Jun 27 04:01:19.099822 np0000003830 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
Jun 27 04:01:20.661310 np0000003830 nova-compute[98984]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98984) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
Jun 27 04:01:20.662039 np0000003830 nova-compute[98984]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98984) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
Jun 27 04:01:20.662039 np0000003830 nova-compute[98984]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
Jun 27 04:01:20.777757 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:01:20.787135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.009s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:01:20.829940 np0000003830 nova-compute[98984]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
Jun 27 04:01:21.597169 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
Jun 27 04:01:21.597335 np0000003830 nova-compute[98984]: INFO nova.utils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] The long task thread pool MainProcess.long_task is initialized
Jun 27 04:01:21.597656 np0000003830 nova-compute[98984]: INFO nova.virt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jun 27 04:01:21.799020 np0000003830 nova-compute[98984]: INFO nova.compute.provider_config [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jun 27 04:01:22.301748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Acquiring lock "singleton_lock" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:01:22.301884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Acquired lock "singleton_lock" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:01:22.302039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Releasing lock "singleton_lock" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:01:22.302211 np0000003830 nova-compute[98984]: WARNING oslo_service.backend._threading.service [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] no_fork=True: running service in main process
Jun 27 04:01:22.302758 np0000003830 nova-compute[98984]: INFO nova.service [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Starting compute node (version 33.1.0)
Jun 27 04:01:22.805200 np0000003830 nova-compute[98984]: INFO nova.utils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] The default thread pool MainProcess.default is initialized
Jun 27 04:01:22.805843 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:01:22.806124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Starting event thread {{(pid=98984) start /opt/stack/nova/nova/virt/libvirt/host.py:251}}
Jun 27 04:01:22.806561 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Starting connection event dispatch thread {{(pid=98984) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}}
Jun 27 04:01:22.807247 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Connecting to libvirt: qemu:///system {{(pid=98984) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}}
Jun 27 04:01:23.293740 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0> {{(pid=98984) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}}
Jun 27 04:01:23.295248 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0> {{(pid=98984) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}}
Jun 27 04:01:23.295928 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Connection event '1' reason 'None'
Jun 27 04:01:23.798742 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Cannot update service status on host "np0000003830" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003830 could not be found.
Jun 27 04:01:23.798881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.mount [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Initialising _HostMountState generation 0 {{(pid=98984) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host capabilities <capabilities>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:   <host>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     <uuid>46a48708-2437-4aca-a317-7807b5e4ff79</uuid>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     <cpu>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <arch>x86_64</arch>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <model>EPYC-Milan</model>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <microcode version='16777317'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <signature family='25' model='1' stepping='1'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <topology sockets='16' dies='1' cores='1' threads='1'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <maxphysaddr mode='emulate' bits='40'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='x2apic'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='tsc-deadline'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='osxsave'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='hypervisor'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='tsc_adjust'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='ospke'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='vaes'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='vpclmulqdq'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='spec-ctrl'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='stibp'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='arch-capabilities'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='ssbd'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='cmp_legacy'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='topoext'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='stibp-always-on'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='virt-ssbd'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='amd-psfd'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='lbrv'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='tsc-scale'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='vmcb-clean'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='flushbyasid'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='pause-filter'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='pfthreshold'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='v-vmsave-vmload'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='vgif'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='no-nested-data-bp'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='lfence-always-serializing'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='null-sel-clr-base'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='rdctl-no'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='skip-l1dfl-vmentry'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='mds-no'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='pschange-mc-no'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <feature name='gds-no'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <pages unit='KiB' size='4'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <pages unit='KiB' size='2048'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <pages unit='KiB' size='1048576'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     </cpu>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     <power_management/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     <iommu support='no'/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     <migration_features>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <live/>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       <uri_transports>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:         <uri_transport>tcp</uri_transport>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:         <uri_transport>rdma</uri_transport>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:       </uri_transports>
Jun 27 04:01:33.950285 np0000003830 nova-compute[98984]:     </migration_features>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:     <topology>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:       <cells num='1'>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:         <cell id='0'>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           <memory unit='KiB'>65844280</memory>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           <pages unit='KiB' size='4'>16461070</pages>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           <pages unit='KiB' size='2048'>0</pages>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           <pages unit='KiB' size='1048576'>0</pages>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           <distances>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <sibling id='0' value='10'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           </distances>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           <cpus num='16'>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='12' socket_id='12' die_id='12' core_id='0' siblings='12'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='13' socket_id='13' die_id='13' core_id='0' siblings='13'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='14' socket_id='14' die_id='14' core_id='0' siblings='14'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:             <cpu id='15' socket_id='15' die_id='15' core_id='0' siblings='15'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:           </cpus>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:         </cell>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:       </cells>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:     </topology>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:     <cache>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
Jun 27 04:01:33.952649 np0000003830 nova-compute[98984]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='12' level='3' type='both' size='32' unit='MiB' cpus='12'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='13' level='3' type='both' size='32' unit='MiB' cpus='13'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='14' level='3' type='both' size='32' unit='MiB' cpus='14'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <bank id='15' level='3' type='both' size='32' unit='MiB' cpus='15'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     </cache>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <secmodel>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <model>apparmor</model>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <doi>0</doi>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     </secmodel>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <secmodel>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <model>dac</model>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <doi>0</doi>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <baselabel type='kvm'>+64055:+993</baselabel>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <baselabel type='qemu'>+64055:+993</baselabel>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     </secmodel>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:   </host>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <arch name='alpha'>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>clipper</machine>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:     <arch name='armv6l'>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.2</machine>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mori-bmc</machine>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>ast2600-evb</machine>
Jun 27 04:01:33.953451 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>borzoi</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>tiogapass-bmc</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>spitz</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.7</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>nuri</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>romulus-bmc</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-3.0</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.0</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>npcm750-evb</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.10</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>rainier-bmc</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps3-an547</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>musca-b1</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>versatileab</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>kzm</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.8</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>fby35-bmc</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>musca-a</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-3.1</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.1</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>smdkc210</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sx1</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.11</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>imx25-pdk</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.9</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>orangepi-pc</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>z2</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.2</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>tosa</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an500</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.12</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mps2-an521</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>sabrelite</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an511</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>canon-a1100</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>realview-eb</machine>
Jun 27 04:01:33.954725 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.0</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.0</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>raspi1ap</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sx1-v1</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>n810</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>g220a-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>n800</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>bletchley-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.1</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.1</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>quanta-gsj</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>versatilepb</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>terrier</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mainstone</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>integratorcp</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.2</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.2</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mps3-an524</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>kudo-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>vexpress-a9</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>midway</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>musicpal</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>lm3s811evb</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>microbit</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='3'>fby35</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an505</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an385</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.0</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.0</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>cubieboard</machine>
Jun 27 04:01:33.955680 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ast1030-evb</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>verdex</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>bpim2u</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>netduino2</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an386</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.1</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.1</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>raspi2b</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>vexpress-a15</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>fuji-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.2</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>cheetah</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.6</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ast2500-evb</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>highbank</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>akita</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>connex</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>netduinoplus2</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>collie</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>raspi0</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:     <arch name='armv7l'>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.2</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mori-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>ast2600-evb</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>borzoi</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>tiogapass-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>spitz</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.7</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>nuri</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>romulus-bmc</machine>
Jun 27 04:01:33.956431 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-3.0</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.0</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>npcm750-evb</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.10</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>rainier-bmc</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps3-an547</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>musca-b1</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>versatileab</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>kzm</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.8</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>fby35-bmc</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>musca-a</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-3.1</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.1</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>smdkc210</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sx1</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.11</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>imx25-pdk</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.9</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>orangepi-pc</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>z2</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.2</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>tosa</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an500</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.12</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mps2-an521</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>sabrelite</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an511</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>canon-a1100</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>realview-eb</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.0</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.0</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>raspi1ap</machine>
Jun 27 04:01:33.957306 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sx1-v1</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>n810</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>g220a-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>n800</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>bletchley-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.1</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.1</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>quanta-gsj</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>versatilepb</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>terrier</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mainstone</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>integratorcp</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.2</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.2</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mps3-an524</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>kudo-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>vexpress-a9</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>midway</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>musicpal</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>lm3s811evb</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>microbit</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='3'>fby35</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an505</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an385</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.0</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.0</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>cubieboard</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ast1030-evb</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>verdex</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>bpim2u</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>netduino2</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an386</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.1</machine>
Jun 27 04:01:33.958370 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.1</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>raspi2b</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>vexpress-a15</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>fuji-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.2</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>cheetah</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.6</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ast2500-evb</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>highbank</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>akita</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>connex</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>netduinoplus2</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>collie</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>raspi0</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:     <arch name='aarch64'>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.2</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mori-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>ast2600-evb</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>borzoi</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>tiogapass-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>spitz</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.7</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>nuri</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>romulus-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-3.0</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.0</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>npcm750-evb</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.10</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>rainier-bmc</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps3-an547</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.8</machine>
Jun 27 04:01:33.959304 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>musca-b1</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>versatileab</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>kzm</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>fby35-bmc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>musca-a</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-3.1</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.1</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>smdkc210</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sx1</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.11</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>imx25-pdk</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.9</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>orangepi-pc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>z2</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-5.2</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>tosa</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an500</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.12</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mps2-an521</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>sabrelite</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an511</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>canon-a1100</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>realview-eb</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>sbsa-ref</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.0</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.0</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>raspi1ap</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sx1-v1</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>n810</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>g220a-bmc</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>n800</machine>
Jun 27 04:01:33.960485 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>bletchley-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.1</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.1</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>quanta-gsj</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>versatilepb</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>terrier</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mainstone</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>integratorcp</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-7.2</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-4.2</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>mps3-an524</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>kudo-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>vexpress-a9</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>midway</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>musicpal</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>lm3s811evb</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>microbit</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='3'>fby35</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an505</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an385</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.0</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.0</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>raspi3ap</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>cubieboard</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ast1030-evb</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>verdex</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>bpim2u</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>netduino2</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mps2-an386</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.1</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-8.1</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>raspi3b</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>raspi2b</machine>
Jun 27 04:01:33.961376 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>vexpress-a15</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='2'>fuji-bmc</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt-6.2</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>cheetah</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>virt-2.6</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ast2500-evb</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>highbank</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>akita</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>connex</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>netduinoplus2</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>collie</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>raspi0</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <acpi default='on' toggle='yes'/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     <arch name='cris'>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>axis-dev88</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:     <arch name='i686'>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-mantic</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jun 27 04:01:33.962602 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-lunar</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-7.1</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jun 27 04:01:33.964114 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>x-remote</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>isapc</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-7.0</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
Jun 27 04:01:33.965226 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-noble</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-8.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-7.2</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>microvm</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jun 27 04:01:33.966386 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <domain type='kvm'/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <pae/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <nonpae/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <acpi default='on' toggle='yes'/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <apic default='on' toggle='no'/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:     <arch name='m68k'>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mcf5208evb</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-7.0</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>an5206</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-6.0</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>q800</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-8.1</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-7.2</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-6.2</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-8.0</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>next-cube</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-7.1</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-6.1</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virt-8.2</machine>
Jun 27 04:01:33.967972 np0000003830 nova-compute[98984]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <arch name='microblaze'>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <arch name='microblazeel'>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <arch name='mips'>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='16'>malta</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mipssim</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <arch name='mipsel'>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='16'>malta</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mipssim</machine>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.969737 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <arch name='mips64'>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='16'>malta</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mipssim</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>pica61</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>magnum</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <arch name='mips64el'>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='16'>malta</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='16'>loongson3-virt</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mipssim</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>pica61</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>magnum</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='16'>boston</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>fuloong2e</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <arch name='ppc'>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>g3beige</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>amigaone</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virtex-ml507</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mac99</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ppce500</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sam460ex</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>pegasos2</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>bamboo</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>40p</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ref405ep</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <machine maxCpus='15'>mpc8544ds</machine>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.971327 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:     <arch name='ppc64'>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-noble</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>amigaone</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='2048'>powernv9</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-4.1</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='15'>mpc8544ds</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-6.1</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.5</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='2048'>powernv10</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-xenial</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-4.2</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-6.2</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-yakkety</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.6</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ppce500</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.7</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-3.0</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-8.0</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-5.0</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>40p</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-lunar</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.8</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>pegasos2</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-hirsute</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-3.1</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-8.1</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-5.1</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-eoan</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.9</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-zesty</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>bamboo</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-groovy</machine>
Jun 27 04:01:33.972402 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-focal</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>g3beige</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-8.2</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-5.2</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-disco</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-mantic</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-kinetic</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.10</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-7.0</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virtex-ml507</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.11</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.1</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-7.1</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-cosmic</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-bionic</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.12</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.2</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-7.2</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mac99</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-impish</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-jammy</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-artful</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sam460ex</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ref405ep</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.3</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='2048'>powernv8</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-4.0</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-6.0</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.4</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:     <arch name='ppc64le'>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-noble</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
Jun 27 04:01:33.973201 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>amigaone</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='2048'>powernv9</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-4.1</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='15'>mpc8544ds</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-6.1</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.5</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='2048'>powernv10</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-xenial</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-4.2</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-6.2</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-yakkety</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.6</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ppce500</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.7</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-3.0</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-8.0</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-5.0</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>40p</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-lunar</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.8</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>pegasos2</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-hirsute</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-3.1</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-8.1</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-5.1</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-eoan</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.9</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-zesty</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>bamboo</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-groovy</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-focal</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>g3beige</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-8.2</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-5.2</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-disco</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-mantic</machine>
Jun 27 04:01:33.973980 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-kinetic</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.10</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-7.0</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>virtex-ml507</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.11</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.1</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-7.1</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-cosmic</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-bionic</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.12</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.2</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-7.2</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>mac99</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-impish</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-jammy</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-artful</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sam460ex</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>ref405ep</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.3</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='2048'>powernv8</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-4.0</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-6.0</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='4096'>pseries-2.4</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     <arch name='riscv32'>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='8'>spike</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>opentitan</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='5'>sifive_u</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sifive_e</machine>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:     <arch name='riscv64'>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.974605 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='512'>virt</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='8'>spike</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='5'>sifive_u</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>shakti_c</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sifive_e</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:     <arch name='s390x'>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jun 27 04:01:33.975570 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     <arch name='sh4'>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>shix</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>r2d</machine>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:     <arch name='sh4eb'>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.976316 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>shix</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>r2d</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <arch name='sparc'>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>SS-5</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>SS-20</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>LX</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>SPARCClassic</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>leon3_generic</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>SPARCbook</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>SS-4</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>SS-600MP</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>SS-10</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>Voyager</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <arch name='sparc64'>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sun4u</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>niagara</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>sun4v</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:     <arch name='x86_64'>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <wordsize>64</wordsize>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-mantic</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jun 27 04:01:33.977208 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-lunar</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-7.1</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
Jun 27 04:01:33.978650 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>x-remote</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='1'>isapc</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
Jun 27 04:01:33.979357 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-7.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-noble</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-8.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-7.2</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>microvm</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jun 27 04:01:33.980079 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <domain type='kvm'/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <acpi default='on' toggle='yes'/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <apic default='on' toggle='no'/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:     <arch name='xtensa'>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>sim</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>kc705</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ml605</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ml605-nommu</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>virt</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx60-nommu</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx200</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx200-nommu</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx60</machine>
Jun 27 04:01:33.980696 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>kc705-nommu</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <guest>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     <os_type>hvm</os_type>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     <arch name='xtensaeb'>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <wordsize>32</wordsize>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='4'>sim</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>kc705</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ml605</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>ml605-nommu</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>virt</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx60-nommu</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx200</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx200-nommu</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>lx60</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <machine maxCpus='32'>kc705-nommu</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <domain type='qemu'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     </arch>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     <features>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <cpuselection/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <deviceboot/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <disksnapshot default='on' toggle='no'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <externalSnapshot/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     </features>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   </guest>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]: </capabilities>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]: 
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-alpha</path>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <machine>clipper</machine>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <arch>alpha</arch>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <vcpu max='4'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.981451 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.982707 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-arm</path>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   <machine>virt-8.2</machine>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   <arch>armv6l</arch>
Jun 27 04:01:33.984267 np0000003830 nova-compute[98984]:   <vcpu max='512'/>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 27 04:01:33.985349 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:33.986176 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.987101 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <gic supported='yes'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <enum name='version'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>2</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>3</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     </gic>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-arm</path>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <machine>virt-8.2</machine>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <arch>armv6l</arch>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <vcpu max='512'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 27 04:01:33.988397 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 27 04:01:33.989944 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.990462 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <gic supported='yes'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       <enum name='version'>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>2</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:         <value>3</value>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     </gic>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:33.991722 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-arm</path>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <machine>virt-8.2</machine>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <arch>armv7l</arch>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <vcpu max='512'/>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     <enum name='firmware'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <value>efi</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 27 04:01:33.992800 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.993612 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.994935 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <gic supported='yes'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <enum name='version'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>2</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>3</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     </gic>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-aarch64</path>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <machine>virt-8.2</machine>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <arch>aarch64</arch>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <vcpu max='512'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <enum name='firmware'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <value>efi</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:33.996321 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1176</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>a64fx</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>ti925t</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1026</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa260</model>
Jun 27 04:01:33.997304 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa250</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa261</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa262</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1110</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sa1100</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm946</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>pxa255</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm926</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:33.998022 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:33.998832 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <gic supported='yes'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='version'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>2</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>3</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     </gic>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-cris</path>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <machine>axis-dev88</machine>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <arch>cris</arch>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.000388 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.001632 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <redirdev supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-i386</path>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <machine>pc-q35-noble-v2</machine>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <arch>i686</arch>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <vcpu max='1024'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.002907 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='lm'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.003888 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.004747 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.005453 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.006391 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-i386</path>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <machine>pc-i440fx-noble</machine>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <arch>i686</arch>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <vcpu max='255'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.007647 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='lm'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.008806 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.009677 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.010580 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.012180 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-i386</path>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <machine>pc-q35-noble</machine>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <arch>i686</arch>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <vcpu max='1024'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.014237 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='lm'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.015947 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.017407 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.018639 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.020097 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-i386</path>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <machine>pc-i440fx-noble-v2</machine>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <arch>i686</arch>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <vcpu max='255'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.022150 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='lm'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.023961 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.025516 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.026398 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.027730 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-m68k</path>
Jun 27 04:01:34.029689 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <machine>mcf5208evb</machine>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <arch>m68k</arch>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.031217 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <redirdev supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-m68k</path>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <machine>virt-8.2</machine>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <arch>m68k</arch>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.033384 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.035184 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <redirdev supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-microblaze</path>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <machine>petalogix-s3adsp1800</machine>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <arch>microblaze</arch>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.037237 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.038733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <redirdev supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-microblazeel</path>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <machine>petalogix-s3adsp1800</machine>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <arch>microblazeel</arch>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.041065 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.042641 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <redirdev supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-mips</path>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <machine>malta</machine>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <arch>mips</arch>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <vcpu max='16'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.044779 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.046398 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-mipsel</path>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <machine>malta</machine>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <arch>mipsel</arch>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <vcpu max='16'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.048366 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.049953 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.052072 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-mips64</path>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <machine>malta</machine>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <arch>mips64</arch>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <vcpu max='16'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.053754 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.055315 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-mips64el</path>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <machine>malta</machine>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <arch>mips64el</arch>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <vcpu max='16'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.057222 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.058733 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-ppc</path>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <machine>g3beige</machine>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <arch>ppc</arch>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.060577 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.062073 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-ppc64</path>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <machine>pseries-noble</machine>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <arch>ppc64</arch>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <vcpu max='4096'/>
Jun 27 04:01:34.063943 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.065529 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>tpm-spapr</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>spapr-tpm-proxy</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.067349 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-ppc64</path>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <machine>powernv9</machine>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <arch>ppc64</arch>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <vcpu max='2048'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.069489 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>tpm-spapr</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>spapr-tpm-proxy</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.071147 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-ppc64</path>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <machine>pseries-noble</machine>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <arch>ppc64</arch>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <vcpu max='4096'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.073122 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.074956 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>tpm-spapr</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>spapr-tpm-proxy</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.076815 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-ppc64le</path>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <machine>powernv9</machine>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <arch>ppc64le</arch>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <vcpu max='2048'/>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.078574 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>tpm-spapr</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>spapr-tpm-proxy</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.080303 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-ppc64le</path>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <machine>pseries-noble</machine>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <arch>ppc64le</arch>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <vcpu max='4096'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER10</model>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER9</model>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER8</model>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='IBM'>POWER7</model>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.082306 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.083967 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>tpm-spapr</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>spapr-tpm-proxy</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-riscv32</path>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   <machine>virt</machine>
Jun 27 04:01:34.085959 np0000003830 nova-compute[98984]:   <arch>riscv32</arch>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   <vcpu max='512'/>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.087588 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.089601 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-riscv64</path>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <machine>virt</machine>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <arch>riscv64</arch>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <vcpu max='512'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>rv64</model>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>any</model>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
Jun 27 04:01:34.091788 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>max</model>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.093027 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.094623 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-s390x</path>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <machine>s390-ccw-virtio-noble</machine>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <arch>s390x</arch>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <vcpu max='248'/>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z13</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.3</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z13-base</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.2</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z196.2-base</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z14</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z14.2-base</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.4</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z196</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
Jun 27 04:01:34.095722 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z114-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen16b</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z890.3-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen16a</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.5</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z196.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>zEC12</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>zEC12.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9EC.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9BC</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z800-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z890</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.4-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9EC.3</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z13.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10BC.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen15a-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z14.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>zBC12-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen16a-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z900.3</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z196-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z14-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z900.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z800</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10EC</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z14ZR1</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z900</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10EC.2</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z900-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10EC.3</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.5-base</model>
Jun 27 04:01:34.096514 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>max</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen15b</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen15a</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.2-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10EC-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen16b-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z114</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9EC-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z13s</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>gen15b-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>zEC12-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z890.3</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z890.2-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z890.2</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10BC-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z890-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9BC-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z10BC</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9EC</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z13.2-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990.3-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z13s-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>zBC12</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z990-base</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <model usable='no' vendor='IBM'>z9BC.2</model>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.097202 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.098304 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <s390-pv supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-sh4</path>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <machine>shix</machine>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <arch>sh4</arch>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.100458 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.102025 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-sh4eb</path>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <machine>shix</machine>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <arch>sh4eb</arch>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.103298 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.104281 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-sparc</path>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.105837 np0000003830 nova-compute[98984]:   <machine>SS-5</machine>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <arch>sparc</arch>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.106789 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <redirdev supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='model'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-sparc64</path>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <machine>sun4u</machine>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <arch>sparc64</arch>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <vcpu max='1'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.108004 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.108984 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.110196 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <machine>pc-q35-noble-v2</machine>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <arch>x86_64</arch>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <vcpu max='1024'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     <enum name='firmware'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <value>efi</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.111277 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.112473 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.113685 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.114577 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.116124 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <machine>pc-i440fx-noble</machine>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <arch>x86_64</arch>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <vcpu max='255'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     <enum name='firmware'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <value>efi</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.118042 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.119843 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.121026 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.121973 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.123895 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <machine>pc-q35-noble</machine>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <arch>x86_64</arch>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <vcpu max='1024'/>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <enum name='firmware'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <value>efi</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.126223 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.128066 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.129267 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.130354 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.132114 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-x86_64</path>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <machine>pc-i440fx-noble-v2</machine>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <arch>x86_64</arch>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <vcpu max='255'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <enum name='firmware'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <value>efi</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='yes'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       <enum name='maximumMigratable'>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>on</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:         <value>off</value>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.134378 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='yes'>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model fallback='forbid'>EPYC</model>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <vendor>AMD</vendor>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='acpi'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='ss'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='monitor'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='hypervisor'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='erms'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='mpx'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='pcommit'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='clwb'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='umip'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='pku'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='vaes'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='la57'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='rdpid'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='pks'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrm'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='fzrm'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrs'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='fsrc'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnowext'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='3dnow'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='xsaveerptr'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='wbnoinvd'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='npt'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='vgif'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='require' name='svme-addr-chk'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='vme'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='xsavec'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='fxsr_opt'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='misalignsse'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='osvw'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='topoext'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <feature policy='disable' name='nrip-save'/>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:     <mode name='custom' supported='yes'>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu64</model>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>qemu32</model>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>phenom</model>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium3</model>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium2</model>
Jun 27 04:01:34.136342 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>pentium</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>n270</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm64</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>kvm32</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>coreduo</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>core2duo</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>athlon</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Westmere</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Snowridge</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>SandyBridge</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Penryn</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Nehalem</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>IvyBridge</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
Jun 27 04:01:34.137644 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Haswell</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='AMD'>EPYC</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Hygon'>Dhyana</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cooperlake</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='Intel'>Conroe</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='no' vendor='Intel'>Broadwell</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <model usable='yes' vendor='unknown'>486</model>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     </mode>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>ide</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.138604 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>vmvga</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>qxl</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>ramfb</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <tpm supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>tpm-tis</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>tpm-crb</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>passthrough</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>emulator</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>external</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='backendVersion'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>1.2</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>2.0</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </tpm>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.140301 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='yes'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <genid supported='yes'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <hyperv supported='yes'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       <enum name='features'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>relaxed</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>vapic</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>spinlocks</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>vpindex</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>runtime</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>synic</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>stimer</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>reset</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>vendor_id</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>frequencies</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>reenlightenment</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>tlbflush</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>ipi</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>avic</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     </hyperv>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-xtensa</path>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <machine>sim</machine>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <arch>xtensa</arch>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <vcpu max='4'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.142551 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.144217 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98984) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}}
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]: <domainCapabilities>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:   <path>/usr/bin/qemu-system-xtensaeb</path>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:   <domain>qemu</domain>
Jun 27 04:01:34.146475 np0000003830 nova-compute[98984]:   <machine>sim</machine>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <arch>xtensaeb</arch>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <vcpu max='4'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <iothreads supported='yes'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <os supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <enum name='firmware'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <loader supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>rom</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>pflash</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='readonly'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>yes</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='secure'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>no</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     </loader>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <cpu>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <mode name='host-passthrough' supported='no'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <mode name='maximum' supported='no'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <mode name='host-model' supported='no'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <mode name='custom' supported='no'/>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <memoryBacking supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <enum name='sourceType'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <value>file</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <value>anonymous</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <value>memfd</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   </memoryBacking>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <disk supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='diskDevice'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>disk</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>cdrom</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>floppy</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>lun</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>fdc</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>sata</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <graphics supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>sdl</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>vnc</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>spice</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>egl-headless</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>dbus</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <video supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='modelType'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>vga</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>cirrus</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>none</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>bochs</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:     <hostdev supported='yes'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       <enum name='mode'>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:         <value>subsystem</value>
Jun 27 04:01:34.148262 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='startupPolicy'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>default</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>mandatory</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>requisite</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>optional</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='subsysType'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>pci</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>scsi</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='capsType'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='pciBackend'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     </hostdev>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <rng supported='yes'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>virtio-transitional</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>virtio-non-transitional</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>random</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>egd</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <filesystem supported='yes'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='driverType'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>path</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>handle</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>virtiofs</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     </filesystem>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <tpm supported='no'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <redirdev supported='yes'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='bus'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>usb</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     </redirdev>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <channel supported='yes'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>pty</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>unix</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>spicevmc</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     </channel>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <crypto supported='yes'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='model'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>virtio</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='type'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>qemu</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       <enum name='backendModel'>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:         <value>builtin</value>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:       </enum>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     </crypto>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <gic supported='no'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <vmcoreinfo supported='no'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <genid supported='no'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <backingStoreInput supported='yes'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <backup supported='yes'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <async-teardown supported='yes'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <sev supported='no'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:     <sgx supported='no'/>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]: </domainCapabilities>
Jun 27 04:01:34.150378 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}}
Jun 27 04:01:34.152376 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Checking secure boot support for host arch (x86_64) {{(pid=98984) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}}
Jun 27 04:01:34.152376 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Secure Boot support detected
Jun 27 04:01:34.557297 np0000003830 nova-compute[98984]: INFO nova.virt.node [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Generated node identity d6db2083-b24e-4fc9-8e4d-9a740cf9bf37
Jun 27 04:01:34.557471 np0000003830 nova-compute[98984]: INFO nova.virt.node [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Wrote node identity d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 to /opt/stack/data/nova/compute_id
Jun 27 04:01:35.059818 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Compute nodes ['d6db2083-b24e-4fc9-8e4d-9a740cf9bf37'] for host np0000003830 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jun 27 04:01:36.063931 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jun 27 04:01:37.068442 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] No compute node record found for host np0000003830. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003830 could not be found.
Jun 27 04:01:37.068875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:01:37.068875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:01:37.068931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:01:37.069024 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:01:37.133573 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:01:37.134406 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:01:37.148160 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:01:37.148531 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Hypervisor/Node resource view: name=np0000003830 free_ram=55571MB free_disk=75.19957733154297GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:01:37.148695 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:01:37.148941 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:01:37.651939 np0000003830 nova-compute[98984]: WARNING nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] No compute node record for np0000003830:d6db2083-b24e-4fc9-8e4d-9a740cf9bf37: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 could not be found.
Jun 27 04:01:38.156323 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Compute node record created for np0000003830:np0000003830 with uuid: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37
Jun 27 04:01:39.663190 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:01:39.663652 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:01:37 up 24 min,  2 users,  load average: 3.04, 1.89, 0.97\n'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:01:40.111995 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] [req-292dc287-ac59-4099-8533-e26c2b234a62] Created resource provider record via placement API for resource provider with UUID d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 and name np0000003830.
Jun 27 04:01:40.160916 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] /sys/module/kvm_amd/parameters/sev contains [N
Jun 27 04:01:40.160916 np0000003830 nova-compute[98984]: ] {{(pid=98984) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}}
Jun 27 04:01:40.161084 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.host [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] kernel doesn't support AMD SEV
Jun 27 04:01:40.161221 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:01:40.161375 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:01:40.161649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Libvirt baseline CPU <cpu>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]:   <arch>x86_64</arch>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]:   <model>Nehalem</model>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]:   <vendor>AMD</vendor>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]:   <topology sockets="16" cores="1" threads="1"/>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]:   <maxphysaddr mode="emulate" bits="40"/>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]: </cpu>
Jun 27 04:01:40.166169 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13763}}
Jun 27 04:01:40.775685 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Updated inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
Jun 27 04:01:40.776080 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Updating resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 generation from 0 to 1 during operation: update_inventory {{(pid=98984) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jun 27 04:01:40.776080 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:01:40.950654 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Updating resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 generation from 1 to 2 during operation: update_traits {{(pid=98984) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jun 27 04:01:41.457136 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:01:41.457307 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.308s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:01:41.457488 np0000003830 nova-compute[98984]: DEBUG nova.service [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98984) start /opt/stack/nova/nova/service.py:196}}
Jun 27 04:01:41.470363 np0000003830 nova-compute[98984]: DEBUG nova.service [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98984) start /opt/stack/nova/nova/service.py:212}}
Jun 27 04:01:41.483266 np0000003830 nova-compute[98984]: DEBUG nova.service [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] Join ServiceGroup membership for this service compute {{(pid=98984) start /opt/stack/nova/nova/service.py:222}}
Jun 27 04:01:41.483478 np0000003830 nova-compute[98984]: DEBUG nova.servicegroup.drivers.db [None req-903bd387-afea-4e4f-834c-93e8d5a4f822 None None] DB_Driver: join new ServiceGroup member np0000003830 to the compute group, service = <Service: host=np0000003830, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98984) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jun 27 04:01:46.986963 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:02:12.485372 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:12.988230 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:12.989140 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.84 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:02:20.831246 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.831841 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.831841 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.832050 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.832276 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.832470 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.832675 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:20.832802 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:02:20.832999 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:02:21.336900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:02:21.337060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:02:21.337213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:02:21.337349 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:02:21.347671 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:02:21.348519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:02:21.364695 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:02:21.365254 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=55303MB free_disk=75.05119705200195GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:02:21.365428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:02:21.365667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:02:22.414549 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:02:22.414549 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:02:21 up 25 min,  2 users,  load average: 2.27, 1.86, 1.01\n'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:02:22.457091 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:02:22.457319 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:02:22.959962 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:02:23.466467 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:02:23.466999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:02:23.466999 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:03:23.461712 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.462155 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.462155 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.462421 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.462660 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.462903 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.463102 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.463272 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.463383 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:03:23.463557 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:03:23.966814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:03:23.966956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:03:23.967060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:03:23.967172 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:03:23.976460 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:03:23.977303 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:03:23.991322 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:03:23.991649 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=55305MB free_disk=74.83265686035156GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:03:23.991800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:03:23.991976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:03:25.045781 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:03:25.046221 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:03:23 up 26 min,  2 users,  load average: 1.40, 1.69, 1.00\n'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:03:25.095299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:03:25.095598 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:03:25.598351 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:03:26.105041 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:03:26.105702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.113s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:03:26.105702 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:03:46.990684 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:03:58.985362 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:03:58.985362 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:03:59.488378 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:00.063343 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:00.063343 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:00.066147 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:00.066398 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Claim successful on node np0000003830
Jun 27 04:04:00.962166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:00.962760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:01.252720 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:01.253632 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:01.468695 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:01.758837 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:02.068424 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:02.267552 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.204s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:02.270287 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.204s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:02.270287 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:02.274934 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:02.275095 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Claim successful on node np0000003830
Jun 27 04:04:02.785563 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:02.785563 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:02.785563 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:02.787095 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:03.301621 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:03.520514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:03.520514 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:03.737073 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2bd621defb420db9fd8345c5b36248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771234de69074fed81ffef19dcee2804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:03.806137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:04.022777 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:04.532455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.264s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:04.532996 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:04.816010 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:04.817375 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:04.817707 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Creating image(s)
Jun 27 04:04:04.818373 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:04.818606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:04.819311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:04.819800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:04.820829 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:04.914051 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Successfully created port: 13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:05.042538 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:05.042538 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:05.042538 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:05.042538 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:05.164128 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:05.167079 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:05.167430 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:05.230949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.part --force-share --output=json" returned: 0 in 0.063s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:05.231672 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ebd84a34-fa18-42ad-a673-89aa8032841e was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:04:05.232959 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:04:05.233364 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.part /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:05.432751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.part /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.converted" returned: 0 in 0.199s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:05.439396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:05.498739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26.converted --force-share --output=json" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:05.499436 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.679s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:05.499925 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:05.502613 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:05.503435 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplvm4sgv1/privsep.sock']
Jun 27 04:04:05.510785 np0000003830 sudo[110358]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplvm4sgv1/privsep.sock
Jun 27 04:04:05.511415 np0000003830 sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
Jun 27 04:04:05.546699 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:05.638701 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb2d09351b2447bbfce95b09ad97b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b76ce35cec84d189228639d70c6be45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:05.822346 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 27 04:04:05.822346 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 27 04:04:05.822346 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 27 04:04:05.822346 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:05.822346 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 27 04:04:05.823167 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 27 04:04:05.823167 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 27 04:04:05.823167 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:05.823167 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 27 04:04:06.054336 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:06.198770 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 27 04:04:06.198867 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 27 04:04:06.198922 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 27 04:04:06.198971 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:06.198971 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 27 04:04:06.199055 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 27 04:04:06.199157 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 27 04:04:06.199157 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:06.199157 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 27 04:04:06.491114 np0000003830 sudo[110358]: pam_unix(sudo:session): session closed for user root
Jun 27 04:04:06.492793 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Spawned new privsep daemon via rootwrap
Jun 27 04:04:06.494168 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 27 04:04:06.494266 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 27 04:04:06.494327 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 27 04:04:06.494429 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110391
Jun 27 04:04:06.598573 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:06.676606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:06.677141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:06.677978 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:06.680159 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:06.683765 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:06.683765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:06.750181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:06.750181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:06.766007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.082s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:06.766620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:06.808179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk 1073741824" returned: 0 in 0.041s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:06.808692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.131s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:06.809124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:06.888884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.079s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:06.889337 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:06.889650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:06.979451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:06.980203 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Cannot resize image /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:06.980696 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:06.980892 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Ensure instance console log exists: /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:06.981199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:06.982224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:06.982224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:07.027308 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Successfully updated port: 13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:07.067386 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:07.070278 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:07.070278 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Creating image(s)
Jun 27 04:04:07.070997 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "/opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:07.070997 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:07.071629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:07.072923 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:07.077086 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:07.078231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:07.161054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.082s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:07.161727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:07.162564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:07.163949 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:07.170652 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:07.171075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:07.250814 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:07.264473 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:07.267875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:07.314526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk 1073741824" returned: 0 in 0.049s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:07.316190 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:07.316190 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:07.399455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.083s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:07.400012 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:07.401042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:07.478649 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:07.478988 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Cannot resize image /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:07.479379 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:07.479719 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Ensure instance console log exists: /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:07.480078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:07.480342 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:07.480546 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:07.532399 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-6ce1c75a-8520-40b5-a060-9580f2f789ed" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:07.532669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-6ce1c75a-8520-40b5-a060-9580f2f789ed" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:07.532896 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:07.749075 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Successfully created port: e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:07.842752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:07.843031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:07.848848 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:07.848848 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Claim successful on node np0000003830
Jun 27 04:04:08.184368 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-changed-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:08.184944 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Refreshing instance network info cache due to event network-changed-13143fe3-8cca-410a-af2e-7235fa68ee4e. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:08.185107 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] Acquiring lock "refresh_cache-6ce1c75a-8520-40b5-a060-9580f2f789ed" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:08.208209 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:08.500022 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:08.580533 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Successfully updated port: e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:08.659940 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Updating instance_info_cache with network_info: [{"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:09.086413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:09.086413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:09.086413 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:09.160934 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:09.161265 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:09.163459 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-6ce1c75a-8520-40b5-a060-9580f2f789ed" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:09.163713 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Instance network_info: |[{"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:09.164263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] Acquired lock "refresh_cache-6ce1c75a-8520-40b5-a060-9580f2f789ed" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:09.166739 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Start _get_guest_xml network_info=[{"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:09.167447 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Refreshing network info cache for port 13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:09.173293 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:09.176647 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1026515125', uuid='6ce1c75a-8520-40b5-a060-9580f2f789ed'), owner=OwnerMeta(userid='6c2bd621defb420db9fd8345c5b36248', username='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member', projectid='771234de69074fed81ffef19dcee2804', projectname='tempest-ServerBootFromVolumeStableRescueTest-2029132639'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533049.1750977) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:09.179243 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:09.180876 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:09.181941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:09.182857 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:09.183872 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:09.186892 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:09.186892 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:09.186892 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:09.186892 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:09.186892 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:09.186892 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:09.187146 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:09.187146 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:09.187589 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:09.187781 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:09.188541 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:09.207060 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:04:09.207833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1026515125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1026515125',id=1,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-mur9hnh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:04Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6ce1c75a-8520-40b5-a060-9580f2f789ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:09.208057 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:09.208934 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:09.210165 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ce1c75a-8520-40b5-a060-9580f2f789ed {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:09.667339 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:09.673452 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:09.708484 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <uuid>6ce1c75a-8520-40b5-a060-9580f2f789ed</uuid>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <name>instance-00000001</name>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1026515125</nova:name>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:09</nova:creationTime>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:user uuid="6c2bd621defb420db9fd8345c5b36248">tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member</nova:user>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:project uuid="771234de69074fed81ffef19dcee2804">tempest-ServerBootFromVolumeStableRescueTest-2029132639</nova:project>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         <nova:port uuid="13143fe3-8cca-410a-af2e-7235fa68ee4e">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <entry name="serial">6ce1c75a-8520-40b5-a060-9580f2f789ed</entry>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <entry name="uuid">6ce1c75a-8520-40b5-a060-9580f2f789ed</entry>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.config"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:82:85:ac"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <target dev="tap13143fe3-8c"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/console.log" append="off"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:09.714008 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:09.717426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Preparing to wait for external event network-vif-plugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:09.717426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:09.717426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:09.717426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:09.717426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1026515125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1026515125',id=1,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-mur9hnh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:04Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6ce1c75a-8520-40b5-a060-9580f2f789ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:09.718701 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:09.718701 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:09.718701 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:09.775114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Created schema index Interface.name {{(pid=98984) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jun 27 04:04:09.775114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Created schema index Port.name {{(pid=98984) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jun 27 04:04:09.775114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Created schema index Bridge.name {{(pid=98984) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jun 27 04:04:09.775114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:04:09.775114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [POLLOUT] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.775114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:04:09.775829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.777554 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3611201-1dc3-5f4f-a4a8-b9f5dd002016', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:09.831400 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpaa5qh3ou/privsep.sock']
Jun 27 04:04:09.829423 np0000003830 sudo[110610]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpaa5qh3ou/privsep.sock
Jun 27 04:04:09.830363 np0000003830 sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
Jun 27 04:04:09.988087 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-changed-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:09.988298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Refreshing instance network info cache due to event network-changed-e8e16ef8-1d1a-4e8b-8975-d89037659b92. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:09.988526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] Acquiring lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:10.050069 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:10.140171 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 27 04:04:10.178526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.334s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:10.178526 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:10.263719 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updating instance_info_cache with network_info: [{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:10.328088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:10.328311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:10.394615 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:10.570908 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 27 04:04:10.570908 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 27 04:04:10.571121 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 27 04:04:10.571121 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:10.571121 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 27 04:04:10.571121 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 27 04:04:10.571282 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 27 04:04:10.571282 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:10.571282 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 27 04:04:10.686876 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:10.686876 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:10.690956 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:10.694826 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:10.757182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:10.763783 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Instance network_info: |[{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:10.763783 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] Acquired lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:10.763783 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Refreshing network info cache for port e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:10.763783 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Start _get_guest_xml network_info=[{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:10.764350 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:10.765529 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2083219872', uuid='99670311-67bb-4d60-b854-655dc01f2722'), owner=OwnerMeta(userid='ebb2d09351b2447bbfce95b09ad97b23', username='tempest-ServerActionsTestOtherA-1390022329-project-member', projectid='4b76ce35cec84d189228639d70c6be45', projectname='tempest-ServerActionsTestOtherA-1390022329'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533050.7651098) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:10.772017 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Updated VIF entry in instance network info cache for port 13143fe3-8cca-410a-af2e-7235fa68ee4e. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:10.772017 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Updating instance_info_cache with network_info: [{"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:10.774715 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:10.775388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:10.777126 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:10.777433 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:10.779245 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:10.779727 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:10.780289 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:10.781661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:10.781661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:10.781661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:10.781661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:10.781661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:10.781661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:10.781943 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:10.782070 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:10.783438 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:10.806556 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083219872',display_name='tempest-ServerActionsTestOtherA-server-2083219872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-2083219872',id=2,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-mwlag0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=99670311-67bb-4d60-b854-655dc01f2722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:10.806556 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:10.806556 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:10.807226 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'pci_devices' on Instance uuid 99670311-67bb-4d60-b854-655dc01f2722 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:10.830912 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:10.867791 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Spawned new privsep daemon via rootwrap
Jun 27 04:04:10.864480 np0000003830 sudo[110610]: pam_unix(sudo:session): session closed for user root
Jun 27 04:04:10.868124 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 27 04:04:10.868396 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 27 04:04:10.868609 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jun 27 04:04:10.868890 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110639
Jun 27 04:04:10.898844 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9a99814caeb41859b0a2000f52a4c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20eaa28753124b488bd3e69bbc01af54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:11.160839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.160839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13143fe3-8c, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.160839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13143fe3-8c, col_values=(('qos', UUID('34b64aea-5ba0-4563-9bc4-79d309432c40')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.160839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13143fe3-8c, col_values=(('external_ids', {'iface-id': '13143fe3-8cca-410a-af2e-7235fa68ee4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:85:ac', 'vm-uuid': '6ce1c75a-8520-40b5-a060-9580f2f789ed'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.161754 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.163793 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:11.170004 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.170383 np0000003830 nova-compute[98984]: INFO os_vif [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c')
Jun 27 04:04:11.193783 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:11.262195 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:11.274653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e335cbb0-2844-4fa5-aebf-7f307d4b614c req-e4c492d2-0432-4261-b157-264231238ece service nova] Releasing lock "refresh_cache-6ce1c75a-8520-40b5-a060-9580f2f789ed" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <uuid>99670311-67bb-4d60-b854-655dc01f2722</uuid>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <name>instance-00000002</name>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherA-server-2083219872</nova:name>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:10</nova:creationTime>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:user uuid="ebb2d09351b2447bbfce95b09ad97b23">tempest-ServerActionsTestOtherA-1390022329-project-member</nova:user>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:project uuid="4b76ce35cec84d189228639d70c6be45">tempest-ServerActionsTestOtherA-1390022329</nova:project>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         <nova:port uuid="e8e16ef8-1d1a-4e8b-8975-d89037659b92">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <entry name="serial">99670311-67bb-4d60-b854-655dc01f2722</entry>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <entry name="uuid">99670311-67bb-4d60-b854-655dc01f2722</entry>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.config"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:dc:c5:54"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <target dev="tape8e16ef8-1d"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/console.log" append="off"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Preparing to wait for external event network-vif-plugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:11.307034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:11.311341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:11.311341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:11.311341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083219872',display_name='tempest-ServerActionsTestOtherA-server-2083219872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-2083219872',id=2,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-mwlag0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=99670311-67bb-4d60-b854-655dc01f2722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:11.311785 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:11.311785 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:11.311785 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:11.311785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.311785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.311785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:11.314118 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.314118 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd73afef3-3970-55d5-b65b-9a344fa2b12f', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.314722 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.316174 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:11.321466 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.324842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.325411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8e16ef8-1d, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.325529 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8e16ef8-1d, col_values=(('qos', UUID('0be54612-a7d1-4733-92fb-0811a0391cb7')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.325774 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8e16ef8-1d, col_values=(('external_ids', {'iface-id': 'e8e16ef8-1d1a-4e8b-8975-d89037659b92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:c5:54', 'vm-uuid': '99670311-67bb-4d60-b854-655dc01f2722'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:11.327270 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.328981 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:11.347050 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.348292 np0000003830 nova-compute[98984]: INFO os_vif [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d')
Jun 27 04:04:11.413637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:11.413943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:11.418646 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:11.418646 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Claim successful on node np0000003830
Jun 27 04:04:11.710867 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:11.745289 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:11.851098 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:12.038159 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Successfully created port: 192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:12.138823 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fce05694-6c60-476a-a921-61a742e8d6eb req-bbd67289-a024-4faf-b3db-977e3e3ae208 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:12.139803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fce05694-6c60-476a-a921-61a742e8d6eb req-bbd67289-a024-4faf-b3db-977e3e3ae208 service nova] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:12.139803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fce05694-6c60-476a-a921-61a742e8d6eb req-bbd67289-a024-4faf-b3db-977e3e3ae208 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:12.139944 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fce05694-6c60-476a-a921-61a742e8d6eb req-bbd67289-a024-4faf-b3db-977e3e3ae208 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:12.140137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fce05694-6c60-476a-a921-61a742e8d6eb req-bbd67289-a024-4faf-b3db-977e3e3ae208 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] No event matching network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 in dict_keys([('network-vif-plugged', 'e8e16ef8-1d1a-4e8b-8975-d89037659b92')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:04:12.140320 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-fce05694-6c60-476a-a921-61a742e8d6eb req-bbd67289-a024-4faf-b3db-977e3e3ae208 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received unexpected event network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 for instance with vm_state building and task_state spawning.
Jun 27 04:04:12.213583 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updated VIF entry in instance network info cache for port e8e16ef8-1d1a-4e8b-8975-d89037659b92. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:12.213583 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updating instance_info_cache with network_info: [{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:12.694183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:12.694546 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:12.694773 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No VIF found with MAC fa:16:3e:82:85:ac, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:12.695435 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Using config drive
Jun 27 04:04:12.711315 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:12.712054 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:12.712320 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Creating image(s)
Jun 27 04:04:12.712820 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:12.713029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:12.713670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:12.714761 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:12.716436 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bbae7ac9-60b9-43fc-84f1-4d5a3b7c6f24 req-feeaf0b2-da12-496c-b0a1-29510a78a432 service nova] Releasing lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:12.740795 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:12.740795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:12.741595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:12.741819 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:12.795202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.073s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:12.796045 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:12.796550 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:12.797079 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:12.800629 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:12.801004 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:12.864174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.063s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:12.864854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:12.885771 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:12.885908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:12.886024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No VIF found with MAC fa:16:3e:dc:c5:54, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:12.886752 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Using config drive
Jun 27 04:04:12.912814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk 1073741824" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:12.913291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.117s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:12.913676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:12.988096 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.074s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:12.988664 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:12.988996 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:13.066021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:13.066409 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Cannot resize image /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:13.066789 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:13.066947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Ensure instance console log exists: /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:13.067231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:13.067430 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:13.067585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:13.203079 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:13.246809 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:13.345204 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Successfully updated port: 192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:13.396688 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:13.764277 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.344s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:13.764277 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:13.791566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:13.848554 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:13.848554 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquired lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:13.848814 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:13.948711 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Creating config drive at /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.config
Jun 27 04:04:13.979201 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Creating config drive at /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.config
Jun 27 04:04:13.982955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplbtmuqtl {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:14.003558 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxumk1air {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:14.026525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplbtmuqtl" returned: 0 in 0.044s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:14.037822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxumk1air" returned: 0 in 0.035s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:14.194629 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-changed-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:14.194629 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Refreshing instance network info cache due to event network-changed-192d7226-ce75-4535-b9af-861512f1c37c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:14.194629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] Acquiring lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:14.275437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:14.275437 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:14.275437 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:14.275437 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:14.454548 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:14.461843 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd8d831825d64665b8175e5d7a1eb681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a658c179c6fe462db19eb1a17419ab06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:14.707518 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:14.775979 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:14.880281 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:14.939298 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:14.964358 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.076846 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.095790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.228084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.228378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.281539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:15.337173 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.382871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Releasing lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:15.383215 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Instance network_info: |[{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:15.384625 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] Acquired lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:15.384625 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Refreshing network info cache for port 192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:15.387748 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Start _get_guest_xml network_info=[{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:15.399105 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:15.401037 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1270200106', uuid='c1d90648-3e76-41e4-9f71-9178785a8979'), owner=OwnerMeta(userid='e9a99814caeb41859b0a2000f52a4c38', username='tempest-TaggedAttachmentsTest-1939092029-project-member', projectid='20eaa28753124b488bd3e69bbc01af54', projectname='tempest-TaggedAttachmentsTest-1939092029'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533055.400416) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:15.408195 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:15.409107 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:15.415563 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:15.416771 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:15.417425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:15.417904 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:15.418562 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:15.418562 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:15.418797 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:15.418961 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:15.419215 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:15.419958 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:15.419958 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:15.420126 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:15.420292 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:15.420473 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:15.443952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:15.445547 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:15.446428 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:15.447851 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'pci_devices' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:15.477746 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b1746661-cb37-4b14-b9c6-30c04b93562e req-bc4b52ff-c619-4d99-8890-3310f422c3e9 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-vif-plugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:15.477993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b1746661-cb37-4b14-b9c6-30c04b93562e req-bc4b52ff-c619-4d99-8890-3310f422c3e9 service nova] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:15.478724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b1746661-cb37-4b14-b9c6-30c04b93562e req-bc4b52ff-c619-4d99-8890-3310f422c3e9 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:15.478724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b1746661-cb37-4b14-b9c6-30c04b93562e req-bc4b52ff-c619-4d99-8890-3310f422c3e9 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:15.479035 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b1746661-cb37-4b14-b9c6-30c04b93562e req-bc4b52ff-c619-4d99-8890-3310f422c3e9 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Processing event network-vif-plugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:15.891128 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:15.909421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:15.911533 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:15.935155 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Successfully created port: fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <uuid>c1d90648-3e76-41e4-9f71-9178785a8979</uuid>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <name>instance-00000003</name>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:15</nova:creationTime>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <entry name="serial">c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <entry name="uuid">c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:ae:33:c8"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <target dev="tap192d7226-ce"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log" append="off"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:15.953861 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:15.956641 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Preparing to wait for external event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:15.956641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:15.956641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:15.956641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:15.956641 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:15.956937 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:15.959875 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:15.959875 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:15.960479 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.960910 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:15.961282 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:15.966355 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.966820 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8141239-942e-5fa9-8ff2-8a89488fcb8a', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:15.967984 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.968972 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:15.974812 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.975459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap192d7226-ce, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:15.975459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap192d7226-ce, col_values=(('qos', UUID('85fe8042-add2-48f4-bd45-5857f1c6a110')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:15.975732 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap192d7226-ce, col_values=(('external_ids', {'iface-id': '192d7226-ce75-4535-b9af-861512f1c37c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:33:c8', 'vm-uuid': 'c1d90648-3e76-41e4-9f71-9178785a8979'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:15.977488 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.979824 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:15.986838 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:15.988784 np0000003830 nova-compute[98984]: INFO os_vif [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce')
Jun 27 04:04:16.298813 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:16.300057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:16.300874 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Creating image(s)
Jun 27 04:04:16.303322 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "/opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:16.303585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "/opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:16.304455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "/opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:16.305057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "0fd2c3bd46355bb4b28732ff17d691133c0ce82b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:16.305234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "0fd2c3bd46355bb4b28732ff17d691133c0ce82b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:16.413107 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:16.450162 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:16.525780 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:16.527210 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782533056.5269248, 99670311-67bb-4d60-b854-655dc01f2722 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:16.527472 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] VM Started (Lifecycle Event)
Jun 27 04:04:16.530232 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:16.539231 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Instance spawned successfully.
Jun 27 04:04:16.539757 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:16.749216 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updated VIF entry in instance network info cache for port 192d7226-ce75-4535-b9af-861512f1c37c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:16.749216 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:17.000306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:17.000710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:17.006212 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:17.006613 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Claim successful on node np0000003830
Jun 27 04:04:17.030518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:17.034395 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:17.046421 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:17.054124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:17.054124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:17.054124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:17.054832 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:17.059191 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:17.059191 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:17.252078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7e211990-7ea0-4801-b0ef-66762b187fb2 req-83a729db-e1a8-404d-b1b6-161cd410064f service nova] Releasing lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:17.495316 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:17.500748 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:17.501257 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:17.530023 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:17.530023 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:17.530247 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No VIF found with MAC fa:16:3e:ae:33:c8, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:17.533839 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Using config drive
Jun 27 04:04:17.539625 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:17.540251 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533057.5388515, 99670311-67bb-4d60-b854-655dc01f2722 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:17.544522 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] VM Paused (Lifecycle Event)
Jun 27 04:04:17.562541 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Successfully updated port: fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:17.570748 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Took 10.50 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:17.571381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:17.578164 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-38b145f7-8f89-411f-a3c6-70eaff495c88 req-5d4338b3-beae-44c4-87ec-73fba838789c service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-vif-plugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:17.578417 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-38b145f7-8f89-411f-a3c6-70eaff495c88 req-5d4338b3-beae-44c4-87ec-73fba838789c service nova] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:17.578698 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-38b145f7-8f89-411f-a3c6-70eaff495c88 req-5d4338b3-beae-44c4-87ec-73fba838789c service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:17.578897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-38b145f7-8f89-411f-a3c6-70eaff495c88 req-5d4338b3-beae-44c4-87ec-73fba838789c service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:17.579053 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-38b145f7-8f89-411f-a3c6-70eaff495c88 req-5d4338b3-beae-44c4-87ec-73fba838789c service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] No waiting events found dispatching network-vif-plugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:17.579486 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-38b145f7-8f89-411f-a3c6-70eaff495c88 req-5d4338b3-beae-44c4-87ec-73fba838789c service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received unexpected event network-vif-plugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 for instance with vm_state building and task_state spawning.
Jun 27 04:04:17.608195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.part --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:17.608928 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] 8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7 was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:04:17.610963 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:04:17.611923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.part /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:17.643720 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-changed-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:17.643720 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Refreshing instance network info cache due to event network-changed-fde3de09-acd7-41da-91df-6a87204801b1. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:17.643720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] Acquiring lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:17.643720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] Acquired lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:17.644657 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Refreshing network info cache for port fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:17.896280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.part /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.converted" returned: 0 in 0.285s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:17.906094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:17.994139 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:17.994854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "0fd2c3bd46355bb4b28732ff17d691133c0ce82b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.690s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:17.995430 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:17.999071 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:18.002086 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:18.055987 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:18.059359 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:18.061544 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533058.0612354, 99670311-67bb-4d60-b854-655dc01f2722 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:18.061748 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] VM Resumed (Lifecycle Event)
Jun 27 04:04:18.065425 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:18.100768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:18.101120 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "0fd2c3bd46355bb4b28732ff17d691133c0ce82b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:18.104577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "0fd2c3bd46355bb4b28732ff17d691133c0ce82b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:18.104577 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:18.110920 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:18.114374 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:18.125566 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Took 16.15 seconds to build instance.
Jun 27 04:04:18.152416 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:18.229615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b --force-share --output=json" returned: 0 in 0.118s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:18.230057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b,backing_fmt=raw /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:18.279191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b,backing_fmt=raw /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk 1073741824" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:18.279191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "0fd2c3bd46355bb4b28732ff17d691133c0ce82b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:18.279421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:18.334733 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:18.383952 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Creating config drive at /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config
Jun 27 04:04:18.386508 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fd2c3bd46355bb4b28732ff17d691133c0ce82b --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:18.386867 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:18.387112 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:18.412995 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ti6x0ny {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:18.461625 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7ti6x0ny" returned: 0 in 0.049s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:18.497275 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:18.498051 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Cannot resize image /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:18.498610 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:18.498687 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Ensure instance console log exists: /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:18.499019 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:18.499452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:18.499692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:18.523704 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:18.534644 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:18.540273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:18.559888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:18.565626 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:18.570925 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:18.577051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:18.629749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6f82114d-c742-4890-b27c-f4ede040439e tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.667s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:18.648358 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:18.723456 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:18.724299 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:18.759536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:18.759536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:18.794781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:18.817331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:18.818799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:18.992528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.010980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.081614 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533059.0812724, 6ce1c75a-8520-40b5-a060-9580f2f789ed => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:19.081775 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] VM Started (Lifecycle Event)
Jun 27 04:04:19.151943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7b53c00a-c478-427a-98bf-cb568b6bd17c req-1468b2ab-62fa-424f-b88f-66eb742a18a9 service nova] Releasing lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:19.151943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquired lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:19.152038 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:19.152842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.227692 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:19.260778 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:19.321631 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:19.459065 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.461520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.470397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.486694 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:19.584627 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:19.587185 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533059.5867145, 6ce1c75a-8520-40b5-a060-9580f2f789ed => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:19.587185 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] VM Paused (Lifecycle Event)
Jun 27 04:04:19.739312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.739s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:19.739822 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:19.748847 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-25ec24d0-2481-4d0e-a7ec-845a10c136ac req-b9290e66-df05-4dbd-a507-0a11d3e4d480 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:19.749192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-25ec24d0-2481-4d0e-a7ec-845a10c136ac req-b9290e66-df05-4dbd-a507-0a11d3e4d480 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:19.749599 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-25ec24d0-2481-4d0e-a7ec-845a10c136ac req-b9290e66-df05-4dbd-a507-0a11d3e4d480 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:19.749675 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-25ec24d0-2481-4d0e-a7ec-845a10c136ac req-b9290e66-df05-4dbd-a507-0a11d3e4d480 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:19.749888 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-25ec24d0-2481-4d0e-a7ec-845a10c136ac req-b9290e66-df05-4dbd-a507-0a11d3e4d480 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Processing event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:19.801618 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:19.872866 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:19.874074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:19.881638 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:19.881638 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Claim successful on node np0000003830
Jun 27 04:04:19.923686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:20.043848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:20.043848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:20.052733 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:20.077791 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:20.091481 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:20.097412 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:20.223938 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:20.234058 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:20.238960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:20.242229 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Instance spawned successfully.
Jun 27 04:04:20.242587 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:20.250528 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:20.250856 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:20.251162 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:20.252942 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:20.377153 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f781ed15934c4a6196eb78da918870d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '046700119b2245e488737e7955caf69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:20.381255 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-changed-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:20.381439 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Refreshing instance network info cache due to event network-changed-e8e16ef8-1d1a-4e8b-8975-d89037659b92. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:20.381547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] Acquiring lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:20.381632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] Acquired lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:20.381738 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Refreshing network info cache for port e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:20.414689 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Updating instance_info_cache with network_info: [{"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:20.601027 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:20.602676 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533060.6016347, c1d90648-3e76-41e4-9f71-9178785a8979 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:20.602676 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] VM Started (Lifecycle Event)
Jun 27 04:04:20.752196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:20.752196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:20.752196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:20.755217 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:20.756057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:20.756057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:20.762166 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:20.885416 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:20.917053 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Releasing lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:20.918212 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Instance network_info: |[{"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:20.920786 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Start _get_guest_xml network_info=[{"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:04:00Z,direct_url=<?>,disk_format='qcow2',id=8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7,min_disk=0,min_ram=0,name='',owner='2825e4e67ee149dab4117772607b304e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:04:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': '8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:20.923785 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:20.925755 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1106665653', uuid='a06a5350-861e-43b7-b679-118dd50490f2'), owner=OwnerMeta(userid='bd8d831825d64665b8175e5d7a1eb681', username='tempest-AttachSCSIVolumeTestJSON-1604028106-project-member', projectid='a658c179c6fe462db19eb1a17419ab06', projectname='tempest-AttachSCSIVolumeTestJSON-1604028106'), image=ImageMeta(id='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533060.925109) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:20.928031 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:20.931522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:20.931522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:20.931522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:20.931522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:20.931522 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:04:00Z,direct_url=<?>,disk_format='qcow2',id=8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7,min_disk=0,min_ram=0,name='',owner='2825e4e67ee149dab4117772607b304e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:04:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:20.931939 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:20.931939 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:20.932036 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:20.932246 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:20.932485 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:20.932923 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:20.932923 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:20.933000 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:20.933142 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:20.933308 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:20.946311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:20.952315 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1106665653',display_name='tempest-AttachSCSIVolumeTestJSON-server-1106665653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachscsivolumetestjson-server-1106665653',id=4,image_ref='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkExx8o/xw2B4SslXt6LUAoHvcgyThfUJ2mOFvaWsSq0vmD99ld+Sym1ABB4L+4cgafpBXoX+uOPNdD3SSh8B97yNzIsbqcsa20PxNJbDgz3N16AWWeq3Dufkrtq0PsYw==',key_name='tempest-keypair-1168361871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a658c179c6fe462db19eb1a17419ab06',ramdisk_id='',reservation_id='r-hqvv3qb8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1604028106',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1604028106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd8d831825d64665b8175e5d7a1eb681',uuid=a06a5350-861e-43b7-b679-118dd50490f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:20.952805 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Converting VIF {"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:20.953750 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:20.954782 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lazy-loading 'pci_devices' on Instance uuid a06a5350-861e-43b7-b679-118dd50490f2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:20.986828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.107887 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:21.112154 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:21.223716 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Successfully created port: 1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:21.272738 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:21.279617 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Took 8.56 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:21.280053 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <uuid>a06a5350-861e-43b7-b679-118dd50490f2</uuid>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <name>instance-00000004</name>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1106665653</nova:name>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:20</nova:creationTime>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:image uuid="8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">scsi</nova:property>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:user uuid="bd8d831825d64665b8175e5d7a1eb681">tempest-AttachSCSIVolumeTestJSON-1604028106-project-member</nova:user>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:project uuid="a658c179c6fe462db19eb1a17419ab06">tempest-AttachSCSIVolumeTestJSON-1604028106</nova:project>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         <nova:port uuid="fde3de09-acd7-41da-91df-6a87204801b1">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <entry name="serial">a06a5350-861e-43b7-b679-118dd50490f2</entry>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <entry name="uuid">a06a5350-861e-43b7-b679-118dd50490f2</entry>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <target dev="sda" bus="scsi"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <address type="drive" controller="0" unit="0"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.config"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <target dev="sdb" bus="scsi"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <address type="drive" controller="0" unit="1"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:be:87:c0"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <target dev="tapfde3de09-ac"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/console.log" append="off"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:21.463252 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:21.467396 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Preparing to wait for external event network-vif-plugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:21.467396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:21.467569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:21.468104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:21.470537 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1106665653',display_name='tempest-AttachSCSIVolumeTestJSON-server-1106665653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachscsivolumetestjson-server-1106665653',id=4,image_ref='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkExx8o/xw2B4SslXt6LUAoHvcgyThfUJ2mOFvaWsSq0vmD99ld+Sym1ABB4L+4cgafpBXoX+uOPNdD3SSh8B97yNzIsbqcsa20PxNJbDgz3N16AWWeq3Dufkrtq0PsYw==',key_name='tempest-keypair-1168361871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a658c179c6fe462db19eb1a17419ab06',ramdisk_id='',reservation_id='r-hqvv3qb8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1604028106',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1604028106-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd8d831825d64665b8175e5d7a1eb681',uuid=a06a5350-861e-43b7-b679-118dd50490f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:21.471094 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Converting VIF {"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:21.472079 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:21.473869 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:21.473869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.476734 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:21.477446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:21.478912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.478912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c58e7fbd-1dd0-557f-8d24-fe8688dbef28', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:21.480074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.482210 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:21.482210 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.487098 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.487398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfde3de09-ac, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:21.487912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfde3de09-ac, col_values=(('qos', UUID('8cf8985d-0ccf-4a74-b8f1-4f1039cf6a4d')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:21.488267 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfde3de09-ac, col_values=(('external_ids', {'iface-id': 'fde3de09-acd7-41da-91df-6a87204801b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:87:c0', 'vm-uuid': 'a06a5350-861e-43b7-b679-118dd50490f2'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:21.490872 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.491990 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:21.497683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:21.500820 np0000003830 nova-compute[98984]: INFO os_vif [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac')
Jun 27 04:04:21.513578 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:21.514735 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:21.603722 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:21.616699 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:21.617202 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533061.6167939, c1d90648-3e76-41e4-9f71-9178785a8979 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:21.617651 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] VM Paused (Lifecycle Event)
Jun 27 04:04:21.793969 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Took 14.04 seconds to build instance.
Jun 27 04:04:21.851975 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updated VIF entry in instance network info cache for port e8e16ef8-1d1a-4e8b-8975-d89037659b92. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:21.853909 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updating instance_info_cache with network_info: [{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:21.871143 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-93852b94-0b98-4055-a70e-1209feeb717a req-25b555c9-49a8-450c-b9af-5c61a0cf198f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:21.871377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-93852b94-0b98-4055-a70e-1209feeb717a req-25b555c9-49a8-450c-b9af-5c61a0cf198f service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:21.871657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-93852b94-0b98-4055-a70e-1209feeb717a req-25b555c9-49a8-450c-b9af-5c61a0cf198f service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:21.872245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-93852b94-0b98-4055-a70e-1209feeb717a req-25b555c9-49a8-450c-b9af-5c61a0cf198f service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:21.872380 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-93852b94-0b98-4055-a70e-1209feeb717a req-25b555c9-49a8-450c-b9af-5c61a0cf198f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:21.872760 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-93852b94-0b98-4055-a70e-1209feeb717a req-25b555c9-49a8-450c-b9af-5c61a0cf198f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with vm_state active and task_state None.
Jun 27 04:04:22.018759 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:22.086159 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Successfully updated port: 1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:22.122701 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:22.124126 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533062.1238835, c1d90648-3e76-41e4-9f71-9178785a8979 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:22.124329 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] VM Resumed (Lifecycle Event)
Jun 27 04:04:22.286282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:22.287653 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:22.288004 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Creating image(s)
Jun 27 04:04:22.288700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "/opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:22.289038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "/opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:22.291939 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "/opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:22.292602 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:22.295872 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:22.296960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.549s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:22.298265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:22.361310 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0db1711a-eb4f-43af-af71-45d94ba55b19 req-a6fac7f1-ba86-4493-a9b9-37412b480a15 service nova] Releasing lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:22.387586 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:22.389396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:22.389396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:22.389736 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:22.392444 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:22.392779 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:22.470164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.077s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:22.470472 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:22.516781 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk 1073741824" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:22.517418 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.128s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:22.517936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:22.534598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.661s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:22.535123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:22.540744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.618s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:22.546796 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:22.547602 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Claim successful on node np0000003830
Jun 27 04:04:22.588626 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:22.588860 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquired lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:22.588975 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:22.610162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:22.611410 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:22.612037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:22.634484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:22.641158 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:22.704684 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:22.704943 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Cannot resize image /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:22.705640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:22.705640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Ensure instance console log exists: /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:22.705925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:22.706428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:22.706428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:23.036299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No BDM found with device name sda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:23.036299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:23.036299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No VIF found with MAC fa:16:3e:be:87:c0, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:23.037955 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Using config drive
Jun 27 04:04:23.049176 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:23.049176 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:23.049600 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:23.049925 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:23.181391 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '077264f43bdd4466af81374e8380fc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e178f8e50d4b57805cd6cbabe007ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:23.191485 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:23.555301 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:23.562239 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:23.795795 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:23.805449 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:23.927937 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Creating config drive at /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.config
Jun 27 04:04:23.936092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm25po6g0 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:23.974765 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-changed-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:23.976001 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Refreshing instance network info cache due to event network-changed-1e7e29d6-5098-4410-8509-30f455510fb9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:23.976001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] Acquiring lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:23.980413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpm25po6g0" returned: 0 in 0.044s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:23.996566 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Successfully created port: 425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:24.070848 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:24.096825 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updating instance_info_cache with network_info: [{"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:24.187047 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:24.187513 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:24.549009 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:24.579989 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:24.600750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Releasing lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:24.600750 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Instance network_info: |[{"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:24.601076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] Acquired lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:24.601311 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Refreshing network info cache for port 1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:24.607534 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Start _get_guest_xml network_info=[{"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:24.612271 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:24.614118 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-197187615', uuid='a25fed18-f473-42b6-b7dd-e29c3712bc39'), owner=OwnerMeta(userid='f781ed15934c4a6196eb78da918870d4', username='tempest-VolumesAssistedSnapshotsTest-2048792395-project-member', projectid='046700119b2245e488737e7955caf69c', projectname='tempest-VolumesAssistedSnapshotsTest-2048792395'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533064.6134753) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:24.615838 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:24.616206 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:24.622551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:24.622898 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:24.624508 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:24.625672 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:24.626331 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:24.626654 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:24.626790 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:24.626886 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:24.626989 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:24.627161 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:24.627278 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:24.627447 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:24.627534 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:24.627617 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:24.640639 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-197187615',display_name='tempest-VolumesAssistedSnapshotsTest-server-197187615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesassistedsnapshotstest-server-197187615',id=5,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMdSu0ashZkeOp+ayYVY0r9P8KDCVQGdhXaz5WSuOqytykAaXXcy2vMXz0nMKyXemZfvsds4W5RQKLgMpGiaKoivENux/wylnwWifWAdQR0vn9aHjd7waxObErQl/VnEg==',key_name='tempest-keypair-1397309913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046700119b2245e488737e7955caf69c',ramdisk_id='',reservation_id='r-bxdtxtxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2048792395',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2048792395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f781ed15934c4a6196eb78da918870d4',uuid=a25fed18-f473-42b6-b7dd-e29c3712bc39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:24.640836 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Converting VIF {"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:24.642525 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:24.642850 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lazy-loading 'pci_devices' on Instance uuid a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:24.691205 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:24.706835 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:24.896112 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-changed-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:24.896751 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Refreshing instance network info cache due to event network-changed-192d7226-ce75-4535-b9af-861512f1c37c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:24.897038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] Acquiring lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:24.897548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] Acquired lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:24.897548 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Refreshing network info cache for port 192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:25.031260 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.035314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.038249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.060602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.090220 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:25.091889 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:25.092054 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Creating image(s)
Jun 27 04:04:25.092569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:25.092844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "/opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:25.093395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "/opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:25.093937 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:25.097662 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:25.100428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:25.121992 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <uuid>a25fed18-f473-42b6-b7dd-e29c3712bc39</uuid>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <name>instance-00000005</name>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-197187615</nova:name>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:24</nova:creationTime>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:user uuid="f781ed15934c4a6196eb78da918870d4">tempest-VolumesAssistedSnapshotsTest-2048792395-project-member</nova:user>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:project uuid="046700119b2245e488737e7955caf69c">tempest-VolumesAssistedSnapshotsTest-2048792395</nova:project>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         <nova:port uuid="1e7e29d6-5098-4410-8509-30f455510fb9">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <entry name="serial">a25fed18-f473-42b6-b7dd-e29c3712bc39</entry>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <entry name="uuid">a25fed18-f473-42b6-b7dd-e29c3712bc39</entry>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.config"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:54:6b:1f"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <target dev="tap1e7e29d6-50"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/console.log" append="off"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:25.151056 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:25.156394 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Preparing to wait for external event network-vif-plugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:25.156394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:25.156394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:25.156394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:25.156394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-197187615',display_name='tempest-VolumesAssistedSnapshotsTest-server-197187615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesassistedsnapshotstest-server-197187615',id=5,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMdSu0ashZkeOp+ayYVY0r9P8KDCVQGdhXaz5WSuOqytykAaXXcy2vMXz0nMKyXemZfvsds4W5RQKLgMpGiaKoivENux/wylnwWifWAdQR0vn9aHjd7waxObErQl/VnEg==',key_name='tempest-keypair-1397309913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='046700119b2245e488737e7955caf69c',ramdisk_id='',reservation_id='r-bxdtxtxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2048792395',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2048792395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f781ed15934c4a6196eb78da918870d4',uuid=a25fed18-f473-42b6-b7dd-e29c3712bc39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:25.156932 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Converting VIF {"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:25.156932 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:25.156932 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:25.156932 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.157155 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:25.157544 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:25.162770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.162770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ddee39e-eaca-5362-bb4a-98349183a9ae', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:25.162770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.163058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:25.169174 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.170875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.170875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e7e29d6-50, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:25.171317 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e7e29d6-50, col_values=(('qos', UUID('2cb27481-b1da-4427-8bdb-b443465ad581')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:25.173030 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e7e29d6-50, col_values=(('external_ids', {'iface-id': '1e7e29d6-5098-4410-8509-30f455510fb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:6b:1f', 'vm-uuid': 'a25fed18-f473-42b6-b7dd-e29c3712bc39'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:25.176204 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.185939 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:25.189591 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:25.191216 np0000003830 nova-compute[98984]: INFO os_vif [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50')
Jun 27 04:04:25.198306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:25.198637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:25.199214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:25.199713 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:25.201897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.661s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:25.212576 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:25.212576 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:25.212576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:25.289942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.079s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:25.290330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:25.306326 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Successfully updated port: 425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:25.345724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk 1073741824" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:25.347224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:25.347597 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:25.404387 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:25.425043 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.077s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:25.425509 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:25.425777 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:25.499765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:25.509113 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Cannot resize image /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:25.509113 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:25.509113 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Ensure instance console log exists: /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:25.509113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:25.509113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:25.509113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:25.671533 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:25.721628 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:25.722036 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:25.722360 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:25.722601 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:25.811208 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '077264f43bdd4466af81374e8380fc8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e178f8e50d4b57805cd6cbabe007ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:25.814446 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:25.814446 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquired lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:25.814446 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:25.846344 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updated VIF entry in instance network info cache for port 1e7e29d6-5098-4410-8509-30f455510fb9. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:25.861747 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updating instance_info_cache with network_info: [{"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:25.973126 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:26.106212 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.106628 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.106902 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.107119 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.107317 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.107555 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.107775 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.107900 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:04:26.108106 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:04:26.179910 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updated VIF entry in instance network info cache for port 192d7226-ce75-4535-b9af-861512f1c37c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:26.180222 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:26.222677 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533066.2222352, a06a5350-861e-43b7-b679-118dd50490f2 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:26.222850 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] VM Started (Lifecycle Event)
Jun 27 04:04:26.224855 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:26.351528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a361e668-04e6-4d35-aebd-e82c96ed43ff req-3725e05f-c8a1-4593-a5b8-e9a6ef3ae054 service nova] Releasing lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:26.399243 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:26.615010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:26.615276 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:26.615467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:26.615685 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:04:26.642946 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:26.683307 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dd85569a-04dc-4ec3-b601-bab75eecf449 req-29206ac9-c83f-4542-a971-73498bedf504 service nova] Releasing lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:26.727868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:26.728634 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:26.738115 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Successfully created port: b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:26.741885 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533066.741393, a06a5350-861e-43b7-b679-118dd50490f2 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:26.742079 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] VM Paused (Lifecycle Event)
Jun 27 04:04:26.750645 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:26.750852 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:26.751051 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] No VIF found with MAC fa:16:3e:54:6b:1f, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:26.753366 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Using config drive
Jun 27 04:04:26.835232 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updating instance_info_cache with network_info: [{"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] No event matching network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 in dict_keys([('network-vif-plugged', 'fde3de09-acd7-41da-91df-6a87204801b1')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received unexpected event network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 for instance with vm_state building and task_state spawning.
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-plugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:27.002727 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Processing event network-vif-plugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:27.003969 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-changed-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:27.004427 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Refreshing instance network info cache due to event network-changed-425ad7c7-90d4-4d00-b524-d76651842a89. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:27.005038 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:27.005853 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Acquiring lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:27.009847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:27.011670 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Instance spawned successfully.
Jun 27 04:04:27.012103 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:27.014206 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:27.014594 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:27.014990 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:27.015433 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:27.245421 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:27.248864 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533067.2485173, a06a5350-861e-43b7-b679-118dd50490f2 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:27.249020 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] VM Resumed (Lifecycle Event)
Jun 27 04:04:27.261564 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:27.340652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Releasing lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:27.340652 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Instance network_info: |[{"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:27.340858 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Start _get_guest_xml network_info=[{"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:27.343606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Acquired lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:27.343606 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Refreshing network info cache for port 425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:27.344224 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:27.348716 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1711362097-1', uuid='a7ff3732-e89b-4c07-b215-daac79472845'), owner=OwnerMeta(userid='077264f43bdd4466af81374e8380fc8d', username='tempest-TestMultiAttachVolumeSwap-2127186776-project-member', projectid='60e178f8e50d4b57805cd6cbabe007ba', projectname='tempest-TestMultiAttachVolumeSwap-2127186776'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533067.3454795) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:27.348716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:27.348716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:27.348716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:27.349015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:27.350874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:27.351380 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:27.353901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:27.380880 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1711362097-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testmultiattachvolumeswap-server-1711362097-1',id=6,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSulVs7ZzRNnOca1kWH/bzgx84tnVtnl8YSHaFdVGw/O0CI6OX5kbEb+9hSIzsuCaQfUBhtLlgqF32mfif8Y7AtJ5eN/rF6zNk81pfCiYYyOSGLSxuVxpAvC26aAOJJjQ==',key_name='tempest-keypair-1975695241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e178f8e50d4b57805cd6cbabe007ba',ramdisk_id='',reservation_id='r-wl9zu1xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2127186776',owner_user_name='tempest-TestMultiAttachVolumeSwap-2127186776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='077264f43bdd4466af81374e8380fc8d',uuid=a7ff3732-e89b-4c07-b215-daac79472845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:27.381174 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converting VIF {"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:27.381960 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:27.382483 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'pci_devices' on Instance uuid a7ff3732-e89b-4c07-b215-daac79472845 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:27.430944 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Successfully updated port: b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:27.489615 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Creating config drive at /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.config
Jun 27 04:04:27.495992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqoar4msa {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.523535 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Took 11.22 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:27.524045 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:27.553066 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqoar4msa" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:27.668627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.749167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:27.755029 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:27.755029 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:27.756854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.758908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:27.759954 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Creating image(s)
Jun 27 04:04:27.769645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:27.769645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "/opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.009s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:27.771901 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:27.777721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "/opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:27.778912 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:27.785161 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:27.787442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.846823 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:27.848213 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:27.858473 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.875197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:27.876712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:27.877820 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:27.879008 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:27.882685 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:27.882973 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <uuid>a7ff3732-e89b-4c07-b215-daac79472845</uuid>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <name>instance-00000006</name>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1711362097-1</nova:name>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:27</nova:creationTime>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:user uuid="077264f43bdd4466af81374e8380fc8d">tempest-TestMultiAttachVolumeSwap-2127186776-project-member</nova:user>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:project uuid="60e178f8e50d4b57805cd6cbabe007ba">tempest-TestMultiAttachVolumeSwap-2127186776</nova:project>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         <nova:port uuid="425ad7c7-90d4-4d00-b524-d76651842a89">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <entry name="serial">a7ff3732-e89b-4c07-b215-daac79472845</entry>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <entry name="uuid">a7ff3732-e89b-4c07-b215-daac79472845</entry>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.config"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:24:e0:0a"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <target dev="tap425ad7c7-90"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/console.log" append="off"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:27.898957 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:27.902077 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Preparing to wait for external event network-vif-plugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:27.902077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:27.902077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:27.902077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:27.902750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1711362097-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testmultiattachvolumeswap-server-1711362097-1',id=6,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSulVs7ZzRNnOca1kWH/bzgx84tnVtnl8YSHaFdVGw/O0CI6OX5kbEb+9hSIzsuCaQfUBhtLlgqF32mfif8Y7AtJ5eN/rF6zNk81pfCiYYyOSGLSxuVxpAvC26aAOJJjQ==',key_name='tempest-keypair-1975695241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e178f8e50d4b57805cd6cbabe007ba',ramdisk_id='',reservation_id='r-wl9zu1xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2127186776',owner_user_name='tempest-TestMultiAttachVolumeSwap-2127186776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='077264f43bdd4466af81374e8380fc8d',uuid=a7ff3732-e89b-4c07-b215-daac79472845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:27.902750 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converting VIF {"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:27.903352 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:27.907455 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:27.911088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.911088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:27.911088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:27.911487 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.911887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfea9d51-0a75-57e8-ac41-66c0ff50ba0f', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:27.913019 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.914423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:27.921777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.925316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.925847 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap425ad7c7-90, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:27.926517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap425ad7c7-90, col_values=(('qos', UUID('a384427c-7211-40b7-bf86-4a262034ea3a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:27.926848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap425ad7c7-90, col_values=(('external_ids', {'iface-id': '425ad7c7-90d4-4d00-b524-d76651842a89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:e0:0a', 'vm-uuid': 'a7ff3732-e89b-4c07-b215-daac79472845'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:27.928091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.931525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:27.933818 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:27.933962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquired lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:27.934295 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:27.951577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:27.953611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:27.955763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:27.956776 np0000003830 nova-compute[98984]: INFO os_vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90')
Jun 27 04:04:27.974886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:27.984154 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.037206 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Took 16.70 seconds to build instance.
Jun 27 04:04:28.042028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk 1073741824" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.044538 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:28.044888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.057419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.070895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.082171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.096177 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.132058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.132667 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:28.135527 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.181248 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.181248 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.213597 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.245230 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.246326 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Cannot resize image /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:28.247579 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:28.247579 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Ensure instance console log exists: /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:28.247579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:28.247835 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:28.248029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:28.270655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.323591 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.420052 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:28.425301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.425768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.509449 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4bd05d36-7787-4d9d-a6f7-499e3d154d02 req-28ed1e5a-b382-4c40-8c50-f8cf0b2bbc42 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-plugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:28.509733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4bd05d36-7787-4d9d-a6f7-499e3d154d02 req-28ed1e5a-b382-4c40-8c50-f8cf0b2bbc42 service nova] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:28.530323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4bd05d36-7787-4d9d-a6f7-499e3d154d02 req-28ed1e5a-b382-4c40-8c50-f8cf0b2bbc42 service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:28.530323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4bd05d36-7787-4d9d-a6f7-499e3d154d02 req-28ed1e5a-b382-4c40-8c50-f8cf0b2bbc42 service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:28.530323 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4bd05d36-7787-4d9d-a6f7-499e3d154d02 req-28ed1e5a-b382-4c40-8c50-f8cf0b2bbc42 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Processing event network-vif-plugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:28.530323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.533284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.533710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.565888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00660cf8-1e83-4021-ae07-a6bc7f00d20f tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.222s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:28.565888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.578191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.578191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:28.631263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.631263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.678982 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:28.705305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.712180 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:28.713535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:28.741612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.027s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:28.742424 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=52622MB free_disk=74.63734817504883GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:04:28.742424 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:28.742740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:28.796896 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updated VIF entry in instance network info cache for port 425ad7c7-90d4-4d00-b524-d76651842a89. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:28.797444 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updating instance_info_cache with network_info: [{"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:28.798118 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:29.004268 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:29.184953 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updating instance_info_cache with network_info: [{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:29.293164 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-changed-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:29.293164 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Refreshing instance network info cache due to event network-changed-b7ad965d-b785-4081-aede-59ad6a86188b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:29.293164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] Acquiring lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Releasing lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-plugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] No waiting events found dispatching network-vif-plugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:29.304119 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8b0105e5-d625-43ec-bf3c-4e629fbacb0f req-4c1bb5ac-751b-4cdc-995f-f479d1a638c7 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received unexpected event network-vif-plugged-fde3de09-acd7-41da-91df-6a87204801b1 for instance with vm_state building and task_state spawning.
Jun 27 04:04:29.532324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:29.532484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:29.532661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No VIF found with MAC fa:16:3e:24:e0:0a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:29.533346 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Using config drive
Jun 27 04:04:29.687629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Releasing lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:29.687960 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Instance network_info: |[{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:29.690703 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Start _get_guest_xml network_info=[{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:29.691141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] Acquired lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:29.691343 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Refreshing network info cache for port b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:29.701564 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:29.703350 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1711362097-2', uuid='4e7bc7eb-135e-4f40-8a1c-1a9845dfb216'), owner=OwnerMeta(userid='077264f43bdd4466af81374e8380fc8d', username='tempest-TestMultiAttachVolumeSwap-2127186776-project-member', projectid='60e178f8e50d4b57805cd6cbabe007ba', projectname='tempest-TestMultiAttachVolumeSwap-2127186776'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533069.7028315) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:29.707380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:29.707880 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:29.710928 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:29.711149 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:29.712957 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:29.716015 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:29.716290 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:29.716587 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:29.718184 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:29.718371 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:29.718411 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:29.718655 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:29.718853 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:29.718941 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:29.719098 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:29.719262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:29.747200 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1711362097-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testmultiattachvolumeswap-server-1711362097-2',id=7,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSulVs7ZzRNnOca1kWH/bzgx84tnVtnl8YSHaFdVGw/O0CI6OX5kbEb+9hSIzsuCaQfUBhtLlgqF32mfif8Y7AtJ5eN/rF6zNk81pfCiYYyOSGLSxuVxpAvC26aAOJJjQ==',key_name='tempest-keypair-1975695241',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e178f8e50d4b57805cd6cbabe007ba',ramdisk_id='',reservation_id='r-wl9zu1xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2127186776',owner_user_name='tempest-TestMultiAttachVolumeSwap-2127186776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='077264f43bdd4466af81374e8380fc8d',uuid=4e7bc7eb-135e-4f40-8a1c-1a9845dfb216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:29.747200 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converting VIF {"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:29.747200 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:29.747673 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:29.847069 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6ce1c75a-8520-40b5-a060-9580f2f789ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.847248 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 99670311-67bb-4d60-b854-655dc01f2722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.847284 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c1d90648-3e76-41e4-9f71-9178785a8979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.847399 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a06a5350-861e-43b7-b679-118dd50490f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.848319 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a25fed18-f473-42b6-b7dd-e29c3712bc39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.848480 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a7ff3732-e89b-4c07-b215-daac79472845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.848641 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:04:29.848851 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 7 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:04:29.849010 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1856MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:04:28 up 27 min,  2 users,  load average: 6.35, 2.96, 1.48\n', 'num_instances': '7', 'num_vm_building': '4', 'num_task_spawning': '4', 'num_os_type_None': '7', 'num_proj_771234de69074fed81ffef19dcee2804': '1', 'io_workload': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_proj_4b76ce35cec84d189228639d70c6be45': '1', 'num_proj_20eaa28753124b488bd3e69bbc01af54': '1', 'num_proj_a658c179c6fe462db19eb1a17419ab06': '1', 'num_proj_046700119b2245e488737e7955caf69c': '1', 'num_proj_60e178f8e50d4b57805cd6cbabe007ba': '2'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:04:29.976110 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533069.9756725, a25fed18-f473-42b6-b7dd-e29c3712bc39 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:29.977831 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:29.978466 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] VM Started (Lifecycle Event)
Jun 27 04:04:29.983348 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:29.986572 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Instance spawned successfully.
Jun 27 04:04:29.987332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:30.045958 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:30.194225 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <uuid>4e7bc7eb-135e-4f40-8a1c-1a9845dfb216</uuid>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <name>instance-00000007</name>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1711362097-2</nova:name>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:29</nova:creationTime>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:user uuid="077264f43bdd4466af81374e8380fc8d">tempest-TestMultiAttachVolumeSwap-2127186776-project-member</nova:user>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:project uuid="60e178f8e50d4b57805cd6cbabe007ba">tempest-TestMultiAttachVolumeSwap-2127186776</nova:project>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         <nova:port uuid="b7ad965d-b785-4081-aede-59ad6a86188b">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <entry name="serial">4e7bc7eb-135e-4f40-8a1c-1a9845dfb216</entry>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <entry name="uuid">4e7bc7eb-135e-4f40-8a1c-1a9845dfb216</entry>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.config"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:42:fd:a4"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <target dev="tapb7ad965d-b7"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/console.log" append="off"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Preparing to wait for external event network-vif-plugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:30.247988 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:30.251186 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:30.251186 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1711362097-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testmultiattachvolumeswap-server-1711362097-2',id=7,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSulVs7ZzRNnOca1kWH/bzgx84tnVtnl8YSHaFdVGw/O0CI6OX5kbEb+9hSIzsuCaQfUBhtLlgqF32mfif8Y7AtJ5eN/rF6zNk81pfCiYYyOSGLSxuVxpAvC26aAOJJjQ==',key_name='tempest-keypair-1975695241',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e178f8e50d4b57805cd6cbabe007ba',ramdisk_id='',reservation_id='r-wl9zu1xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2127186776',owner_user_name='tempest-TestMultiAttachVolumeSwap-2127186776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='077264f43bdd4466af81374e8380fc8d',uuid=4e7bc7eb-135e-4f40-8a1c-1a9845dfb216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:30.251186 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converting VIF {"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.251912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84017915-a2f4-5158-bd78-def40605bde1', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:30.259244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.259244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:30.271901 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.276451 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.276616 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7ad965d-b7, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:30.277511 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7ad965d-b7, col_values=(('qos', UUID('0d05ea1f-11b2-4c73-9662-d8e9add1322b')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:30.277974 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7ad965d-b7, col_values=(('external_ids', {'iface-id': 'b7ad965d-b785-4081-aede-59ad6a86188b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:fd:a4', 'vm-uuid': '4e7bc7eb-135e-4f40-8a1c-1a9845dfb216'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:30.280049 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.284295 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:30.292414 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:30.293977 np0000003830 nova-compute[98984]: INFO os_vif [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7')
Jun 27 04:04:30.345911 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Creating config drive at /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.config
Jun 27 04:04:30.352175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkts4dqld {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:30.407177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkts4dqld" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:30.457661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:30.457661 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:30.486405 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:30.488101 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:30.498304 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:30.498596 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:30.498856 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:30.499100 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:30.499337 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:30.499618 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:30.617882 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9ad8025-d186-4b8f-be56-8d1954807d18 req-a9129555-2e8a-498d-93de-4be68278efd0 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-plugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:30.617882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9ad8025-d186-4b8f-be56-8d1954807d18 req-a9129555-2e8a-498d-93de-4be68278efd0 service nova] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:30.617882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9ad8025-d186-4b8f-be56-8d1954807d18 req-a9129555-2e8a-498d-93de-4be68278efd0 service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:30.617882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9ad8025-d186-4b8f-be56-8d1954807d18 req-a9129555-2e8a-498d-93de-4be68278efd0 service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:30.620344 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9ad8025-d186-4b8f-be56-8d1954807d18 req-a9129555-2e8a-498d-93de-4be68278efd0 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] No waiting events found dispatching network-vif-plugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:30.620344 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a9ad8025-d186-4b8f-be56-8d1954807d18 req-a9129555-2e8a-498d-93de-4be68278efd0 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received unexpected event network-vif-plugged-1e7e29d6-5098-4410-8509-30f455510fb9 for instance with vm_state building and task_state spawning.
Jun 27 04:04:30.736689 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:30.960837 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:30.988647 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-changed-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:30.988647 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Refreshing instance network info cache due to event network-changed-fde3de09-acd7-41da-91df-6a87204801b1. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:30.988647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] Acquiring lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:30.988647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] Acquired lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:30.988647 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Refreshing network info cache for port fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:30.992685 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:31.006426 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533070.9928043, a25fed18-f473-42b6-b7dd-e29c3712bc39 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:31.006426 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] VM Paused (Lifecycle Event)
Jun 27 04:04:31.006426 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Took 8.72 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:31.006426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:31.026523 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.083412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.083412 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updated VIF entry in instance network info cache for port b7ad965d-b785-4081-aede-59ad6a86188b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:31.083412 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updating instance_info_cache with network_info: [{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:31.083412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.211844 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.470301 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:04:31.470301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.727s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:31.470301 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 57.72 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:04:31.488095 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:31.490617 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.499307 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:31.500015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.505799 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533071.5049665, a25fed18-f473-42b6-b7dd-e29c3712bc39 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:31.505799 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] VM Resumed (Lifecycle Event)
Jun 27 04:04:31.507426 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.528235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.535474 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:31.549225 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Took 14.63 seconds to build instance.
Jun 27 04:04:31.572334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4fddeb6f-8a69-49c9-989c-fadbf44bcbfc req-c60790ef-0da0-4a22-9211-cbd8b2e597e5 service nova] Releasing lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:31.725439 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:31.725889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:31.821148 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:31.821301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:31.821454 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No VIF found with MAC fa:16:3e:42:fd:a4, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:31.822028 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Using config drive
Jun 27 04:04:32.009313 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:32.020142 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:32.041525 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:32.052707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8b26f6e4-46de-48a5-b99b-2665ae4759b4 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.143s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:32.228668 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:32.242094 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Updated VIF entry in instance network info cache for port fde3de09-acd7-41da-91df-6a87204801b1. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:32.242782 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Updating instance_info_cache with network_info: [{"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:32.330150 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:32.333299 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:32.465924 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Creating config drive at /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.config
Jun 27 04:04:32.471189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_zhlsnwg {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:32.512113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_zhlsnwg" returned: 0 in 0.040s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:32.523402 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533072.5229695, a7ff3732-e89b-4c07-b215-daac79472845 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:32.523568 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] VM Started (Lifecycle Event)
Jun 27 04:04:32.731911 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-plugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:32.732134 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:32.732265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:32.732534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:32.732625 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Processing event network-vif-plugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:32.735605 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-plugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:32.739175 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:32.739738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:32.740018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:32.740157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:32.740524 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] No waiting events found dispatching network-vif-plugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:32.740524 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d9274c57-1219-4262-8286-412773fcd105 req-687d09b6-3105-491f-b4cc-fba7ea4542ff service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received unexpected event network-vif-plugged-425ad7c7-90d4-4d00-b524-d76651842a89 for instance with vm_state building and task_state spawning.
Jun 27 04:04:32.745511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:32.747738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ce5771bb-efef-4bef-a6c6-6d32fd6aa924 req-7fc9e65e-2cf2-4cdf-88ea-d7ec8f622766 service nova] Releasing lock "refresh_cache-a06a5350-861e-43b7-b679-118dd50490f2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:32.751427 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Instance spawned successfully.
Jun 27 04:04:32.751427 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:32.803693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:32.804004 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:32.809953 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:32.810184 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Claim successful on node np0000003830
Jun 27 04:04:33.027837 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:33.031764 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:33.076870 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fe4d8487-a7b9-42c3-9c6e-8e6234718fa4 req-2c8ea363-ab86-4e06-9df2-1ac56686516f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:33.077436 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe4d8487-a7b9-42c3-9c6e-8e6234718fa4 req-2c8ea363-ab86-4e06-9df2-1ac56686516f service nova] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:33.077690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe4d8487-a7b9-42c3-9c6e-8e6234718fa4 req-2c8ea363-ab86-4e06-9df2-1ac56686516f service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:33.077799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe4d8487-a7b9-42c3-9c6e-8e6234718fa4 req-2c8ea363-ab86-4e06-9df2-1ac56686516f service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:33.079435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fe4d8487-a7b9-42c3-9c6e-8e6234718fa4 req-2c8ea363-ab86-4e06-9df2-1ac56686516f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] No event matching network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e in dict_keys([('network-vif-plugged', '13143fe3-8cca-410a-af2e-7235fa68ee4e')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:04:33.079435 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-fe4d8487-a7b9-42c3-9c6e-8e6234718fa4 req-2c8ea363-ab86-4e06-9df2-1ac56686516f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received unexpected event network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e for instance with vm_state building and task_state spawning.
Jun 27 04:04:33.102607 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:33.131785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:33.132769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:33.230334 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:33.272368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:33.272584 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:33.273310 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:33.274782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:33.274782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:33.274782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:33.308820 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:33.309884 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:33.534602 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:33.534952 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533073.5346522, a7ff3732-e89b-4c07-b215-daac79472845 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:33.535246 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] VM Paused (Lifecycle Event)
Jun 27 04:04:33.783646 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Took 8.69 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:33.783826 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:33.802938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:34.038974 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:34.049754 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533074.0493963, a7ff3732-e89b-4c07-b215-daac79472845 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:34.049931 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] VM Resumed (Lifecycle Event)
Jun 27 04:04:34.280349 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:34.308048 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Took 14.54 seconds to build instance.
Jun 27 04:04:34.471132 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:34.471462 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:34.553542 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:34.554945 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:34.812736 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.055s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:34.824577 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-changed-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:34.824577 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Refreshing instance network info cache due to event network-changed-1e7e29d6-5098-4410-8509-30f455510fb9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:34.824956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] Acquiring lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:34.824956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] Acquired lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:34.824956 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Refreshing network info cache for port 1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:34.974463 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:34.983109 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:35.057207 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533075.0567944, 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:35.057400 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] VM Started (Lifecycle Event)
Jun 27 04:04:35.281021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:35.327207 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:35.487898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:35.488441 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:35.559815 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:35.561361 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533075.5610926, 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:35.561540 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] VM Paused (Lifecycle Event)
Jun 27 04:04:35.765797 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:35.911314 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updated VIF entry in instance network info cache for port 1e7e29d6-5098-4410-8509-30f455510fb9. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:35.911648 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updating instance_info_cache with network_info: [{"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:35.996490 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:35.996961 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:35.997041 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:35.997362 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:36.064031 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:36.065722 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:36.247397 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2ca81daafb240d491c79ed8561982a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97026720e5114b53a1aa2cd0d93104ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:36.415115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c7fab963-cfdc-4d41-bc87-4aa13e6e8068 req-891f4231-0285-451a-9069-8d02378e35b4 service nova] Releasing lock "refresh_cache-a25fed18-f473-42b6-b7dd-e29c3712bc39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:36.501765 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:36.574029 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:36.945488 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully created port: b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:37.596094 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully created port: 8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:38.012799 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:38.035556 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9ccf4574-a62a-4b65-aacc-caa857a25459 req-080b6ede-1a88-4fa5-91c9-a29b160cdc7f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-plugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:38.035798 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9ccf4574-a62a-4b65-aacc-caa857a25459 req-080b6ede-1a88-4fa5-91c9-a29b160cdc7f service nova] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:38.036015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9ccf4574-a62a-4b65-aacc-caa857a25459 req-080b6ede-1a88-4fa5-91c9-a29b160cdc7f service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:38.036181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9ccf4574-a62a-4b65-aacc-caa857a25459 req-080b6ede-1a88-4fa5-91c9-a29b160cdc7f service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:38.036727 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9ccf4574-a62a-4b65-aacc-caa857a25459 req-080b6ede-1a88-4fa5-91c9-a29b160cdc7f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Processing event network-vif-plugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:38.037866 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Instance event wait completed in 21 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:38.043286 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:38.045775 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533078.044397, 6ce1c75a-8520-40b5-a060-9580f2f789ed => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:38.055315 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] VM Resumed (Lifecycle Event)
Jun 27 04:04:38.058551 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Instance spawned successfully.
Jun 27 04:04:38.062379 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:38.292243 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully created port: 2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:38.519912 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Booting with volume 21edcccc-4546-4c75-8a26-aba5c952c93a at /dev/vda
Jun 27 04:04:38.549617 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:38.555961 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:38.571878 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:38.580343 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:38.580343 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:38.580343 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:38.580343 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:38.580343 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:38.646330 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:04:38.649948 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9y3o38cb/privsep.sock']
Jun 27 04:04:38.658902 np0000003830 sudo[112029]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9y3o38cb/privsep.sock
Jun 27 04:04:38.659859 np0000003830 sudo[112029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
Jun 27 04:04:38.805379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:38.987781 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 27 04:04:38.987938 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 27 04:04:38.987938 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 27 04:04:38.988011 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:38.990340 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 27 04:04:38.990340 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 27 04:04:38.990340 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 27 04:04:38.990340 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:38.990340 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 27 04:04:39.059965 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:39.079981 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Took 34.26 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:39.080186 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:39.336261 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully created port: 752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:39.436071 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 27 04:04:39.436281 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 27 04:04:39.436737 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 27 04:04:39.436737 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:39.436737 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 27 04:04:39.436737 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 27 04:04:39.436737 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 27 04:04:39.436907 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 27 04:04:39.436907 np0000003830 nova-compute[98984]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 27 04:04:39.602078 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Took 39.61 seconds to build instance.
Jun 27 04:04:39.752257 np0000003830 sudo[112029]: pam_unix(sudo:session): session closed for user root
Jun 27 04:04:39.754114 np0000003830 nova-compute[98984]: INFO oslo.privsep.daemon [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Spawned new privsep daemon via rootwrap
Jun 27 04:04:39.897663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:04:39.898387 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.nvmeof [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jun 27 04:04:39.930803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:39.962762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:04:39.963057 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:04:39.976541 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:04:39.979227 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4'] 
Jun 27 04:04:39.980071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:04:39.980071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:04:39.981269 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== get_connector_properties: return (1333ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:04:39.981659 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating existing volume attachment record: 2062453f-73e3-4280-9a83-60acbd2d7fc5 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:04:40.016519 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully created port: a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:40.027460 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:40.027460 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:40.106076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8ac8e25b-b4b9-4fc7-b540-d763dc2bf19b tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.121s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:40.134262 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-plugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:40.134547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:40.134885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:40.136877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:40.137432 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] No waiting events found dispatching network-vif-plugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:40.137767 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received unexpected event network-vif-plugged-13143fe3-8cca-410a-af2e-7235fa68ee4e for instance with vm_state active and task_state None.
Jun 27 04:04:40.138308 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:40.138545 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:40.138773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:40.138932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:40.139608 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] No event matching network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b in dict_keys([('network-vif-plugged', 'b7ad965d-b785-4081-aede-59ad6a86188b')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:04:40.139992 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-074d961d-71be-4a04-953a-2b9480b86f6f req-5ee3d392-ea8f-496c-a596-b075b57ffd88 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received unexpected event network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b for instance with vm_state building and task_state spawning.
Jun 27 04:04:40.283410 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:40.529383 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:40.859264 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:40.923080 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:40.923723 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-b889b1b6-e646-47d0-a58a-deb2c27cb567. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:40.924076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:40.924245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:40.924443 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:41.084461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:41.085017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:41.089039 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:41.089173 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Claim successful on node np0000003830
Jun 27 04:04:41.427173 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:41.549124 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:41.675869 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Booting with volume b0b7b3a1-c205-4ea6-bbc1-b60973d55061 at /dev/vdb
Jun 27 04:04:41.737574 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:04:41.750357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:04:41.774429 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:41.779084 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:41.804420 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:04:41.804420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:04:41.812402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:04:41.815049 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4'] 
Jun 27 04:04:41.815236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:04:41.815441 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:04:41.816177 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:04:41.816750 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating existing volume attachment record: bd0f44e7-bc9c-4d5b-ad00-1214088c29ec {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:04:42.091468 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: 34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:42.212366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-plugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:42.212808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:42.212844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:42.213057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:42.213351 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Processing event network-vif-plugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:42.213598 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-plugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:42.213789 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:42.214138 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:42.214221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:42.214389 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] No waiting events found dispatching network-vif-plugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:42.214627 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-bd9582b7-9584-4856-9e0e-ff035bceece6 req-209f1711-d331-45f2-a929-85607023b9b9 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received unexpected event network-vif-plugged-b7ad965d-b785-4081-aede-59ad6a86188b for instance with vm_state building and task_state spawning.
Jun 27 04:04:42.215042 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:42.218948 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533082.2184496, 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:42.219187 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] VM Resumed (Lifecycle Event)
Jun 27 04:04:42.220474 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:42.231530 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Instance spawned successfully.
Jun 27 04:04:42.232314 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:42.277394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b778d09f-e203-4cdd-b13f-c49d69a581a4 req-9d0affee-5b1a-40ac-8df3-531cc794ca1d service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:42.696931 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:42.697166 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:42.724388 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:42.726412 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:42.742091 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:42.742458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:42.742729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:42.743140 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:42.743703 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:42.744001 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:43.024840 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:43.025017 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-34c66af1-878e-42c8-ab08-32e34e085f38. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:43.025221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:43.025360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:43.025440 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port 34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:43.150084 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:43.200160 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:43.231711 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:43.254439 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Took 15.50 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:43.254707 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:43.442484 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:43.466263 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Booting with volume f5bca00e-bc31-469e-9030-dcbd935f12df at /dev/vdc
Jun 27 04:04:43.528306 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:43.561454 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:04:43.576340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:04:43.608893 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:43.636010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:04:43.636880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:04:43.646852 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:04:43.648242 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4'] 
Jun 27 04:04:43.648357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:04:43.648597 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:04:43.648869 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:04:43.649125 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating existing volume attachment record: 3a6ac0d9-e9a4-4f96-9e39-35401614b0cd {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:04:43.662868 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] instance snapshotting
Jun 27 04:04:43.685180 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:43.714069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.629s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:43.714818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:43.768795 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Took 23.94 seconds to build instance.
Jun 27 04:04:43.811560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:43.823320 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Beginning live snapshot process
Jun 27 04:04:43.928511 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:44.222137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:44.222694 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:44.222694 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:44.222999 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:44.271224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d40f89dc-eec7-4771-b9d0-22caed2581f5 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.454s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:44.362740 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9eb961442fd240f58e6e1b794a94b458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3262b8f5fb44457b7ccb37d681055bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:44.431345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22f2191e-a78a-40c9-afb9-0430ea40ef6d req-e229b163-5ec1-4a7e-8a0e-074a3ef41e2e service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:44.640889 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: 8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:44.728973 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:44.895706 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Successfully created port: a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:45.108323 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:45.111015 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:45.111312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:45.111511 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:45.111694 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:45.233179 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:45.285644 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:45.347980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:45.438701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json -f qcow2" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:45.438701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:45.527125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json -f qcow2" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:45.530474 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:45.532536 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:45.533208 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:45.616309 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:45.622169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:45.625524 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_hs83zc0/baf5ef38e917455db1dca6b6602c377d.delta 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:45.671909 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Successfully updated port: a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:45.674837 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_hs83zc0/baf5ef38e917455db1dca6b6602c377d.delta 1073741824" returned: 0 in 0.051s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:45.676367 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 27 04:04:45.757599 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:45.768187 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-changed-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:45.768187 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Refreshing instance network info cache due to event network-changed-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:45.768187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] Acquiring lock "refresh_cache-449cab84-f0b9-40e0-bcb3-595b102c1303" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:45.768187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] Acquired lock "refresh_cache-449cab84-f0b9-40e0-bcb3-595b102c1303" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:45.768187 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Refreshing network info cache for port a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:45.862073 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:45.864142 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:45.864520 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Creating image(s)
Jun 27 04:04:45.865024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:04:45.865200 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Ensure instance console log exists: /opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:45.865557 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:45.865763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:45.866205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:45.998608 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:04:46.000735 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 27 04:04:46.020633 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: 2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:46.043307 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:46.062426 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:04:46.064185 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_hs83zc0/baf5ef38e917455db1dca6b6602c377d.delta /opt/stack/data/nova/instances/snapshots/tmp_hs83zc0/baf5ef38e917455db1dca6b6602c377d {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:46.090027 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:46.090645 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-2a748cfd-0098-4b02-ae17-e5818b112843. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:46.090947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:46.157045 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_hs83zc0/baf5ef38e917455db1dca6b6602c377d.delta /opt/stack/data/nova/instances/snapshots/tmp_hs83zc0/baf5ef38e917455db1dca6b6602c377d" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:46.157674 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Snapshot extracted, beginning image upload
Jun 27 04:04:46.175697 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "refresh_cache-449cab84-f0b9-40e0-bcb3-595b102c1303" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:46.262422 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:04:46.263819 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:04:46.264165 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Creating image(s)
Jun 27 04:04:46.265043 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "/opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:46.265208 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "/opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:46.265729 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "/opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:46.266255 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:46.269737 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:46.270953 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:46.283527 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:46.349416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:46.349986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:46.350614 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:46.351217 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:46.354287 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:04:46.354421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:46.374590 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:46.443193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:46.443824 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:46.480573 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk 1073741824" returned: 0 in 0.037s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:46.481596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.130s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:46.481596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:46.547184 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.065s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:46.547714 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:04:46.548560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:46.548766 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:46.549043 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-8e4345c6-eb4c-4b2e-8017-7bd5340110a6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:46.549635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:46.549831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:46.550181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:46.565547 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port 2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:46.572486 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:46.624725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:46.625083 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Cannot resize image /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:04:46.625444 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:04:46.625685 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Ensure instance console log exists: /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:04:46.625957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:46.626182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:46.626366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:47.078160 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:47.080355 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c02f9b9-e232-492e-b975-2a4536b1d607 req-423f6a11-52bc-4e9a-88ba-ba852a3db280 service nova] Releasing lock "refresh_cache-449cab84-f0b9-40e0-bcb3-595b102c1303" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:47.080672 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquired lock "refresh_cache-449cab84-f0b9-40e0-bcb3-595b102c1303" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:47.080954 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:47.211730 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:47.225723 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: 752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:47.237377 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-changed-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:47.240806 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Refreshing instance network info cache due to event network-changed-b7ad965d-b785-4081-aede-59ad6a86188b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:47.240806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] Acquiring lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:47.240806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] Acquired lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:47.240806 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Refreshing network info cache for port b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:47.418169 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:47.673973 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:47.749949 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:47.919193 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:47.921513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ecc4de39-bc9e-4543-a3cc-dd9a1d886dd6 req-1beb233a-3806-45c0-8fba-10b9dbb14066 service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:47.922161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:47.922482 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port 8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:48.119001 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Updating instance_info_cache with network_info: [{"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:48.252149 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:48.428509 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:48.453686 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updated VIF entry in instance network info cache for port b7ad965d-b785-4081-aede-59ad6a86188b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:48.454053 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updating instance_info_cache with network_info: [{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:48.529151 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:48.620694 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Releasing lock "refresh_cache-449cab84-f0b9-40e0-bcb3-595b102c1303" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:48.621149 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Instance network_info: |[{"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:48.624307 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Start _get_guest_xml network_info=[{"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:48.629034 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:48.631072 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1187085653', uuid='449cab84-f0b9-40e0-bcb3-595b102c1303'), owner=OwnerMeta(userid='9eb961442fd240f58e6e1b794a94b458', username='tempest-DeleteServersTestJSON-878476380-project-member', projectid='d3262b8f5fb44457b7ccb37d681055bc', projectname='tempest-DeleteServersTestJSON-878476380'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533088.6304133) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:48.636463 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:48.636873 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:48.638584 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:48.638836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:48.641394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:48.641905 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:48.643035 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:48.643174 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:48.643257 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:48.643434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:48.643571 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:48.643886 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:48.643953 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:48.644130 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:48.644208 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:48.644389 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:48.647740 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Successfully updated port: a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:48.664978 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1187085653',display_name='tempest-DeleteServersTestJSON-server-1187085653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-deleteserverstestjson-server-1187085653',id=9,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3262b8f5fb44457b7ccb37d681055bc',ramdisk_id='',reservation_id='r-o77g1nil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-878476380',owner_user_name='tempest-DeleteServersTestJSON-878476380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:45Z,user_data=None,user_id='9eb961442fd240f58e6e1b794a94b458',uuid=449cab84-f0b9-40e0-bcb3-595b102c1303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:04:48.664978 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Converting VIF {"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:48.665935 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:48.666159 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lazy-loading 'pci_devices' on Instance uuid 449cab84-f0b9-40e0-bcb3-595b102c1303 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:48.722455 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:48.722820 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-a1e92a3f-1a46-4ae7-ae73-158e544bfb94. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:48.723619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:48.742834 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:48.813392 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:48.956444 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-03473d9d-3d5f-4954-822d-8f03ba0deecd req-2e815e07-f1ea-4655-94da-5f27dc6b0d6c service nova] Releasing lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:49.160065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <uuid>449cab84-f0b9-40e0-bcb3-595b102c1303</uuid>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <name>instance-00000009</name>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:name>tempest-DeleteServersTestJSON-server-1187085653</nova:name>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:48</nova:creationTime>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:user uuid="9eb961442fd240f58e6e1b794a94b458">tempest-DeleteServersTestJSON-878476380-project-member</nova:user>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:project uuid="d3262b8f5fb44457b7ccb37d681055bc">tempest-DeleteServersTestJSON-878476380</nova:project>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         <nova:port uuid="a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <entry name="serial">449cab84-f0b9-40e0-bcb3-595b102c1303</entry>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <entry name="uuid">449cab84-f0b9-40e0-bcb3-595b102c1303</entry>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.config"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:ab:ed:f1"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <target dev="tapa7812e2f-35"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/console.log" append="off"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:04:49.169468 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:04:49.172998 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Preparing to wait for external event network-vif-plugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:04:49.172998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:49.172998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:49.172998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:49.172998 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1187085653',display_name='tempest-DeleteServersTestJSON-server-1187085653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-deleteserverstestjson-server-1187085653',id=9,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3262b8f5fb44457b7ccb37d681055bc',ramdisk_id='',reservation_id='r-o77g1nil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-878476380',owner_user_name='tempest-DeleteServersTestJSON-878476380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:45Z,user_data=None,user_id='9eb961442fd240f58e6e1b794a94b458',uuid=449cab84-f0b9-40e0-bcb3-595b102c1303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:04:49.173263 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Converting VIF {"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:04:49.173263 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:04:49.173263 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:04:49.173263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:49.173263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:49.173263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:04:49.173583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:49.173804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20361317-2460-522a-b021-019a9a7deb13', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:49.175924 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:49.175924 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:49.178142 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:49.178399 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7812e2f-35, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:49.178838 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7812e2f-35, col_values=(('qos', UUID('b4c13d45-df3a-4f8a-add3-5bfaea485bf9')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:49.179062 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7812e2f-35, col_values=(('external_ids', {'iface-id': 'a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ed:f1', 'vm-uuid': '449cab84-f0b9-40e0-bcb3-595b102c1303'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:04:49.180189 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:49.181940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:04:49.186250 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:49.187344 np0000003830 nova-compute[98984]: INFO os_vif [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35')
Jun 27 04:04:49.246345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3738e6d7-45f7-4e61-8529-63d067596f6c req-5bf4608e-4747-4303-b855-efcb8978b2a3 service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:49.247246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:49.247246 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:49.317850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:49.317850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-752f568e-442f-482f-bee6-23258b2a5023. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:49.317850 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:49.753602 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:49.836033 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:49.923717 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Snapshot image upload complete
Jun 27 04:04:49.923950 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b2fa4342-6c46-46e6-8207-07adb2f555ff tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Took 6.25 seconds to snapshot the instance on the hypervisor.
Jun 27 04:04:50.052308 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:50.554521 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8302bfba-b2e9-470a-8f16-aa6904fe2c64 req-5bb1469a-4755-4151-a11b-a8cef63c29cf service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:50.554834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:50.554952 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:04:50.707931 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:50.708849 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:04:50.709089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No VIF found with MAC fa:16:3e:ab:ed:f1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:04:50.710995 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Using config drive
Jun 27 04:04:51.153825 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:51.218453 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:51.351321 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:51.413140 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Creating config drive at /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.config
Jun 27 04:04:51.416795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps9dm22z9 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:04:51.461215 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps9dm22z9" returned: 0 in 0.044s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:04:51.771466 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:51.995406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.024972 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.027259 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.152265 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.229444 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:52.309653 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e12f686d-6308-4191-a73b-8c992ccceebe req-ade52032-957d-420d-a365-96a5c1a54849 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-plugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:52.309653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e12f686d-6308-4191-a73b-8c992ccceebe req-ade52032-957d-420d-a365-96a5c1a54849 service nova] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:52.309902 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e12f686d-6308-4191-a73b-8c992ccceebe req-ade52032-957d-420d-a365-96a5c1a54849 service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:52.310669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e12f686d-6308-4191-a73b-8c992ccceebe req-ade52032-957d-420d-a365-96a5c1a54849 service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:52.310669 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e12f686d-6308-4191-a73b-8c992ccceebe req-ade52032-957d-420d-a365-96a5c1a54849 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Processing event network-vif-plugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:04:52.321924 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:52.324737 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:52.447725 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.455028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.479461 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:52.759764 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:52.826431 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:04:53.184773 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:53.198337 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533093.197769, 449cab84-f0b9-40e0-bcb3-595b102c1303 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:53.198774 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] VM Started (Lifecycle Event)
Jun 27 04:04:53.199701 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:04:53.202878 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:04:53.205146 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Instance spawned successfully.
Jun 27 04:04:53.205691 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:04:53.407000 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:53.407000 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:53.412078 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:04:53.412323 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Claim successful on node np0000003830
Jun 27 04:04:53.583446 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:53.702484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:53.704348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:53.712701 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:53.712916 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:53.713322 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:53.713654 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:53.714045 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:53.714208 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:04:53.820442 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:53.983815 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:54.150826 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [{"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:54.181624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:54.210949 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:04:54.211219 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533094.2110243, 449cab84-f0b9-40e0-bcb3-595b102c1303 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:54.211360 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] VM Paused (Lifecycle Event)
Jun 27 04:04:54.220702 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Took 7.96 seconds to spawn the instance on the hypervisor.
Jun 27 04:04:54.220702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:54.394905 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-185333de-7e39-4635-ba7c-fad01b74f255 req-c3c1e015-ec2e-4f46-89e0-93e6d637cbb7 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-plugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:54.395467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-185333de-7e39-4635-ba7c-fad01b74f255 req-c3c1e015-ec2e-4f46-89e0-93e6d637cbb7 service nova] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:54.395803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-185333de-7e39-4635-ba7c-fad01b74f255 req-c3c1e015-ec2e-4f46-89e0-93e6d637cbb7 service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:54.395972 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-185333de-7e39-4635-ba7c-fad01b74f255 req-c3c1e015-ec2e-4f46-89e0-93e6d637cbb7 service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:54.396163 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-185333de-7e39-4635-ba7c-fad01b74f255 req-c3c1e015-ec2e-4f46-89e0-93e6d637cbb7 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] No waiting events found dispatching network-vif-plugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:04:54.396372 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-185333de-7e39-4635-ba7c-fad01b74f255 req-c3c1e015-ec2e-4f46-89e0-93e6d637cbb7 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received unexpected event network-vif-plugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e for instance with vm_state active and task_state None.
Jun 27 04:04:54.653165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:54.653966 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance network_info: |[{"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:04:54.655879 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:54.656299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Start _get_guest_xml network_info=[{"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '2062453f-73e3-4280-9a83-60acbd2d7fc5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0bdb15c0-e951-4850-963b-2439b99b93f7', 'attached_at': '', 'detached_at': '', 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'serial': '21edcccc-4546-4c75-8a26-aba5c952c93a'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': 'bd0f44e7-bc9c-4d5b-ad00-1214088c29ec', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0bdb15c0-e951-4850-963b-2439b99b93f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'serial': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '3a6ac0d9-e9a4-4f96-9e39-35401614b0cd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0bdb15c0-e951-4850-963b-2439b99b93f7', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'serial': 'f5bca00e-bc31-469e-9030-dcbd935f12df'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:04:54.656750 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port 752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:54.660069 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:04:54.661641 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-131578094', uuid='0bdb15c0-e951-4850-963b-2439b99b93f7'), owner=OwnerMeta(userid='b2ca81daafb240d491c79ed8561982a1', username='tempest-TaggedBootDevicesTest_v242-1895596559-project-member', projectid='97026720e5114b53a1aa2cd0d93104ea', projectname='tempest-TaggedBootDevicesTest_v242-1895596559'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533094.660192) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:04:54.661946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:04:54.662347 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:04:54.665380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:04:54.665757 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:04:54.666966 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:04:54.668122 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:04:54.668122 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:04:54.669225 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:04:54.669368 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:04:54.669443 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:04:54.669584 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:04:54.669772 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:04:54.669911 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:04:54.670068 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:04:54.670767 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:04:54.671258 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:04:54.692644 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:54.693386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:54.695794 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connector [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Factory for ISCSI on None {{(pid=98984) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
Jun 27 04:04:54.696447 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:54.696447 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:04:54.696692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:04:54.698817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:04:54.698817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:04:54.698817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:04:54.711229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:04:54.712262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:04:54.712823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:04:54.713056 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:04:54.713997 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:54.714395 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:04:54.714629 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:04:54.716098 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533094.7157335, 449cab84-f0b9-40e0-bcb3-595b102c1303 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:04:54.716098 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] VM Resumed (Lifecycle Event)
Jun 27 04:04:54.725563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:04:54.725563 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:54.729954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:04:54.729954 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:54.733609 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Took 13.70 seconds to build instance.
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a] added
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:54.742084 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:54.742449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:04:54.742647 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:04:54.742871 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a] added
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:54.756574 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:54.757385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:04:54.757705 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.043(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:04:54.758942 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:04:55.035715 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:04:55.037324 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:04:55.160042 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:55.219730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:04:55.223253 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:04:55.236583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8113da80-b4ca-4d98-b0cc-1ea90089222f tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.212s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:55.542424 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:04:55.617845 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:55.743293 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:04:55.756487 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:55.760581 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:04:55.772090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:04:55.777444 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:55.789185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:04:55.789185 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:04:55.789344 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:04:55.789344 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:04:55.789427 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:04:55.789427 np0000003830 nova-compute[98984]: 
Jun 27 04:04:55.790049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:55.809857 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:04:55.809857 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:04:55.810076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:04:55.810076 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:04:55.810154 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:04:55.810154 np0000003830 nova-compute[98984]: 
Jun 27 04:04:55.813832 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updated VIF entry in instance network info cache for port 752f568e-442f-482f-bee6-23258b2a5023. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:04:55.814650 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [{"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:56.050808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.644s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:56.051305 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:04:56.319954 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b10a3470-95e1-4583-a1f8-a2f53390b6c7 req-12f7b6cd-32a1-41e8-997a-c0c1b499c353 service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:56.559381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:04:56.559601 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:04:56.559910 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:56.560179 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:56.673537 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2bd621defb420db9fd8345c5b36248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771234de69074fed81ffef19dcee2804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:04:56.696339 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:04:56.696805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:04:56.844556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.50.100,3260]
Jun 27 04:04:56.844556 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.50.100,3260] successful.
Jun 27 04:04:56.844556 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:56.850204 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.40.100,3260]
Jun 27 04:04:56.850204 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.40.100,3260] successful.
Jun 27 04:04:56.850204 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:56.858960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:56.872416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:56.881295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.881295 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.881295 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:04:56.881295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.881295 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.881295 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:04:56.882088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.168s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:04:56.882397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:04:56.883291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:04:56.883402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:04:56.892984 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.892984 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.892984 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.179s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:04:56.894844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:04:56.915521 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:04:56.934597 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:04:56.934597 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:04:57.064787 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:04:57.200635 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lazy-loading 'flavor' on Instance uuid 449cab84-f0b9-40e0-bcb3-595b102c1303 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:04:57.369837 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Successfully created port: b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:04:57.570932 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:04:57.911377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:04:57.911876 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:04:58.078906 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Booting with blank volume at /dev/vda
Jun 27 04:04:58.184705 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Successfully updated port: b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:04:58.210513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:04:58.280451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-changed-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:04:58.280451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Refreshing instance network info cache due to event network-changed-b4a8af07-d05c-4f98-98c1-0f087b0fcd54. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:04:58.280451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] Acquiring lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:58.280451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] Acquired lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:58.280451 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Refreshing network info cache for port b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:04:58.687244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:04:58.733765 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Found WWN 330000000b68bcf25 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:04:58.734138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:04:58.734342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== connect_volume: return (4037ms) {'type': 'block', 'scsi_wwn': '330000000b68bcf25', 'path': '/dev/dm-0', 'multipath_id': '330000000b68bcf25'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:04:58.734559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b68bcf25', 'path': '/dev/dm-0', 'multipath_id': '330000000b68bcf25'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:04:58.786444 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:04:58.822612 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:58.877994 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:04:59.115214 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:04:59.184172 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:04:59.242330 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:04:59.242737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:04:59.242925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:04:59.243336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:04:59.243641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:04:59.258281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:04:59.258807 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:04:59.258991 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:04:59.261450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:04:59.262353 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:04:59.262844 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:04:59.272207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:04:59.272207 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:59.278347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:04:59.278347 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061] added
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:59.290329 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:59.296159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:04:59.296159 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:04:59.296159 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061] added
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:04:59.298948 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:04:59.299290 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:04:59.299290 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:04:59.299466 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:04:59.620044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5703ca43-186a-45b3-bbc0-4589737f8d73 req-a431dbe5-06a5-48d7-b435-ae695002e26a service nova] Releasing lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:04:59.621075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:04:59.621202 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:00.121272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:00.121272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:00.121691 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Attaching volume 694e1d83-a81f-41e7-a38c-edb12c3525a3 to /dev/vdb
Jun 27 04:05:00.180560 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:00.198771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:00.219997 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:05:00.223639 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:00.249776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:00.250215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:00.260643 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:00.262052 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:feab:edf1', 'fe80::58f0:e6ff:fe0c:b2d4'] 
Jun 27 04:05:00.262202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:00.262304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:00.263813 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:00.263813 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Updating existing volume attachment record: 175a79eb-cf96-47bb-858e-15e4c1b9f022 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:00.292460 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:00.300469 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:00.308453 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:00.314342 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.322687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.331804 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.337801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.337801 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.337801 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:00.338098 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.338098 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.338098 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:00.352726 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.352726 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.352726 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:00.352726 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.352726 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.352726 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:00.377148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.40.100,3260]
Jun 27 04:05:00.377148 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:00.377148 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.392843 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.406069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.50.100,3260]
Jun 27 04:05:00.406069 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:00.406069 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.413386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.413386 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.413386 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.413386 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.413386 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:00.413531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.413531 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.413531 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.413531 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.413531 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:00.414175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:00.414175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:00.415109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:00.415109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:00.422193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:00.435799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:00.442242 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:00.442906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:00.442906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:00.443328 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:00.443398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:00.464683 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:00.488584 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:00.609291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:00.609523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:00.723190 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Updating instance_info_cache with network_info: [{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:00.864232 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:00.864573 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '694e1d83-a81f-41e7-a38c-edb12c3525a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:00.864775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:01.116255 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:05:01.226380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:01.227185 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance network_info: |[{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:05:01.436089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:01.436219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:01.457364 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "interface-c1d90648-3e76-41e4-9f71-9178785a8979-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:01.457643 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "interface-c1d90648-3e76-41e4-9f71-9178785a8979-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:01.458089 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'flavor' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:01.467247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:01.467486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:01.675369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:01.675699 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:01.680080 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:05:01.681969 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Claim successful on node np0000003830
Jun 27 04:05:01.743454 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:01.756213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:01.776638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:01.798778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:01.799252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:01.808347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:01.810400 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:feab:edf1', 'fe80::58f0:e6ff:fe0c:b2d4'] 
Jun 27 04:05:01.811116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:01.811274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:01.811511 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:01.811773 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Updating existing volume attachment record: 13d3ddb8-228a-444f-a76b-db7d78fee107 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:01.962842 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:02.140024 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'pci_requests' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:02.264740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:02.642862 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Object Instance<c1d90648-3e76-41e4-9f71-9178785a8979> lazy-loaded attributes: flavor,pci_requests {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:02.643001 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:05:02.643257 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:02.643508 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:02.736156 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9a99814caeb41859b0a2000f52a4c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20eaa28753124b488bd3e69bbc01af54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:05:03.283732 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Found WWN 3300000006bf24e4f for multipath device dm-3 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:03.284420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:03.284641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== connect_volume: return (4041ms) {'type': 'block', 'scsi_wwn': '3300000006bf24e4f', 'path': '/dev/dm-3', 'multipath_id': '3300000006bf24e4f'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:03.284808 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006bf24e4f', 'path': '/dev/dm-3', 'multipath_id': '3300000006bf24e4f'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:03.285329 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.421s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:03.285657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '694e1d83-a81f-41e7-a38c-edb12c3525a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:03.296534 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Successfully created port: 7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:05:03.302612 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:03.304154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:03.305452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:03.305452 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:03.305800 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:03.305999 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:03.320542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:03.320542 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:03.328599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:03.328599 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3] added
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:03.343525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:03.344014 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3] added
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:03.345904 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:03.346327 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:03.346327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:03.346601 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:03.346795 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:03.348014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:03.348096 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:03.804110 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:03.806788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:03.806788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:03.820790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:03.852987 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:04.012594 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Creating image(s)
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Ensure instance console log exists: /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:04.016090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Start _get_guest_xml network_info=[{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '13d3ddb8-228a-444f-a76b-db7d78fee107', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '58490b25-bc9d-4a48-aff3-3eb967088bc8', 'attached_at': '', 'detached_at': '', 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'serial': '42cf866d-9c6d-4cb7-a814-58d9c1f02365'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:05:04.021973 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:05:04.023650 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1870437479', uuid='58490b25-bc9d-4a48-aff3-3eb967088bc8'), owner=OwnerMeta(userid='6c2bd621defb420db9fd8345c5b36248', username='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member', projectid='771234de69074fed81ffef19dcee2804', projectname='tempest-ServerBootFromVolumeStableRescueTest-2029132639'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533104.02325) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:04.024796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:05:04.025260 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:05:04.026138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:05:04.026406 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:05:04.027803 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:05:04.029514 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:05:04.041561 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:04.042348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:04.042692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:04.185284 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:04.205916 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Successfully updated port: 7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:05:04.262221 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-changed-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:04.262950 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Refreshing instance network info cache due to event network-changed-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:04.263182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] Acquiring lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:04.263367 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] Acquired lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:04.263530 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Refreshing network info cache for port 7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:04.346524 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:04.347386 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:04.361705 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.365067 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.687s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:04.365067 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:04.377644 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.388466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.394593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.403425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.403425 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.403425 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.403425 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.403425 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:04.403717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.403717 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.403717 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.403717 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.403717 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:04.411516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.411516 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.411516 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.411516 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.411516 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:04.411761 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.411761 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.411761 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.411761 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.411761 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:04.444025 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.40.100,3260]
Jun 27 04:05:04.444025 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:04.444025 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.459055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.459215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.50.100,3260]
Jun 27 04:05:04.459215 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:04.459215 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.476350 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.476691 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:04.476950 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:04.477037 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:04.477998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:04.478129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:04.478864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:04.499402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:04.499402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '694e1d83-a81f-41e7-a38c-edb12c3525a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.501599 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:04.501913 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:04.502134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:04.502538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:04.504034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:04.504144 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:04.523528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:04.708117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:04.765923 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:04.870447 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:05:04.870651 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:05:04.871598 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:04.871943 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:04.964742 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb2d09351b2447bbfce95b09ad97b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b76ce35cec84d189228639d70c6be45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:05:05.142852 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:05.342249 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Added VIF to instance network info cache for port 7d2fe356-f649-4eeb-a8a8-28c9e2b502f5. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3531}}
Jun 27 04:05:05.342898 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:05.376864 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:05:05.524149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:05.524346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '694e1d83-a81f-41e7-a38c-edb12c3525a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:05.586386 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Successfully created port: cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:05:05.847860 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee03777d-93f6-408d-ac79-29fc6c71ad1b req-c0c3513e-a913-40d3-ac27-fac80b0359c4 service nova] Releasing lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:05.848293 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquired lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:05.848750 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:05.879058 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:05:06.193801 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Successfully updated port: cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:05:06.247571 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-changed-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:06.247775 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Refreshing instance network info cache due to event network-changed-cae96b34-24ed-4e2c-bbb8-8659432395f6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:06.247917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] Acquiring lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:06.248092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] Acquired lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:06.248092 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Refreshing network info cache for port cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:06.325126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Found WWN 33000000056036313 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:06.325413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:06.325629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] <== connect_volume: return (5460ms) {'type': 'block', 'scsi_wwn': '33000000056036313', 'path': '/dev/dm-4', 'multipath_id': '33000000056036313'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:06.325800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000056036313', 'path': '/dev/dm-4', 'multipath_id': '33000000056036313'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:06.326923 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.522s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:06.327334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:06.329068 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lazy-loading 'flavor' on Instance uuid 449cab84-f0b9-40e0-bcb3-595b102c1303 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:06.340343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:06.341257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:06.341910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:06.342249 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:06.342803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:06.343104 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:06.354880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:06.354880 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:06.356008 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:06.356008 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df] added
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:06.369246 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:06.369564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:06.369607 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:06.369778 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df] added
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:06.371194 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:06.371345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:06.371519 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:06.371707 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:06.418576 np0000003830 nova-compute[98984]: WARNING nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] 00413ed2-7db2-47e8-ac42-81160431a2e3 already exists in list: networks containing: ['00413ed2-7db2-47e8-ac42-81160431a2e3']. ignoring it
Jun 27 04:05:06.418576 np0000003830 nova-compute[98984]: WARNING nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] 7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 already exists in list: port_ids containing: ['7d2fe356-f649-4eeb-a8a8-28c9e2b502f5']. ignoring it
Jun 27 04:05:06.625074 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:06.696722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:06.750607 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:06.833772 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Attempting to attach volume 694e1d83-a81f-41e7-a38c-edb12c3525a3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]:   <alias name="ua-694e1d83-a81f-41e7-a38c-edb12c3525a3"/>
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]:   <serial>694e1d83-a81f-41e7-a38c-edb12c3525a3</serial>
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:06.835234 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:06.853704 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:05:06.888938 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:05:06.889835 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:05:06.890096 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Creating image(s)
Jun 27 04:05:06.890658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:06.890847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:06.891454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:06.892149 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:06.896403 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:06.898753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:06.987715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:06.988141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:06.988652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:06.989128 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:06.992257 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:06.992902 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:07.017746 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:07.069687 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:07.074384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.081s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:07.074384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:07.120180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk 1073741824" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:07.120669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.132s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:07.120991 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:07.184916 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:07.204484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.083s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:07.205018 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:05:07.205343 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:07.290740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:07.291123 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Cannot resize image /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:05:07.291518 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:05:07.291740 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Ensure instance console log exists: /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:05:07.292018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:07.292338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:07.292486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:07.370329 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:07.372193 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:07.387992 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:07.391430 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.402132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.407684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.418962 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.419636 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.425434 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.425897 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:07.466988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.50.100,3260]
Jun 27 04:05:07.466988 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:07.466988 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.481296 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.482745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.40.100,3260]
Jun 27 04:05:07.482745 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:07.482745 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.500877 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.501282 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:07.501728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:07.501728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:07.502749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:07.502840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:07.505254 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:07.527657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.528280 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:07.529129 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:07.529583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:07.530036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:07.531219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:07.531377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:07.548737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:07.572009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-65134e03-542d-4720-81cb-6400264593ae req-bcc0850e-8bad-4baf-a2a8-baa42fb931cf service nova] Releasing lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:07.572654 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:07.572956 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:07.687651 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Releasing lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:07.691307 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:07.691307 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:07.692355 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:07.693078 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:07.693249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.693942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:07.694136 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:07.695641 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.695858 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60a6e1ae-77ab-5c8d-bdd3-5f5abde494c5', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:07.700127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.700127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:07.700127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.702074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.702280 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d2fe356-f6, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:07.702744 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d2fe356-f6, col_values=(('qos', UUID('69c639c0-3d64-4475-8553-6bfb3d415bcf')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:07.703092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d2fe356-f6, col_values=(('external_ids', {'iface-id': '7d2fe356-f649-4eeb-a8a8-28c9e2b502f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:bf:67', 'vm-uuid': 'c1d90648-3e76-41e4-9f71-9178785a8979'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:07.704646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.705367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:07.714246 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.717120 np0000003830 nova-compute[98984]: INFO os_vif [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6')
Jun 27 04:05:07.719534 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:07.719534 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:07.720829 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] attach device xml: <interface type="ethernet">
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]:   <mac address="fa:16:3e:18:bf:67"/>
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]:   <model type="virtio"/>
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]:   <driver name="qemu"/>
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]:   <mtu size="1372"/>
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]:   <target dev="tap7d2fe356-f6"/>
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]: </interface>
Jun 27 04:05:07.722818 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:07.745524 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.815656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.825674 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:07.877058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:08.150055 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c87c2d28-f657-4c08-b736-48f357a282c3 req-2a99c500-e03a-4eff-9142-3fb8fe5043f4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-plugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:08.150782 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c87c2d28-f657-4c08-b736-48f357a282c3 req-2a99c500-e03a-4eff-9142-3fb8fe5043f4 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:08.154871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c87c2d28-f657-4c08-b736-48f357a282c3 req-2a99c500-e03a-4eff-9142-3fb8fe5043f4 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:08.157113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c87c2d28-f657-4c08-b736-48f357a282c3 req-2a99c500-e03a-4eff-9142-3fb8fe5043f4 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:08.157113 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c87c2d28-f657-4c08-b736-48f357a282c3 req-2a99c500-e03a-4eff-9142-3fb8fe5043f4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-plugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:08.157113 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c87c2d28-f657-4c08-b736-48f357a282c3 req-2a99c500-e03a-4eff-9142-3fb8fe5043f4 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-plugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 for instance with vm_state active and task_state None.
Jun 27 04:05:08.180380 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:05:08.250530 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:08.255667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:08.264983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:08.287054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:08.424673 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:08.522279 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:08.522758 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:08.523112 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:08.523326 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] No VIF found with MAC fa:16:3e:ab:ed:f1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:08.531269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:08.531269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:08.550030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:08.550030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:08.629524 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updating instance_info_cache with network_info: [{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:08.825323 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.131743 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:09.132051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance network_info: |[{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:05:09.134188 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Start _get_guest_xml network_info=[{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:05:09.138043 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:05:09.139619 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-1323519502', uuid='9f560b0d-dc54-4d68-a06b-71401abd49eb'), owner=OwnerMeta(userid='ebb2d09351b2447bbfce95b09ad97b23', username='tempest-ServerActionsTestOtherA-1390022329-project-member', projectid='4b76ce35cec84d189228639d70c6be45', projectname='tempest-ServerActionsTestOtherA-1390022329'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533109.1392136) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:09.141192 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:05:09.147594 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:05:09.149380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:05:09.149654 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:05:09.150931 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:05:09.151397 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:05:09.152041 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:05:09.152041 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:05:09.152041 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:05:09.152413 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:05:09.152626 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:05:09.153079 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:05:09.153079 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:05:09.153204 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:05:09.153263 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:05:09.153442 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:05:09.174605 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1323519502',display_name='tempest-tempest.common.compute-instance-1323519502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-tempest-common-compute-instance-1323519502',id=11,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI9xfxfD6g5hHXvRwB1cGd+3Ord0BopOOvhperZGd/ghdEcMyEp1xbdxEVjA/3QZyaRwnT7dLUUdrrnyVKJXYDGNJzWn8jrrRHLF1SlO5BgRPvlwjOpfHMYPHjDmELizw==',key_name='tempest-keypair-625566794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-830mrx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=9f560b0d-dc54-4d68-a06b-71401abd49eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:09.174605 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:09.174605 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:09.174605 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:09.345639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:09.412764 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:09.413000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:09.413466 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No VIF found with MAC fa:16:3e:ae:33:c8, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <uuid>9f560b0d-dc54-4d68-a06b-71401abd49eb</uuid>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <name>instance-0000000b</name>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:name>tempest-tempest.common.compute-instance-1323519502</nova:name>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:05:09</nova:creationTime>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:user uuid="ebb2d09351b2447bbfce95b09ad97b23">tempest-ServerActionsTestOtherA-1390022329-project-member</nova:user>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:project uuid="4b76ce35cec84d189228639d70c6be45">tempest-ServerActionsTestOtherA-1390022329</nova:project>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         <nova:port uuid="cae96b34-24ed-4e2c-bbb8-8659432395f6">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <entry name="serial">9f560b0d-dc54-4d68-a06b-71401abd49eb</entry>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <entry name="uuid">9f560b0d-dc54-4d68-a06b-71401abd49eb</entry>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:63:9e:91"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <target dev="tapcae96b34-24"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/console.log" append="off"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:09.677451 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Preparing to wait for external event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1323519502',display_name='tempest-tempest.common.compute-instance-1323519502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-tempest-common-compute-instance-1323519502',id=11,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI9xfxfD6g5hHXvRwB1cGd+3Ord0BopOOvhperZGd/ghdEcMyEp1xbdxEVjA/3QZyaRwnT7dLUUdrrnyVKJXYDGNJzWn8jrrRHLF1SlO5BgRPvlwjOpfHMYPHjDmELizw==',key_name='tempest-keypair-625566794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-830mrx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=9f560b0d-dc54-4d68-a06b-71401abd49eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:09.680506 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:09.681425 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.681812 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:09.682149 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:09.683261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.683613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e517e3c-27b5-5b58-a196-7856a5b79b44', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:09.684604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.685249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:09.687424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.690624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.691145 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcae96b34-24, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:09.691656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcae96b34-24, col_values=(('qos', UUID('1c97a590-9e4e-407e-abc4-bde077aaf3a1')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:09.691916 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcae96b34-24, col_values=(('external_ids', {'iface-id': 'cae96b34-24ed-4e2c-bbb8-8659432395f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:9e:91', 'vm-uuid': '9f560b0d-dc54-4d68-a06b-71401abd49eb'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:09.693611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.694913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:09.702840 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:09.704143 np0000003830 nova-compute[98984]: INFO os_vif [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24')
Jun 27 04:05:09.922035 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1270200106', uuid='c1d90648-3e76-41e4-9f71-9178785a8979'), owner=OwnerMeta(userid='e9a99814caeb41859b0a2000f52a4c38', username='tempest-TaggedAttachmentsTest-1939092029-project-member', projectid='20eaa28753124b488bd3e69bbc01af54', projectname='tempest-TaggedAttachmentsTest-1939092029'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533109.9213302) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:09</nova:creationTime>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     <nova:port uuid="7d2fe356-f649-4eeb-a8a8-28c9e2b502f5">
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.10.10.135" ipVersion="4"/>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:09.922539 np0000003830 nova-compute[98984]:  {{(pid=98984) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
Jun 27 04:05:10.112448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b26d392c-a020-4372-8f2b-fd88c48289b9 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.991s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:10.236619 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee82c1b8-51d6-493f-9b13-ed7cb70e0357 req-1c06dc5f-43d6-4833-8f26-c585d929c48f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-plugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:10.236708 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee82c1b8-51d6-493f-9b13-ed7cb70e0357 req-1c06dc5f-43d6-4833-8f26-c585d929c48f service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:10.236956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee82c1b8-51d6-493f-9b13-ed7cb70e0357 req-1c06dc5f-43d6-4833-8f26-c585d929c48f service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:10.237358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee82c1b8-51d6-493f-9b13-ed7cb70e0357 req-1c06dc5f-43d6-4833-8f26-c585d929c48f service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:10.237645 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee82c1b8-51d6-493f-9b13-ed7cb70e0357 req-1c06dc5f-43d6-4833-8f26-c585d929c48f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-plugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:10.241306 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ee82c1b8-51d6-493f-9b13-ed7cb70e0357 req-1c06dc5f-43d6-4833-8f26-c585d929c48f service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-plugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 for instance with vm_state active and task_state None.
Jun 27 04:05:10.363677 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Found WWN 3300000001be01518 for multipath device dm-5 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:10.363880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:10.364280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== connect_volume: return (6559ms) {'type': 'block', 'scsi_wwn': '3300000001be01518', 'path': '/dev/dm-5', 'multipath_id': '3300000001be01518'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:10.364469 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001be01518', 'path': '/dev/dm-5', 'multipath_id': '3300000001be01518'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:10.367304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.324s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:10.369062 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:10.383802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:10.385339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:10.386102 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:10.386421 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:10.387604 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:10.388464 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:10.400382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:10.400382 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:10.407165 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:10.407165 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365] added
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:10.420620 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365] added
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:10.421896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:10.422627 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:10.422627 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:10.428316 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6fe1e9fb-5f94-4c0c-8cc0-a189aa5ffbdb tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "interface-c1d90648-3e76-41e4-9f71-9178785a8979-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.971s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:10.685345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:10.685943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:10.875442 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.875775 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.876629 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.877173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.877379 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.878115 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.879123 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.879399 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.880009 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.880888 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.881142 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.881792 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.882715 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.882980 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.883553 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.884418 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.884654 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.885165 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.886129 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:10.886381 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:10.887016 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:10.887719 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bdb15c0-e951-4850-963b-2439b99b93f7 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:10.980705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:10.980991 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:10.981272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:10.982165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:10.982165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:10.988076 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Terminating instance
Jun 27 04:05:11.189161 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lazy-loading 'flavor' on Instance uuid a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:11.222565 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:11.222692 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:11.222799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No VIF found with MAC fa:16:3e:63:9e:91, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:11.223223 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Using config drive
Jun 27 04:05:11.276578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.276578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <uuid>0bdb15c0-e951-4850-963b-2439b99b93f7</uuid>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <name>instance-00000008</name>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:name>tempest-device-tagging-server-131578094</nova:name>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:04:54</nova:creationTime>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:user uuid="b2ca81daafb240d491c79ed8561982a1">tempest-TaggedBootDevicesTest_v242-1895596559-project-member</nova:user>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:project uuid="97026720e5114b53a1aa2cd0d93104ea">tempest-TaggedBootDevicesTest_v242-1895596559</nova:project>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="b889b1b6-e646-47d0-a58a-deb2c27cb567">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="34c66af1-878e-42c8-ab08-32e34e085f38">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.201" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.194" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="8e4345c6-eb4c-4b2e-8017-7bd5340110a6">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="2a748cfd-0098-4b02-ae17-e5818b112843">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="752f568e-442f-482f-bee6-23258b2a5023">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         <nova:port uuid="a1e92a3f-1a46-4ae7-ae73-158e544bfb94">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <entry name="serial">0bdb15c0-e951-4850-963b-2439b99b93f7</entry>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <entry name="uuid">0bdb15c0-e951-4850-963b-2439b99b93f7</entry>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7/disk.config"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <alias name="ua-21edcccc-4546-4c75-8a26-aba5c952c93a"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <serial>21edcccc-4546-4c75-8a26-aba5c952c93a</serial>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <alias name="ua-b0b7b3a1-c205-4ea6-bbc1-b60973d55061"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-3"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <serial>b0b7b3a1-c205-4ea6-bbc1-b60973d55061</serial>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <alias name="ua-f5bca00e-bc31-469e-9030-dcbd935f12df"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-5"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="vdc" bus="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <serial>f5bca00e-bc31-469e-9030-dcbd935f12df</serial>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:7d:30:7d"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tapb889b1b6-e6"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:03:a7:ea"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tap34c66af1-87"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:46:62:3c"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tape4c0ad82-96"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:99:58:e6"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tap8e4345c6-eb"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:9e:c1:84"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tap2a748cfd-00"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:43:7e:69"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tap752f568e-44"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:46:6c:7a"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <target dev="tapa1e92a3f-1a"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7/console.log" append="off"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:11.391531 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:05:11.395088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.395088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.395088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.395088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.395088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.395088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.395268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.395413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.395636 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.395764 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.395940 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.396073 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.396258 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.396377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.396668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.396829 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.396993 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.397099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.397258 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.397391 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.397826 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.398004 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.398212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.398514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.398768 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Preparing to wait for external event network-vif-plugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:11.398984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.399252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.399471 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.400382 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:11.400665 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:11.401378 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:11.401731 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:11.402484 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.402484 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.402484 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:11.403926 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.403926 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ebdbf9d-ff12-584d-ae05-208d1dc22228', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.405002 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.405002 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.412570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.415568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.415568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb889b1b6-e6, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.415568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb889b1b6-e6, col_values=(('qos', UUID('5a87a932-9aec-454b-a43f-21fc464d22f2')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.415568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb889b1b6-e6, col_values=(('external_ids', {'iface-id': 'b889b1b6-e646-47d0-a58a-deb2c27cb567', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:30:7d', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.415983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.417646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.420520 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:11.423806 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:11.427291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.429895 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6')
Jun 27 04:05:11.430865 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:11.431160 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:11.431936 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:11.432291 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:11.433738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.433738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.433738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:11.435879 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:11.439028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.439028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a1c123a-9682-5aa0-8cf1-ff298b912496', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.440326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.440326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:11.442367 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:11.449525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:11.453956 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.458195 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:11.458828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.459154 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34c66af1-87, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.460440 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34c66af1-87, col_values=(('qos', UUID('a9d69c51-cd46-480b-88e1-7e4e88141df5')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.460440 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34c66af1-87, col_values=(('external_ids', {'iface-id': '34c66af1-878e-42c8-ab08-32e34e085f38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:a7:ea', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.463132 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.463791 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.471584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.471998 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.478508 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.478798 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:11.480852 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.482660 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87')
Jun 27 04:05:11.484012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:11.484511 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:11.485201 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:11.485505 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:11.486127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.486127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.486127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:11.487662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.487662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fea6920-68b8-557d-969b-6a82ba1dafb8', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.489016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.489016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.498912 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:05:11.509423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.522613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.522613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4c0ad82-96, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.522613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4c0ad82-96, col_values=(('qos', UUID('276631e2-d0d7-49c5-8fd1-863df66946b7')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.522613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4c0ad82-96, col_values=(('external_ids', {'iface-id': 'e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:62:3c', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.524536 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.526034 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.526987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.40.100,3260]
Jun 27 04:05:11.526987 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:11.526987 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:11.541331 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.560274 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:11.560771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:11.561041 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:11.562106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:11.562223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:11.568409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.570887 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96')
Jun 27 04:05:11.572249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:11.572249 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:11.573631 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:11.578746 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:11.578746 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.578746 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.578746 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:11.580073 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.581160 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1ccafbf-850d-59ff-b237-d0a4f03e299c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.583603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.583603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.596963 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:11.598256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:11.616586 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.627299 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.640831 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.669759 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.671294 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.671518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e4345c6-eb, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.671935 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e4345c6-eb, col_values=(('qos', UUID('36de346b-f3a4-4063-9f99-3f277be4f622')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.672088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e4345c6-eb, col_values=(('external_ids', {'iface-id': '8e4345c6-eb4c-4b2e-8017-7bd5340110a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:58:e6', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.673254 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.683823 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.735745 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:11.749110 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.750585 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb')
Jun 27 04:05:11.751547 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:11.751784 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:11.753007 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:11.753366 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:11.753890 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.755582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.755582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:11.755973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.756208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ffc18e9-6e74-5808-bf8d-86b84c60a8cd', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.757631 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.758487 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.780134 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'flavor' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:11.806930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9bcc4e7-ee90-40c4-a9d6-cc68d803f8fc req-3efdcd32-8b78-4866-aa02-9fac00c0758f service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-unplugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:11.807158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9bcc4e7-ee90-40c4-a9d6-cc68d803f8fc req-3efdcd32-8b78-4866-aa02-9fac00c0758f service nova] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:11.808712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9bcc4e7-ee90-40c4-a9d6-cc68d803f8fc req-3efdcd32-8b78-4866-aa02-9fac00c0758f service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:11.808712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9bcc4e7-ee90-40c4-a9d6-cc68d803f8fc req-3efdcd32-8b78-4866-aa02-9fac00c0758f service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:11.808941 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9bcc4e7-ee90-40c4-a9d6-cc68d803f8fc req-3efdcd32-8b78-4866-aa02-9fac00c0758f service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] No waiting events found dispatching network-vif-unplugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:11.809077 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9bcc4e7-ee90-40c4-a9d6-cc68d803f8fc req-3efdcd32-8b78-4866-aa02-9fac00c0758f service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-unplugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:11.826637 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.836698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.837138 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a748cfd-00, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.837594 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a748cfd-00, col_values=(('qos', UUID('c333f1f6-1616-4d2f-ad8c-ac212b78addd')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.837950 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a748cfd-00, col_values=(('external_ids', {'iface-id': '2a748cfd-0098-4b02-ae17-e5818b112843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:c1:84', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.839347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.840687 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.877445 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998982248000175 future=<Future at 0x7ec51871c9e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:11.877445 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99785091900003 future=<Future at 0x7ec51871c9e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:11.877445 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99762739200014 future=<Future at 0x7ec51871c9e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:11.882012 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Instance destroyed successfully.
Jun 27 04:05:11.882912 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lazy-loading 'resources' on Instance uuid 449cab84-f0b9-40e0-bcb3-595b102c1303 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:11.922859 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Creating config drive at /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config
Jun 27 04:05:11.926414 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.929886 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00')
Jun 27 04:05:11.931611 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:11.934528 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:11.936596 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:11.937068 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:11.937220 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.937515 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.937789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:11.941263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp10kei85x {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:11.942602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.942602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77da4233-8512-521e-9cd1-a11e0581dc6c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.955902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.958521 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:11.991377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.998375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:11.998758 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap752f568e-44, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.999455 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap752f568e-44, col_values=(('qos', UUID('67ca67fc-e81a-4025-a9cb-bc106613e75a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:11.999695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap752f568e-44, col_values=(('external_ids', {'iface-id': '752f568e-442f-482f-bee6-23258b2a5023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:7e:69', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.001340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.004844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp10kei85x" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:12.005874 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:12.050739 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.052997 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44')
Jun 27 04:05:12.055211 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:12.055211 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:12.056737 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:12.057879 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:12.058268 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.058621 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.058862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:12.060670 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.060862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '098078bb-b592-5f15-8472-be69135d6a02', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.062085 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.063167 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:12.112098 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.114828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.115112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1e92a3f-1a, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.115561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1e92a3f-1a, col_values=(('qos', UUID('957432c9-77fa-4818-8da5-c5bd69cf7bc3')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.115985 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1e92a3f-1a, col_values=(('external_ids', {'iface-id': 'a1e92a3f-1a46-4ae7-ae73-158e544bfb94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:6c:7a', 'vm-uuid': '0bdb15c0-e951-4850-963b-2439b99b93f7'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.117226 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.119169 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:12.177401 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.180437 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a')
Jun 27 04:05:12.194988 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:12.387250 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1187085653',display_name='tempest-DeleteServersTestJSON-server-1187085653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-deleteserverstestjson-server-1187085653',id=9,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:54Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3262b8f5fb44457b7ccb37d681055bc',ramdisk_id='',reservation_id='r-o77g1nil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-878476380',owner_user_name='tempest-DeleteServersTestJSON-878476380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:54Z,user_data=None,user_id='9eb961442fd240f58e6e1b794a94b458',uuid=449cab84-f0b9-40e0-bcb3-595b102c1303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:12.388554 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Converting VIF {"id": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "address": "fa:16:3e:ab:ed:f1", "network": {"id": "60095012-f193-4f8d-9627-4010a4a6565d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1844540273-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d3262b8f5fb44457b7ccb37d681055bc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7812e2f-35", "ovs_interfaceid": "a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:12.388815 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:12.389665 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:12.392308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.392648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7812e2f-35, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.394239 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.395475 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:12.446878 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.448386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.448798 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4c13d45-df3a-4f8a-add3-5bfaea485bf9) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:12.449459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.450210 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:12.490144 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.492973 np0000003830 nova-compute[98984]: INFO os_vif [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ed:f1,bridge_name='br-int',has_traffic_filtering=True,id=a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e,network=Network(60095012-f193-4f8d-9627-4010a4a6565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7812e2f-35')
Jun 27 04:05:12.495156 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:05:12.495156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '694e1d83-a81f-41e7-a38c-edb12c3525a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:12.495357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:12.527730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.50.100,3260]
Jun 27 04:05:12.527730 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:12.527730 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:12.539737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:12.560258 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:12.561063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.173s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:12.561063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:12.561942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:12.562106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:12.585412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:12.585412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:12.599581 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.683793 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.785090 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.794577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:12.856101 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.912407 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:12.966796 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-967f2e75-089e-42d6-a5d2-6f0033dc6134 req-b3ba94d7-e8cf-45a2-a697-187a22960c42 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:12.967076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-967f2e75-089e-42d6-a5d2-6f0033dc6134 req-b3ba94d7-e8cf-45a2-a697-187a22960c42 service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:12.967244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-967f2e75-089e-42d6-a5d2-6f0033dc6134 req-b3ba94d7-e8cf-45a2-a697-187a22960c42 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:12.967731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-967f2e75-089e-42d6-a5d2-6f0033dc6134 req-b3ba94d7-e8cf-45a2-a697-187a22960c42 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:12.967731 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-967f2e75-089e-42d6-a5d2-6f0033dc6134 req-b3ba94d7-e8cf-45a2-a697-187a22960c42 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Processing event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:13.429091 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:13.725476 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:13.726277 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:13.727881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] No VIF found with MAC fa:16:3e:7d:30:7d, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:13.728565 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] No VIF found with MAC fa:16:3e:9e:c1:84, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:13.733187 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Using config drive
Jun 27 04:05:13.826517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:13.872649 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a7eec18a-3c1c-4f04-b63b-38700b8ff7ad req-5c2b57f0-0feb-4fa9-8dec-b856616eff49 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-unplugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:13.873863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a7eec18a-3c1c-4f04-b63b-38700b8ff7ad req-5c2b57f0-0feb-4fa9-8dec-b856616eff49 service nova] Acquiring lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:13.874097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a7eec18a-3c1c-4f04-b63b-38700b8ff7ad req-5c2b57f0-0feb-4fa9-8dec-b856616eff49 service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:13.874402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a7eec18a-3c1c-4f04-b63b-38700b8ff7ad req-5c2b57f0-0feb-4fa9-8dec-b856616eff49 service nova] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:13.874630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a7eec18a-3c1c-4f04-b63b-38700b8ff7ad req-5c2b57f0-0feb-4fa9-8dec-b856616eff49 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] No waiting events found dispatching network-vif-unplugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:13.874824 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a7eec18a-3c1c-4f04-b63b-38700b8ff7ad req-5c2b57f0-0feb-4fa9-8dec-b856616eff49 service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-unplugged-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:14.130362 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533114.1299675, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:14.130796 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:05:14.131002 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Started (Lifecycle Event)
Jun 27 04:05:14.133030 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:05:14.135137 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance spawned successfully.
Jun 27 04:05:14.135695 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:05:14.235437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:14.235762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:14.236024 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Attaching volume 11a7dd5e-c571-4ba3-bdd6-288607921117 to /dev/vdb
Jun 27 04:05:14.247126 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:14.313485 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:14.326968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:14.349950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:14.371826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:14.372078 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:14.380363 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:14.382234 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:fe18:bf67', 'fe80::2c7c:d5ff:fe82:a046', 'fe80::fc16:3eff:fe63:9e91'] 
Jun 27 04:05:14.382417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:14.386672 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:14.387035 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:14.387507 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updating existing volume attachment record: 8dc527ec-71a6-4a33-9c16-648c0abf1332 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Creating config drive at /opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7/disk.config
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798925 for multipath device dm-6 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.080s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== connect_volume: return (10404ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798925', 'path': '/dev/dm-6', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798925'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798925', 'path': '/dev/dm-6', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798925'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.953s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '694e1d83-a81f-41e7-a38c-edb12c3525a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:05:14.455170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2n8xigjh {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:14.484483 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3 (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:14.485014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:05:14.485519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', '7')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:14.490336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3', '8')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:14.493673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53813a0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:05:14.493673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:05:14.493673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Flush multipath device 33000000056036313 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:05:14.500270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2n8xigjh" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:14.532215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:14.587102 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:14.634985 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:14.638432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:05:14.638656 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:05:14.648459 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:05:14.650231 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:14.656525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:14.656525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:14.656525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:14.656525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:14.656525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:14.656525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:14.661978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:05:14.666524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:05:14.678873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:14.703823 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:14.704063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:14.704328 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Attaching volume e2e1e72b-d60e-4e24-a1a2-31c00d7217bd to /dev/vdb
Jun 27 04:05:14.722019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.40.100,3260]
Jun 27 04:05:14.722019 np0000003830 nova-compute[98984]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:14.722019 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:14.753252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:14.768053 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:14.788688 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:14.807157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:14.807707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:14.817377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:14.824593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.50.100,3260]
Jun 27 04:05:14.824593 np0000003830 nova-compute[98984]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-694e1d83-a81f-41e7-a38c-edb12c3525a3, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:14.824593 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:14.846002 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:14.860002 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:14.861756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:14.861756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] <== disconnect_volume: return (2365ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:14.861756 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:05:14.871914 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Deleting instance files /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303_del
Jun 27 04:05:14.871914 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Deletion of /opt/stack/data/nova/instances/449cab84-f0b9-40e0-bcb3-595b102c1303_del complete
Jun 27 04:05:14.885709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:14.885987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:14.896367 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:14.898573 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:fe18:bf67', 'fe80::2c7c:d5ff:fe82:a046', 'fe80::fc16:3eff:fe63:9e91'] 
Jun 27 04:05:14.899286 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:14.899448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:14.899782 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:14.900074 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating existing volume attachment record: 20641a11-4a56-4114-8f30-ec14f5d3d139 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:14.957347 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1870437479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1870437479',id=10,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-l6wcgi2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:58Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=58490b25-bc9d-4a48-aff3-3eb967088bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:14.957574 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:14.958386 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:14.960882 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'pci_devices' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:14.971046 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:14.971046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:14.972611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:14.972611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:14.972611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:14.992456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:14.992456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:14.994129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:14.994439 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:14.995094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:14.995352 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:15.010686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:15.010686 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:15.020016 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:15.020016 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117] added
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:15.031421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:15.031847 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:15.031847 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117] added
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:15.036414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:15.036860 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:15.036860 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:15.061974 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7dd802f4-c8eb-45ee-bb0d-ff662ea687cb req-7b103cc9-0d8d-44ba-8107-6b94474cb944 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:15.062478 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7dd802f4-c8eb-45ee-bb0d-ff662ea687cb req-7b103cc9-0d8d-44ba-8107-6b94474cb944 service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:15.062698 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7dd802f4-c8eb-45ee-bb0d-ff662ea687cb req-7b103cc9-0d8d-44ba-8107-6b94474cb944 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:15.063690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7dd802f4-c8eb-45ee-bb0d-ff662ea687cb req-7b103cc9-0d8d-44ba-8107-6b94474cb944 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:15.064467 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7dd802f4-c8eb-45ee-bb0d-ff662ea687cb req-7b103cc9-0d8d-44ba-8107-6b94474cb944 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:15.064752 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-7dd802f4-c8eb-45ee-bb0d-ff662ea687cb req-7b103cc9-0d8d-44ba-8107-6b94474cb944 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received unexpected event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with vm_state building and task_state spawning.
Jun 27 04:05:15.082344 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.139264 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.155115 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:05:15.155115 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533115.154748, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:15.155960 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Paused (Lifecycle Event)
Jun 27 04:05:15.166171 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Took 8.28 seconds to spawn the instance on the hypervisor.
Jun 27 04:05:15.169040 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:15.209434 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.314277 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lazy-loading 'flavor' on Instance uuid a06a5350-861e-43b7-b679-118dd50490f2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:15.342430 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.375783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.384790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.396825 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Took 3.90 seconds to destroy the instance on the hypervisor.
Jun 27 04:05:15.401116 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:05:15.402076 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:05:15.402076 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:05:15.402076 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:15.425424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.430845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <uuid>58490b25-bc9d-4a48-aff3-3eb967088bc8</uuid>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <name>instance-0000000a</name>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1870437479</nova:name>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:05:04</nova:creationTime>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:user uuid="6c2bd621defb420db9fd8345c5b36248">tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member</nova:user>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:project uuid="771234de69074fed81ffef19dcee2804">tempest-ServerBootFromVolumeStableRescueTest-2029132639</nova:project>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         <nova:port uuid="b4a8af07-d05c-4f98-98c1-0f087b0fcd54">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <entry name="serial">58490b25-bc9d-4a48-aff3-3eb967088bc8</entry>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <entry name="uuid">58490b25-bc9d-4a48-aff3-3eb967088bc8</entry>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <alias name="ua-42cf866d-9c6d-4cb7-a814-58d9c1f02365"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-6"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <serial>42cf866d-9c6d-4cb7-a814-58d9c1f02365</serial>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:2c:5b:14"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <target dev="tapb4a8af07-d0"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/console.log" append="off"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Preparing to wait for external event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:04:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1870437479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1870437479',id=10,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-l6wcgi2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:04:58Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=58490b25-bc9d-4a48-aff3-3eb967088bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:15.471847 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:15.476601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.476601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:15.476601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:15.479237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.479237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a8ef21-461d-592b-b6cf-e8bee9684e8f', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:15.479237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.479237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:15.504875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.510781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.510781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4a8af07-d0, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:15.510781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4a8af07-d0, col_values=(('qos', UUID('67f8667e-d2ed-48fe-998c-1c344701412a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:15.510781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4a8af07-d0, col_values=(('external_ids', {'iface-id': 'b4a8af07-d05c-4f98-98c1-0f087b0fcd54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:5b:14', 'vm-uuid': '58490b25-bc9d-4a48-aff3-3eb967088bc8'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:15.517335 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.517335 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:15.535185 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:15.543153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:15.543153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:15.543153 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:15.549257 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.562550 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.596243 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.596243 np0000003830 nova-compute[98984]: INFO os_vif [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0')
Jun 27 04:05:15.596243 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.628952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.658437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-920a6f05-d6ca-4369-bfcf-cb863e38eb84 req-a1181227-4a8c-43af-b8c6-dc0ed4ed4026 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:15.664484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-920a6f05-d6ca-4369-bfcf-cb863e38eb84 req-a1181227-4a8c-43af-b8c6-dc0ed4ed4026 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:15.664484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-920a6f05-d6ca-4369-bfcf-cb863e38eb84 req-a1181227-4a8c-43af-b8c6-dc0ed4ed4026 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:15.664484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-920a6f05-d6ca-4369-bfcf-cb863e38eb84 req-a1181227-4a8c-43af-b8c6-dc0ed4ed4026 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:15.664484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-920a6f05-d6ca-4369-bfcf-cb863e38eb84 req-a1181227-4a8c-43af-b8c6-dc0ed4ed4026 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:15.664484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:15.668104 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533115.6659424, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:15.668104 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Resumed (Lifecycle Event)
Jun 27 04:05:15.681038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.698409 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Took 14.07 seconds to build instance.
Jun 27 04:05:15.765985 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.768320 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.853186 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.861724 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.921606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:15.966330 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.011693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:16.013202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:16.013202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:16.013202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:16.013202 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:16.013202 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:16.013407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:16.013533 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:16.013706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:16.013873 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No event matching network-vif-plugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 in dict_keys([('network-vif-plugged', 'e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95'), ('network-vif-plugged', '8e4345c6-eb4c-4b2e-8017-7bd5340110a6'), ('network-vif-plugged', '2a748cfd-0098-4b02-ae17-e5818b112843'), ('network-vif-plugged', '752f568e-442f-482f-bee6-23258b2a5023'), ('network-vif-plugged', 'a1e92a3f-1a46-4ae7-ae73-158e544bfb94')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:05:16.014062 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 for instance with vm_state building and task_state spawning.
Jun 27 04:05:16.016040 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:16.016040 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:16.016040 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:16.016207 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:16.016372 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39eac326-192a-4ffb-92ab-1ad269467263 req-4191aee9-4bfd-48c3-a805-af9ad709ddcf service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:16.032158 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:16.037901 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:16.057896 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:16.065285 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.076661 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.077733 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.085959 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.100930 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.101399 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.115427 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.115979 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:16.159304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.40.100,3260]
Jun 27 04:05:16.159304 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:16.159304 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.172003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:16.172003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.50.100,3260]
Jun 27 04:05:16.172003 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:16.172003 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.176065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.187341 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:16.194080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:16.196433 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.586s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.208053 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.208568 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:16.208837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:16.208837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:16.211270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] HCTL ('11', '-', '-', 0) found on session 13 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:16.211270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.220067 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:16.220458 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:16.221139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:16.221139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:16.224075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] HCTL ('12', '-', '-', 0) found on session 14 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:16.224288 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:16.254334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Searching for a device in session 13 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:16.254334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:16.272142 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Searching for a device in session 14 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:16.272142 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:16.328226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:16.360548 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.375596 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.379709 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.405387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.410724 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.755158 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.772994 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.852887 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:16.960327 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.965953 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:16.996105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:17.143024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:17.143292 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:17.143405 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No VIF found with MAC fa:16:3e:2c:5b:14, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:17.143899 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Using config drive
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No event matching network-vif-plugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 in dict_keys([('network-vif-plugged', '2a748cfd-0098-4b02-ae17-e5818b112843'), ('network-vif-plugged', '752f568e-442f-482f-bee6-23258b2a5023'), ('network-vif-plugged', 'a1e92a3f-1a46-4ae7-ae73-158e544bfb94')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 for instance with vm_state building and task_state spawning.
Jun 27 04:05:17.160817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:17.161774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:17.161774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:17.161959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:17.163363 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:17.163917 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:17.164129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:17.164361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:17.164651 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:17.164721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No event matching network-vif-plugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 in dict_keys([('network-vif-plugged', '2a748cfd-0098-4b02-ae17-e5818b112843'), ('network-vif-plugged', '752f568e-442f-482f-bee6-23258b2a5023')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:05:17.164870 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-adf65b90-eed6-4b7e-b396-311640dffc17 req-4f9bf9da-7aa8-42e2-9eb5-d4483b35c8ec service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 for instance with vm_state building and task_state spawning.
Jun 27 04:05:17.165662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.170995 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.357734 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Took 1.96 seconds to deallocate network for instance.
Jun 27 04:05:17.500081 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:17.500342 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:17.500736 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Attaching volume dc3c0b69-28f0-4050-9fe7-62e7fab41f0e to /dev/sdc
Jun 27 04:05:17.516489 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533117.5159202, 0bdb15c0-e951-4850-963b-2439b99b93f7 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:17.516489 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] VM Started (Lifecycle Event)
Jun 27 04:05:17.572253 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:17.578670 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.585801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:17.591649 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.594166 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.619831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:17.637752 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.658519 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:17.661473 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:17.661773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:17.673333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:17.675171 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:fe18:bf67', 'fe80::2c7c:d5ff:fe82:a046', 'fe80::fc16:3eff:fe63:9e91', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329'] 
Jun 27 04:05:17.675310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:17.675412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:17.675828 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:17.676279 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Updating existing volume attachment record: f3bdb393-32e8-4364-a097-fa26b0606a31 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:17.794730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:17.794730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:17.794730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:17.794730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:17.794730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No event matching network-vif-plugged-34c66af1-878e-42c8-ab08-32e34e085f38 in dict_keys([('network-vif-plugged', '2a748cfd-0098-4b02-ae17-e5818b112843'), ('network-vif-plugged', '752f568e-442f-482f-bee6-23258b2a5023')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:05:17.796810 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-34c66af1-878e-42c8-ab08-32e34e085f38 for instance with vm_state building and task_state spawning.
Jun 27 04:05:17.797539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-acb3e37d-428e-4ec0-8f9c-00be88cd1c07 req-2a0b8e87-9678-4fa5-8253-57a1b97d7cbd service nova] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Received event network-vif-deleted-a7812e2f-35b8-4b2a-83cf-9cdf7a197d6e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:17.860904 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Creating config drive at /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config
Jun 27 04:05:17.870064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxh8alh6j {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:17.906119 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.913570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:17.921613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxh8alh6j" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:17.975370 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Took 0.62 seconds to detach 1 volumes for instance.
Jun 27 04:05:18.013966 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Found WWN 3300000006ec712a9 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:18.013966 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:18.013966 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000006ec712a9', 'path': '/dev/dm-4', 'multipath_id': '3300000006ec712a9'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:18.013966 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006ec712a9', 'path': '/dev/dm-4', 'multipath_id': '3300000006ec712a9'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:18.014480 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.479s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:18.014731 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:18.017227 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lazy-loading 'flavor' on Instance uuid a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:18.020638 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:18.023747 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533118.023324, 0bdb15c0-e951-4850-963b-2439b99b93f7 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:18.023955 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] VM Paused (Lifecycle Event)
Jun 27 04:05:18.031103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:18.032241 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:18.032632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:18.032934 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:18.033331 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:18.033571 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:18.050916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:18.050916 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:18.056889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:18.056889 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd] added
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:18.065057 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:18.065547 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:18.066057 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:18.066520 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd] added
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:18.073445 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:18.074164 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:18.074164 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:18.074164 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:18.122268 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:18.122728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:18.122900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:18.123065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:18.123312 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No event matching network-vif-plugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 in dict_keys([('network-vif-plugged', '2a748cfd-0098-4b02-ae17-e5818b112843'), ('network-vif-plugged', '752f568e-442f-482f-bee6-23258b2a5023')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:05:18.123471 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 for instance with vm_state building and task_state spawning.
Jun 27 04:05:18.123637 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:18.123754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:18.123867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:18.124002 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:18.124130 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:18.124322 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:18.124514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:18.124654 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:18.124758 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:18.124905 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No event matching network-vif-plugged-2a748cfd-0098-4b02-ae17-e5818b112843 in dict_keys([('network-vif-plugged', '752f568e-442f-482f-bee6-23258b2a5023')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:05:18.126317 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-2a748cfd-0098-4b02-ae17-e5818b112843 for instance with vm_state building and task_state spawning.
Jun 27 04:05:18.126642 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:18.126752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:18.126961 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:18.127001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:18.127250 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Processing event network-vif-plugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:18.127313 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-plugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:18.127550 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:18.127999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:18.128244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:18.128426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-plugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:18.128664 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ff3e78b2-d8ce-44c6-801c-30b1da7aab89 req-5116e4a6-80a1-49a2-b3b0-b13bb8f78270 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received unexpected event network-vif-plugged-752f568e-442f-482f-bee6-23258b2a5023 for instance with vm_state building and task_state spawning.
Jun 27 04:05:18.129883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:05:18.136365 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:05:18.139553 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance spawned successfully.
Jun 27 04:05:18.140111 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:05:18.273143 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:18.273143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:18.273143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:18.457662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:18.468636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:18.488815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:18.488815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:18.495510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:18.522696 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Attempting to attach volume 11a7dd5e-c571-4ba3-bdd6-288607921117 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] attach device xml: <disk type="block" device="disk">
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]:   <alias name="ua-11a7dd5e-c571-4ba3-bdd6-288607921117"/>
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]:   <serial>11a7dd5e-c571-4ba3-bdd6-288607921117</serial>
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:18.527002 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:18.541761 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:18.550722 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533118.550313, 0bdb15c0-e951-4850-963b-2439b99b93f7 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:18.550884 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] VM Resumed (Lifecycle Event)
Jun 27 04:05:18.606928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:18.659268 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:18.659425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:18.659848 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:18.660137 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:18.660524 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:18.660815 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:18.680564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:18.681814 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:18.834560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:19.053531 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:19.056829 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:19.067019 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:19.074547 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:19.083397 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:19.093227 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.098901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.107570 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.124021 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.132460 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.133216 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:19.172590 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Took 33.31 seconds to spawn the instance on the hypervisor.
Jun 27 04:05:19.172590 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:19.184743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.40.100,3260]
Jun 27 04:05:19.184743 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:19.184743 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.195825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.50.100,3260]
Jun 27 04:05:19.195825 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:19.195825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.202040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.211333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.229166 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:19.229970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:19.229970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:19.230873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:19.231182 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.239676 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:19.244839 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:19.245651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:19.245651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:19.247315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:19.254183 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:19.256302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:19.281919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:19.282174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:19.324782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:19.325596 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:19.560383 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:05:19.681701 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Took 46.94 seconds to build instance.
Jun 27 04:05:19.786316 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533119.7858846, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:19.786533 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Started (Lifecycle Event)
Jun 27 04:05:19.828931 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:20.183955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c4721a7-e562-4c3f-b1f3-6910f51e2a3f tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.458s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:20.205705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-changed-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:20.207911 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Refreshing instance network info cache due to event network-changed-cae96b34-24ed-4e2c-bbb8-8659432395f6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:20.207911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Acquiring lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:20.207911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Acquired lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:20.207911 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Refreshing network info cache for port cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:20.257020 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:20.257243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:20.292070 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:20.294002 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533120.2937226, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:20.294229 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Paused (Lifecycle Event)
Jun 27 04:05:20.295883 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:20.296796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:20.296938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:20.297176 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] No VIF found with MAC fa:16:3e:54:6b:1f, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:20.338545 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.850s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:20.410466 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Deleted allocations for instance 449cab84-f0b9-40e0-bcb3-595b102c1303
Jun 27 04:05:20.512618 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:20.649732 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-changed-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:20.649732 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing instance network info cache due to event network-changed-b889b1b6-e646-47d0-a58a-deb2c27cb567. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:20.649732 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] Acquiring lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:20.649732 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] Acquired lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:20.649732 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Refreshing network info cache for port b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:20.709056 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:20.797668 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:20.799333 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:21.053076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Found WWN 33000000077207378 for multipath device dm-7 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:21.053241 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:21.053413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] <== connect_volume: return (5517ms) {'type': 'block', 'scsi_wwn': '33000000077207378', 'path': '/dev/dm-7', 'multipath_id': '33000000077207378'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:21.053946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000077207378', 'path': '/dev/dm-7', 'multipath_id': '33000000077207378'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:21.054336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.781s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:21.054752 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:21.056389 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'flavor' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:21.066294 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:21.066764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:21.066988 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:21.067691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:21.068264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:21.068645 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:21.079545 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:21.079545 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:21.088991 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:21.088991 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e] added
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:21.093917 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:21.094162 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:21.094263 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:21.094444 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:21.100705 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e] added
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:21.105259 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:21.105775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:21.105992 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:21.106190 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:21.156982 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:21.302186 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:05:21.311158 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updated VIF entry in instance network info cache for port cae96b34-24ed-4e2c-bbb8-8659432395f6. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:05:21.313048 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updating instance_info_cache with network_info: [{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:21.421239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-214a866e-4ce7-4744-81ff-684076cb2bf2 tempest-DeleteServersTestJSON-878476380 tempest-DeleteServersTestJSON-878476380-project-member] Lock "449cab84-f0b9-40e0-bcb3-595b102c1303" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.440s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:21.559828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Attempting to attach volume e2e1e72b-d60e-4e24-a1a2-31c00d7217bd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]:   <alias name="ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd"/>
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-7"/>
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]:   <serial>e2e1e72b-d60e-4e24-a1a2-31c00d7217bd</serial>
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:21.561164 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:21.608371 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:21.763877 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updated VIF entry in instance network info cache for port b889b1b6-e646-47d0-a58a-deb2c27cb567. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:05:21.764489 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [{"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:21.817525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Releasing lock "refresh_cache-9f560b0d-dc54-4d68-a06b-71401abd49eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:21.817525 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:21.817525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:21.817525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:21.817525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:21.817525 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Processing event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:21.817817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:21.817849 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:21.818000 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:21.818147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:21.818295 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:21.818448 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2bd0096c-7c72-4011-ada1-a8c8dc7d7ffc req-ff84e6c7-0e16-42b6-886e-45bfe5bdd168 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state building and task_state spawning.
Jun 27 04:05:21.818849 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:05:21.821411 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533121.8210812, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:21.821599 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Resumed (Lifecycle Event)
Jun 27 04:05:21.823920 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:05:21.826517 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance spawned successfully.
Jun 27 04:05:21.826933 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:05:21.884583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91ffbe36-ba32-4615-b025-fa0365df0725 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.649s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:22.059934 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] volume_snapshot_create: create_info: {'snapshot_id': 'f911ece6-0995-4477-b3ec-d81f51a3fd15', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98984) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3759}}
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] snap xml: <domainsnapshot>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:   <disks>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:     <disk name="/dev/dm-4" snapshot="external" type="file">
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:       <source file="/dev/new_file"/>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:     <disk name="vda" snapshot="no"/>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:     <disk name="hda" snapshot="no"/>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:   </disks>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]: </domainsnapshot>
Jun 27 04:05:22.062221 np0000003830 nova-compute[98984]:  {{(pid=98984) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3700}}
Jun 27 04:05:22.062635 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] Lazy-loading 'system_metadata' on Instance uuid a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:22.094883 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:22.106665 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:22.111665 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:22.122657 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.128235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-115702b7-fed4-4a5c-8291-1a2550237008 tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] volume_snapshot_delete: delete_info: {'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117'} {{(pid=98984) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3867}}
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [None req-115702b7-fed4-4a5c-8291-1a2550237008 tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Traceback (most recent call last):
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     self._volume_snapshot_delete(context, instance, volume_id,
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     if delete_info['type'] != 'qcow2':
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]        ~~~~~~~~~~~^^^^^^^^
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] KeyError: 'type'
Jun 27 04:05:22.133657 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] 
Jun 27 04:05:22.137332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.138980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.158809 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.159156 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.172506 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [None req-115702b7-fed4-4a5c-8291-1a2550237008 tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-2675604f-4de9-4d86-81df-bfca5cc58e7a)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Jun 27 04:05:22.188297 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server [None req-115702b7-fed4-4a5c-8291-1a2550237008 tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] Exception during message handling: KeyError: 'type'
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4043, in volume_snapshot_delete
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Jun 27 04:05:22.205160 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server 
Jun 27 04:05:22.223384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.50.100,3260]
Jun 27 04:05:22.223384 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:22.223384 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.237351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.40.100,3260]
Jun 27 04:05:22.237351 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:22.237351 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.246583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.253755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:22.267034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe225a8e-faa8-4842-877a-656dd5d11db0 req-c4ca81e7-d0dd-437f-8dc3-e2766aafe537 service nova] Releasing lock "refresh_cache-0bdb15c0-e951-4850-963b-2439b99b93f7" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.269060 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:22.269556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:22.270011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:22.271870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] HCTL ('19', '-', '-', 0) found on session 17 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:22.272145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:22.284139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:22.285750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] HCTL ('20', '-', '-', 0) found on session 18 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:22.285850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:22.296071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Searching for a device in session 17 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:22.296071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:22.306010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:22.326182 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:22.328705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:22.338079 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:22.338243 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:22.338739 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:22.339022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:22.339300 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:22.340266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:22.566640 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Traceback (most recent call last):
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.574219 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] 
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Traceback (most recent call last):
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     self._volume_snapshot_create(context, instance, guest,
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.577050 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] 
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f911ece6-0995-4477-b3ec-d81f51a3fd15 could not be found.
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f911ece6-0995-4477-b3ec-d81f51a3fd15 could not be found. (HTTP 404) (Request-ID: req-ffd9089b-1e20-4838-9754-56d85cfc3816)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f911ece6-0995-4477-b3ec-d81f51a3fd15 could not be found.
Jun 27 04:05:22.600063 np0000003830 nova-compute[98984]: ERROR nova.virt.libvirt.driver 
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server [None req-825cf473-f933-43d7-ae35-8fa842eb0afd tempest-VolumesAssistedSnapshotsTest-822817227 tempest-VolumesAssistedSnapshotsTest-822817227-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3780, in volume_snapshot_create
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     raise self.value
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Jun 27 04:05:22.604017 np0000003830 nova-compute[98984]: ERROR oslo_messaging.rpc.server 
Jun 27 04:05:22.832696 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:05:22.846510 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Took 18.83 seconds to spawn the instance on the hypervisor.
Jun 27 04:05:22.846715 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:22.976082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:22.976349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:23.241765 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:23.241826 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:23.242011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] No VIF found with MAC fa:16:3e:ae:33:c8, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:23.278082 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-changed-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:23.278346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Refreshing instance network info cache due to event network-changed-b7ad965d-b785-4081-aede-59ad6a86188b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:23.278382 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] Acquiring lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:23.278717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] Acquired lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:23.278717 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Refreshing network info cache for port b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:23.441703 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Took 30.11 seconds to build instance.
Jun 27 04:05:23.444101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Searching for a device in session 18 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:23.444258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:23.482602 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Detaching volume 11a7dd5e-c571-4ba3-bdd6-288607921117
Jun 27 04:05:23.530602 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Attempting to driver detach volume 11a7dd5e-c571-4ba3-bdd6-288607921117 from mountpoint /dev/vdb
Jun 27 04:05:23.537632 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Found disk vdb by alias ua-11a7dd5e-c571-4ba3-bdd6-288607921117 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:23.539174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Found disk vdb by alias ua-11a7dd5e-c571-4ba3-bdd6-288607921117 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:23.539359 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Attempting to detach device vdb from instance a25fed18-f473-42b6-b7dd-e29c3712bc39 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:   <alias name="ua-11a7dd5e-c571-4ba3-bdd6-288607921117"/>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:   <serial>11a7dd5e-c571-4ba3-bdd6-288607921117</serial>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:23.539899 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:23.551710 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Successfully detached device vdb from instance a25fed18-f473-42b6-b7dd-e29c3712bc39 from the persistent domain config.
Jun 27 04:05:23.552038 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] (1/8): Attempting to detach device vdb with device alias ua-11a7dd5e-c571-4ba3-bdd6-288607921117 from instance a25fed18-f473-42b6-b7dd-e29c3712bc39 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:   <alias name="ua-11a7dd5e-c571-4ba3-bdd6-288607921117"/>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:   <serial>11a7dd5e-c571-4ba3-bdd6-288607921117</serial>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:23.552405 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:23.836022 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:23.940922 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:23.946525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.622s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:24.028945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:24.029229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:24.086358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Found WWN 330000000a3503839 for multipath device dm-8 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:24.088327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:24.088987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] <== connect_volume: return (5816ms) {'type': 'block', 'scsi_wwn': '330000000a3503839', 'path': '/dev/dm-8', 'multipath_id': '330000000a3503839'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:24.089345 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a3503839', 'path': '/dev/dm-8', 'multipath_id': '330000000a3503839'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:24.100387 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lazy-loading 'flavor' on Instance uuid a06a5350-861e-43b7-b679-118dd50490f2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:24.232605 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533124.2319713, a25fed18-f473-42b6-b7dd-e29c3712bc39 => ua-11a7dd5e-c571-4ba3-bdd6-288607921117> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:05:24.233371 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-11a7dd5e-c571-4ba3-bdd6-288607921117 for instance a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:05:24.236308 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Successfully detached device vdb from instance a25fed18-f473-42b6-b7dd-e29c3712bc39 from the live domain config.
Jun 27 04:05:24.238012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:05:24.238310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:24.238777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:24.240389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:24.240847 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '11a7dd5e-c571-4ba3-bdd6-288607921117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:05:24.241028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:24.276234 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117 (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:05:24.276888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', '13')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:24.277791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117', '14')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:24.278796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5381df740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:05:24.279075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:05:24.279321 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Flush multipath device 3300000006ec712a9 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:05:24.322755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:24.380772 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:24.397561 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:24.432831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:05:24.433168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:05:24.434630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:05:24.451024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:05:24.451465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:05:24.466976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:24.526433 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.40.100,3260]
Jun 27 04:05:24.526433 np0000003830 nova-compute[98984]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:24.526433 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:24.534355 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'flavor' on Instance uuid 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:24.539674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:24.561852 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:24.616776 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.50.100,3260]
Jun 27 04:05:24.616776 np0000003830 nova-compute[98984]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-11a7dd5e-c571-4ba3-bdd6-288607921117, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:24.616776 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:   <alias name="ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e"/>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-8"/>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:   <target dev="sdc" bus="scsi"/>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:   <serial>dc3c0b69-28f0-4050-9fe7-62e7fab41f0e</serial>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:   <address type="drive" controller="0" unit="2"/>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:24.618282 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:24.657023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:24.657273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:24.657448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] <== disconnect_volume: return (418ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:24.657636 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:05:24.731112 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updated VIF entry in instance network info cache for port b7ad965d-b785-4081-aede-59ad6a86188b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:05:24.731112 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updating instance_info_cache with network_info: [{"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:24.848289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-32175ce6-658d-4177-a8de-cda5e92d6287 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.144s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:25.239051 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aece7953-f622-43f1-aa4c-e671af172571 req-dab98ad1-9119-48b4-b883-bc6ddbd86bea service nova] Releasing lock "refresh_cache-4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:25.278839 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lazy-loading 'flavor' on Instance uuid a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:25.355544 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-changed-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:25.357094 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Refreshing instance network info cache due to event network-changed-425ad7c7-90d4-4d00-b524-d76651842a89. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:25.357431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] Acquiring lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:25.357602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] Acquired lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:25.357740 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Refreshing network info cache for port 425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:25.512879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:25.542313 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:25.863148 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:26.237204 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Rescuing
Jun 27 04:05:26.237204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:26.237204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:26.237696 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:26.286271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6bd5a509-4b74-42f7-8306-2039b0589875 tempest-VolumesAssistedSnapshotsTest-796991292 tempest-VolumesAssistedSnapshotsTest-796991292-project-admin] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.310s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:26.310541 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:26.385394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No BDM found with device name sda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:26.385394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:26.385394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:26.385748 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] No VIF found with MAC fa:16:3e:be:87:c0, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:26.389543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:26.491831 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updated VIF entry in instance network info cache for port 425ad7c7-90d4-4d00-b524-d76651842a89. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:05:26.492192 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updating instance_info_cache with network_info: [{"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:26.752670 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:26.874689 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004900760000055016 future=<Future at 0x7ec51871c9e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:26.875118 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782533111.8740203, 449cab84-f0b9-40e0-bcb3-595b102c1303 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:26.875328 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:26.875489 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] VM Stopped (Lifecycle Event)
Jun 27 04:05:26.994254 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2f40346-d73c-4f17-a734-d1c8bdf223d4 req-eab99d36-62bc-4e40-84e9-44cab9ae98af service nova] Releasing lock "refresh_cache-a7ff3732-e89b-4c07-b215-daac79472845" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:27.377964 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] [instance: 449cab84-f0b9-40e0-bcb3-595b102c1303] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:27.482984 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:27.523272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:27.523623 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:27.524026 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Attaching volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69 to /dev/vdb
Jun 27 04:05:27.603669 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:27.617789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:27.642942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:27.675099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:27.675729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:27.689630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:27.691572 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:febe:87c0', 'fe80::98b7:65ff:fe7a:4546', 'fe80::fc16:3eff:fe54:6b1f', 'fe80::e061:abff:fe4b:e75f', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:fe18:bf67', 'fe80::2c7c:d5ff:fe82:a046', 'fe80::fc16:3eff:fe63:9e91', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329', 'fe80::fc16:3eff:fe2c:5b14'] 
Jun 27 04:05:27.691819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:27.691819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:27.692059 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:27.692313 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updating existing volume attachment record: 97aabb98-c592-4aee-a51d-a051bd0097fb {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:27.701308 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Updating instance_info_cache with network_info: [{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:28.041271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:28.041750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:28.041750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:28.041857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:28.041975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:28.048260 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Terminating instance
Jun 27 04:05:28.062450 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9eb5971f-9071-4ec9-a64f-f0f50563036a tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.562s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:28.204663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:28.279237 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:28.279651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:28.279925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:28.280409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:28.280733 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:28.319398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:28.319398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:28.319398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:28.319398 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:28.319398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:28.319398 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:28.332181 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:28.332181 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:28.342159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:28.342159 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69] added
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:28.348538 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:28.348884 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:28.348998 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:28.349173 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69] added
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:28.355731 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:28.355963 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:28.356094 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:28.356279 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:28.411684 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:28.411900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:28.553447 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:05:28.578205 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:28.590249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:28.621514 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:28.625506 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:28.653291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:28.832122 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:28.832347 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:28.837896 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:28.898615 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999628794000046 future=<Future at 0x7ec518738740 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:28.899917 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998810436999975 future=<Future at 0x7ec518738740 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:28.899917 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998295610000014 future=<Future at 0x7ec518738740 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:28.902823 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Instance destroyed successfully.
Jun 27 04:05:28.903658 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lazy-loading 'resources' on Instance uuid a25fed18-f473-42b6-b7dd-e29c3712bc39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:28.914409 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Detaching volume e2e1e72b-d60e-4e24-a1a2-31c00d7217bd
Jun 27 04:05:28.956032 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17f42bfd-c230-43f3-a632-690b32044cef req-ca39f596-bdae-4945-aa18-49efe571d1bb service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-unplugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:28.956032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17f42bfd-c230-43f3-a632-690b32044cef req-ca39f596-bdae-4945-aa18-49efe571d1bb service nova] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:28.956032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17f42bfd-c230-43f3-a632-690b32044cef req-ca39f596-bdae-4945-aa18-49efe571d1bb service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:28.956032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17f42bfd-c230-43f3-a632-690b32044cef req-ca39f596-bdae-4945-aa18-49efe571d1bb service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:28.956032 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17f42bfd-c230-43f3-a632-690b32044cef req-ca39f596-bdae-4945-aa18-49efe571d1bb service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] No waiting events found dispatching network-vif-unplugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:28.956032 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17f42bfd-c230-43f3-a632-690b32044cef req-ca39f596-bdae-4945-aa18-49efe571d1bb service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-unplugged-1e7e29d6-5098-4410-8509-30f455510fb9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:28.986260 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Attempting to driver detach volume e2e1e72b-d60e-4e24-a1a2-31c00d7217bd from mountpoint /dev/vdb
Jun 27 04:05:28.986260 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Found disk vdb by alias ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:28.987095 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Found disk vdb by alias ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:28.987221 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Attempting to detach device vdb from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:   <alias name="ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd"/>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-7"/>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:   <serial>e2e1e72b-d60e-4e24-a1a2-31c00d7217bd</serial>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:28.987468 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:28.997600 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully detached device vdb from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the persistent domain config.
Jun 27 04:05:28.997856 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] (1/8): Attempting to detach device vdb with device alias ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:   <alias name="ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd"/>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-7"/>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:   <serial>e2e1e72b-d60e-4e24-a1a2-31c00d7217bd</serial>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:28.998093 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:29.189981 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.190603 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.190603 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.190926 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.191279 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.191572 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.191807 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.192026 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.192163 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:05:29.192470 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:05:29.335130 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Detaching volume dc3c0b69-28f0-4050-9fe7-62e7fab41f0e
Jun 27 04:05:29.349688 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:29.356799 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:29.365938 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:29.374031 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.385663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.391545 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.399539 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Attempting to driver detach volume dc3c0b69-28f0-4050-9fe7-62e7fab41f0e from mountpoint /dev/sdc
Jun 27 04:05:29.406627 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-197187615',display_name='tempest-VolumesAssistedSnapshotsTest-server-197187615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesassistedsnapshotstest-server-197187615',id=5,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMdSu0ashZkeOp+ayYVY0r9P8KDCVQGdhXaz5WSuOqytykAaXXcy2vMXz0nMKyXemZfvsds4W5RQKLgMpGiaKoivENux/wylnwWifWAdQR0vn9aHjd7waxObErQl/VnEg==',key_name='tempest-keypair-1397309913',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:31Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='046700119b2245e488737e7955caf69c',ramdisk_id='',reservation_id='r-bxdtxtxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2048792395',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2048792395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f781ed15934c4a6196eb78da918870d4',uuid=a25fed18-f473-42b6-b7dd-e29c3712bc39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:29.407299 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Converting VIF {"id": "1e7e29d6-5098-4410-8509-30f455510fb9", "address": "fa:16:3e:54:6b:1f", "network": {"id": "6faf4837-f776-42d7-90f0-20461735ca33", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2144801531-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "046700119b2245e488737e7955caf69c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7e29d6-50", "ovs_interfaceid": "1e7e29d6-5098-4410-8509-30f455510fb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:29.408430 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:29.408809 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.411308 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.411923 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:29.412715 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Found disk sdc by alias ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Found disk sdc by alias ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Attempting to detach device sdc from instance a06a5350-861e-43b7-b679-118dd50490f2 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:   <alias name="ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e"/>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-8"/>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:   <target dev="sdc" bus="scsi"/>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:   <serial>dc3c0b69-28f0-4050-9fe7-62e7fab41f0e</serial>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:29.416568 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:29.417645 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.418355 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e7e29d6-50, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.419599 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:29.421105 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.421394 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:29.423236 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.424785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.424785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cb27481-b1da-4427-8bdb-b443465ad581) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:29.425089 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.425795 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:29.428457 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.432283 np0000003830 nova-compute[98984]: INFO os_vif [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6b:1f,bridge_name='br-int',has_traffic_filtering=True,id=1e7e29d6-5098-4410-8509-30f455510fb9,network=Network(6faf4837-f776-42d7-90f0-20461735ca33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7e29d6-50')
Jun 27 04:05:29.432890 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Deleting instance files /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39_del
Jun 27 04:05:29.433805 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Deletion of /opt/stack/data/nova/instances/a25fed18-f473-42b6-b7dd-e29c3712bc39_del complete
Jun 27 04:05:29.442015 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Successfully detached device sdc from instance a06a5350-861e-43b7-b679-118dd50490f2 from the persistent domain config.
Jun 27 04:05:29.442015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] (1/8): Attempting to detach device sdc with device alias ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e from instance a06a5350-861e-43b7-b679-118dd50490f2 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:   <alias name="ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e"/>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-8"/>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:   <target dev="sdc" bus="scsi"/>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:   <serial>dc3c0b69-28f0-4050-9fe7-62e7fab41f0e</serial>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:29.442253 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:29.479464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.50.100,3260]
Jun 27 04:05:29.479464 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:29.479464 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.488297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.40.100,3260]
Jun 27 04:05:29.488297 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:29.488297 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.496773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.507391 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.518027 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.518553 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:29.519088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:29.519088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:29.520668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] HCTL ('11', '-', '-', 0) found on session 19 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:29.520864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.528784 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:29.529342 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:29.530149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:29.530985 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:29.543203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching for a device in session 19 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:29.543203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:29.543203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] HCTL ('12', '-', '-', 0) found on session 20 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:29.543203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:29.543203 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533129.5427108, c1d90648-3e76-41e4-9f71-9178785a8979 => ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:05:29.546227 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd for instance c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:05:29.553040 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully detached device vdb from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the live domain config.
Jun 27 04:05:29.554553 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:05:29.554869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:29.555589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:29.561072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching for a device in session 20 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:29.561072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:29.676959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533129.676188, a06a5350-861e-43b7-b679-118dd50490f2 => ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:05:29.686171 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e for instance a06a5350-861e-43b7-b679-118dd50490f2 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:05:29.690262 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Successfully detached device sdc from instance a06a5350-861e-43b7-b679-118dd50490f2 from the live domain config.
Jun 27 04:05:29.696790 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:29.697075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:29.697218 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:29.697404 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:05:29.699390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:05:29.699764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:29.702906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:29.851623 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.859406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.890319 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:29.950362 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Took 1.40 seconds to destroy the instance on the hypervisor.
Jun 27 04:05:29.951004 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:05:29.951263 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:05:29.951553 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:05:29.952040 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:30.025720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.034319 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.126213 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:30.135524 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.162135 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999418593999962 future=<Future at 0x7ec518447a70 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:30.170330 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance destroyed successfully.
Jun 27 04:05:30.171079 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'numa_topology' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:30.201900 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.206429 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.232819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.320213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:30.367841 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.375365 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.579391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.586456 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:30.675951 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Attempting a stable device rescue
Jun 27 04:05:30.770629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:30.808956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98984) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 27 04:05:30.814081 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:05:30.814273 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Creating image(s)
Jun 27 04:05:30.815031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:30.815365 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:30.815911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:30.816200 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'trusted_certs' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:30.866292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:30.866882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:30.976152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:30.980897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.019174 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d89e860-5aa7-4e72-ba5c-81c24d4ddfe4 req-a34664a7-fe7a-4fa6-b7aa-91a090509784 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-deleted-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:31.019515 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-1d89e860-5aa7-4e72-ba5c-81c24d4ddfe4 req-a34664a7-fe7a-4fa6-b7aa-91a090509784 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Neutron deleted interface 1e7e29d6-5098-4410-8509-30f455510fb9; detaching it from the instance and deleting it from the info cache
Jun 27 04:05:31.021768 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d89e860-5aa7-4e72-ba5c-81c24d4ddfe4 req-a34664a7-fe7a-4fa6-b7aa-91a090509784 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Detach interface failed, port_id=1e7e29d6-5098-4410-8509-30f455510fb9, reason: Instance a25fed18-f473-42b6-b7dd-e29c3712bc39 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:05:31.040107 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-unplugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:31.040734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Acquiring lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:31.040734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:31.040734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:31.041021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] No waiting events found dispatching network-vif-unplugged-1e7e29d6-5098-4410-8509-30f455510fb9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:31.041021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Received event network-vif-unplugged-1e7e29d6-5098-4410-8509-30f455510fb9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:31.041259 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:31.041348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:31.041590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:31.042197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:31.042378 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:31.042573 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:31.042764 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:31.042925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:31.043074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:31.043219 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:31.043374 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:31.043515 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:31.043688 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:31.043917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:31.044009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:31.044557 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:31.044557 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:31.044557 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ca9ed1a1-ce6d-43cf-bd0d-1f94e378c60a req-523452b6-6f4a-497b-b390-6f40a04265e4 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:31.076326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.079691 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.185092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.189796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:05:31.189934 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:05:31.190036 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:05:31.192115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.272637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.273735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.320999 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:31.323437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "a73c6023d0e180343e68b2f4d80d934b6d51c555" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:31.324273 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "a73c6023d0e180343e68b2f4d80d934b6d51c555" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:31.342316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Found WWN 3300000000a6b0dd1 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:31.342890 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.062s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:31.343762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.788s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:31.344335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] <== connect_volume: return (3063ms) {'type': 'block', 'scsi_wwn': '3300000000a6b0dd1', 'path': '/dev/dm-4', 'multipath_id': '3300000000a6b0dd1'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:31.344834 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:05:31.345135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:05:31.345397 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a6b0dd1', 'path': '/dev/dm-4', 'multipath_id': '3300000000a6b0dd1'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:31.352291 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'flavor' on Instance uuid 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:31.368267 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.377728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.399264 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:31.400610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:05:31.401231 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', '15')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:31.403156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd', '16')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:31.411661 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5381ddc60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'): ({'sdm'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:05:31.413224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Removing multipathed devices sdl, sdm {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:05:31.413224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Flush multipath device 33000000077207378 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:05:31.455374 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:31.471644 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:31.479534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.480591 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.518752 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:31.574991 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:05:31.574991 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:05:31.577212 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:05:31.579590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.589523 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:05:31.592211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:05:31.592596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:05:31.597337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.613087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:31.663190 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.40.100,3260]
Jun 27 04:05:31.663190 np0000003830 nova-compute[98984]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:31.663190 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:31.691823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:31.697956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.699144 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.714264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:31.761901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.50.100,3260]
Jun 27 04:05:31.761901 np0000003830 nova-compute[98984]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-e2e1e72b-d60e-4e24-a1a2-31c00d7217bd, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:31.761901 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:31.789835 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:31.790423 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:31.790629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] <== disconnect_volume: return (2235ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:31.791062 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:05:31.797778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.098s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:31.798345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:05:31.798858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:05:31.799451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.809610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:05:31.847584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '18')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:31.850434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e', '17')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:31.851379 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538294860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'): ({'sdn'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:05:31.852460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Removing multipathed devices sdo, sdn {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:05:31.852460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Flush multipath device 330000000a3503839 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:05:31.858531 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Attempting to attach volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:   <alias name="ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69"/>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:   <serial>8d1afea0-388e-4672-a14b-0f4e53d1ff69</serial>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:31.861985 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:31.889915 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:31.912048 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.912048 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:31.943899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:31.975252 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Took 2.02 seconds to deallocate network for instance.
Jun 27 04:05:31.987690 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:05:31.987877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:05:31.989979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:05:31.995564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:31.997520 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid 'a25fed18-f473-42b6-b7dd-e29c3712bc39' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a25fed18-f473-42b6-b7dd-e29c3712bc39' (instance-00000005)
Jun 27 04:05:31.999421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:32.016580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:05:32.018282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:05:32.033634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:32.079018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.40.100,3260]
Jun 27 04:05:32.079018 np0000003830 nova-compute[98984]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:32.079018 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:32.099175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:32.101561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:32.136238 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:32.151842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:32.189671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.50.100,3260]
Jun 27 04:05:32.189671 np0000003830 nova-compute[98984]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-dc3c0b69-28f0-4050-9fe7-62e7fab41f0e, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:32.189671 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:32.215958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:32.216955 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:32.217156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] <== disconnect_volume: return (2517ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:32.217443 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:05:32.225838 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:32.237815 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:05:32.240844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:32.290642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:32.290642 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50238MB free_disk=74.35599517822266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:05:32.291709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:32.291709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:32.419926 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'flavor' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:32.486650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:32.614333 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:32.618002 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:32.618406 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:32.712331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.part --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:32.712988 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] d0c7a5fb-91e7-42e2-89d1-f2712cedf7f3 was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:05:32.713861 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:05:32.714621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.part /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:32.814035 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.part /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.converted" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:32.827770 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:32.856329 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lazy-loading 'flavor' on Instance uuid a06a5350-861e-43b7-b679-118dd50490f2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:32.920868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555.converted --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:32.921448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "a73c6023d0e180343e68b2f4d80d934b6d51c555" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.597s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:32.921937 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:32.930822 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:32.932785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "a73c6023d0e180343e68b2f4d80d934b6d51c555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:32.933189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "a73c6023d0e180343e68b2f4d80d934b6d51c555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:32.933511 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:32.936288 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:32.936656 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:33.039104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555 --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:33.039871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555,backing_fmt=raw /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.rescue {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:33.094276 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a73c6023d0e180343e68b2f4d80d934b6d51c555,backing_fmt=raw /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.rescue" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:33.094938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "a73c6023d0e180343e68b2f4d80d934b6d51c555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:33.095259 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'migration_context' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:33.120919 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:33.121245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:33.121509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:33.121738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:33.122287 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:33.122436 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:33.122532 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:33.122719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:33.122847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:33.122957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:33.123074 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:33.123631 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:33.124020 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:33.124020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:33.124100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:33.124268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:33.124460 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:33.124568 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2c97d704-cce1-4e54-895b-7c278220d363 req-f1a0d0a5-02e3-4d7c-80c7-ecd8c185645e service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:33.411116 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6ce1c75a-8520-40b5-a060-9580f2f789ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.411649 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 99670311-67bb-4d60-b854-655dc01f2722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.411649 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c1d90648-3e76-41e4-9f71-9178785a8979 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.411800 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a06a5350-861e-43b7-b679-118dd50490f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.412911 np0000003830 nova-compute[98984]: WARNING nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a25fed18-f473-42b6-b7dd-e29c3712bc39 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Jun 27 04:05:33.413544 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a7ff3732-e89b-4c07-b215-daac79472845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.413914 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.414157 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 0bdb15c0-e951-4850-963b-2439b99b93f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.414351 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 58490b25-bc9d-4a48-aff3-3eb967088bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.414569 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 9f560b0d-dc54-4d68-a06b-71401abd49eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:05:33.414920 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:05:33.415211 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:05:32 up 28 min,  2 users,  load average: 9.19, 4.53, 2.13\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_771234de69074fed81ffef19dcee2804': '2', 'io_workload': '1', 'num_proj_4b76ce35cec84d189228639d70c6be45': '2', 'num_proj_20eaa28753124b488bd3e69bbc01af54': '1', 'num_proj_a658c179c6fe462db19eb1a17419ab06': '1', 'num_proj_60e178f8e50d4b57805cd6cbabe007ba': '2', 'num_proj_97026720e5114b53a1aa2cd0d93104ea': '1', 'num_task_rescuing': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:05:33.542179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:33.542179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:33.542179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:33.542179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No VIF found with MAC fa:16:3e:42:fd:a4, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:33.598600 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:33.598904 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:05:33.599728 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Start _get_guest_xml network_info=[{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:2c:5b:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd0c7a5fb-91e7-42e2-89d1-f2712cedf7f3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '13d3ddb8-228a-444f-a76b-db7d78fee107', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, 'status': 'reserved', 'instance': '58490b25-bc9d-4a48-aff3-3eb967088bc8', 'attached_at': '', 'detached_at': '', 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'serial': '42cf866d-9c6d-4cb7-a814-58d9c1f02365'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:05:33.600072 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'resources' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:33.843363 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:33.874714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-233b134d-ad24-4754-912a-2c373be98635 tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.042s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:33.879479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "interface-c1d90648-3e76-41e4-9f71-9178785a8979-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:33.879687 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "interface-c1d90648-3e76-41e4-9f71-9178785a8979-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:33.939212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9522dc3b-c5ed-458b-92b8-a01ba442e61d tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.526s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:34.069001 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:34.069288 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:34.103150 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:34.109953 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:05:34.111482 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1870437479', uuid='58490b25-bc9d-4a48-aff3-3eb967088bc8'), owner=OwnerMeta(userid='6c2bd621defb420db9fd8345c5b36248', username='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member', projectid='771234de69074fed81ffef19dcee2804', projectname='tempest-ServerBootFromVolumeStableRescueTest-2029132639'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:2c:5b:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533134.1110597) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:34.112692 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:05:34.113367 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:05:34.114991 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:05:34.115175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:05:34.116290 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:05:34.116666 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:05:34.116813 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:05:34.116918 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:05:34.117475 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:05:34.117475 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:05:34.117475 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:05:34.117475 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:05:34.117613 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:05:34.117700 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:05:34.118730 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:05:34.118730 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:05:34.118730 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:34.386533 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'flavor' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:34.426319 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:34.545776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:34.546030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:34.546259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:34.546447 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:34.546676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:34.549095 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Terminating instance
Jun 27 04:05:34.575149 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:34.623155 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:34.646104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:34.701560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:34.750659 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:34.751116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:34.751552 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:34.752108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:34.753583 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:34.753583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:34.753908 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:34.754180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:34.754557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:34.770259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:34.771829 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:34.772269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:34.772971 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:34.773354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:34.773959 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:34.792257 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:34.802143 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:34.807609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:34.816548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.829303 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:34.830097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:34.830097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:34.830783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('16', '0', '0', 0) found on session 12 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:34.830940 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.837685 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:34.838138 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:34.838565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:34.838565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:34.839137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('15', '0', '0', 0) found on session 11 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:34.839246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:34.850821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 12 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:34.851122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:34.856555 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 11 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:34.856868 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:34.890339 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:34.891407 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:34.892901 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:34.898925 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface> {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 27 04:05:34.901446 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface> {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 27 04:05:34.902772 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Attempting to detach device tap7d2fe356-f6 from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] detach device xml: <interface type="ethernet">
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]:   <mac address="fa:16:3e:18:bf:67"/>
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]:   <model type="virtio"/>
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]:   <driver name="qemu"/>
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]:   <mtu size="1372"/>
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]:   <target dev="tap7d2fe356-f6"/>
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]: </interface>
Jun 27 04:05:34.903000 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:34.909216 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface> {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface>not found in domain: <domain type='qemu' id='3'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <name>instance-00000003</name>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <uuid>c1d90648-3e76-41e4-9f71-9178785a8979</uuid>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:09</nova:creationTime>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <nova:port uuid="7d2fe356-f649-4eeb-a8a8-28c9e2b502f5">
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.10.10.135" ipVersion="4"/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <memory unit='KiB'>196608</memory>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <vcpu placement='static'>1</vcpu>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <resource>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <partition>/machine</partition>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </resource>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <sysinfo type='smbios'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <entry name='product'>OpenStack Nova</entry>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <entry name='version'>33.1.0</entry>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <entry name='serial'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <entry name='uuid'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <entry name='family'>Virtual Machine</entry>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <boot dev='hd'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <smbios mode='sysinfo'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <vmcoreinfo state='on'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <cpu mode='custom' match='exact' check='full'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <model fallback='forbid'>Nehalem</model>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <feature policy='require' name='hypervisor'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <clock offset='utc'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <on_poweroff>destroy</on_poweroff>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <on_reboot>restart</on_reboot>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <on_crash>destroy</on_crash>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <disk type='file' device='disk'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk' index='2'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <backingStore type='file' index='3'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:         <format type='raw'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:         <source file='/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:         <backingStore/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       </backingStore>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <target dev='vda' bus='virtio'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='virtio-disk0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <disk type='file' device='cdrom'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <driver name='qemu' type='raw' cache='none'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config' index='1'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <backingStore/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <target dev='hda' bus='ide'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <readonly/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='ide0-0-0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <controller type='usb' index='0' model='none'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='usb'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <controller type='pci' index='0' model='pci-root'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='pci.0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <controller type='ide' index='0'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='ide'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <interface type='ethernet'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <mac address='fa:16:3e:ae:33:c8'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <target dev='tap192d7226-ce'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <model type='virtio'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <driver name='qemu'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <mtu size='1372'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='net0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <interface type='ethernet'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <mac address='fa:16:3e:18:bf:67'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <target dev='tap7d2fe356-f6'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <model type='virtio'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <driver name='qemu'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <mtu size='1372'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='net1'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <serial type='pty'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <target type='isa-serial' port='0'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:         <model name='isa-serial'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       </target>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <console type='pty' tty='/dev/pts/2'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <target type='serial' port='0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </console>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <input type='mouse' bus='ps2'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='input0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <input type='keyboard' bus='ps2'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='input1'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <listen type='address' address='0.0.0.0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <audio id='1' type='none'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <model type='virtio' heads='1' primary='yes'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='video0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <stats period='10'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='balloon0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <rng model='virtio'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <backend model='random'>/dev/urandom</backend>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <alias name='rng0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <label>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</label>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <imagelabel>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</imagelabel>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <label>+64055:+993</label>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:     <imagelabel>+64055:+993</imagelabel>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:34.918013 np0000003830 nova-compute[98984]:  {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully detached device tap7d2fe356-f6 from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the persistent domain config.
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] (1/8): Attempting to detach device tap7d2fe356-f6 with device alias net1 from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] detach device xml: <interface type="ethernet">
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]:   <mac address="fa:16:3e:18:bf:67"/>
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]:   <model type="virtio"/>
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]:   <driver name="qemu"/>
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]:   <mtu size="1372"/>
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]:   <target dev="tap7d2fe356-f6"/>
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]: </interface>
Jun 27 04:05:34.922569 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:35.019482 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.054003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:05:35.083849 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:05:35.084075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.793s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:35.084907 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.75 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:05:35.084907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.598s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:35.088520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:35.092992 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.098549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.121215 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.135905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.142858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:35.142858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:35.176534 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.187099 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Deleted allocations for instance a25fed18-f473-42b6-b7dd-e29c3712bc39
Jun 27 04:05:35.191415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92528d9b-4bf0-4ef8-aa2c-c940219f6221 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.668s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:35.428028 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99968029899992 future=<Future at 0x7ec5382c9d60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:35.435781 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Instance destroyed successfully.
Jun 27 04:05:35.437633 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lazy-loading 'resources' on Instance uuid a06a5350-861e-43b7-b679-118dd50490f2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:35.443773 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4f7858d-b032-4a01-962c-75a33df32982 req-571a1694-6e2e-4c24-b495-97dcacbd39a6 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:35.444410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b4f7858d-b032-4a01-962c-75a33df32982 req-571a1694-6e2e-4c24-b495-97dcacbd39a6 service nova] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:35.444650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b4f7858d-b032-4a01-962c-75a33df32982 req-571a1694-6e2e-4c24-b495-97dcacbd39a6 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:35.444810 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b4f7858d-b032-4a01-962c-75a33df32982 req-571a1694-6e2e-4c24-b495-97dcacbd39a6 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:35.444949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4f7858d-b032-4a01-962c-75a33df32982 req-571a1694-6e2e-4c24-b495-97dcacbd39a6 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] No waiting events found dispatching network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:35.445124 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4f7858d-b032-4a01-962c-75a33df32982 req-571a1694-6e2e-4c24-b495-97dcacbd39a6 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:35.652324 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'flavor' on Instance uuid a7ff3732-e89b-4c07-b215-daac79472845 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:35.773232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:35.944969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1106665653',display_name='tempest-AttachSCSIVolumeTestJSON-server-1106665653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachscsivolumetestjson-server-1106665653',id=4,image_ref='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkExx8o/xw2B4SslXt6LUAoHvcgyThfUJ2mOFvaWsSq0vmD99ld+Sym1ABB4L+4cgafpBXoX+uOPNdD3SSh8B97yNzIsbqcsa20PxNJbDgz3N16AWWeq3Dufkrtq0PsYw==',key_name='tempest-keypair-1168361871',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:27Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a658c179c6fe462db19eb1a17419ab06',ramdisk_id='',reservation_id='r-hqvv3qb8',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8c2068cb-2bc2-4aa6-af9e-e45469e2b8d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1604028106',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1604028106-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd8d831825d64665b8175e5d7a1eb681',uuid=a06a5350-861e-43b7-b679-118dd50490f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:35.945175 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Converting VIF {"id": "fde3de09-acd7-41da-91df-6a87204801b1", "address": "fa:16:3e:be:87:c0", "network": {"id": "f8515b70-2f25-40d8-bbe5-f4906df1b277", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1956424520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a658c179c6fe462db19eb1a17419ab06", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde3de09-ac", "ovs_interfaceid": "fde3de09-acd7-41da-91df-6a87204801b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:35.945776 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:35.946039 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:35.947545 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.947739 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfde3de09-ac, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:35.953827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.953827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:35.962559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.966183 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.966183 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cf8985d-0ccf-4a74-b8f1-4f1039cf6a4d) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:35.968634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.968634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:35.978055 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:35.981325 np0000003830 nova-compute[98984]: INFO os_vif [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:87:c0,bridge_name='br-int',has_traffic_filtering=True,id=fde3de09-acd7-41da-91df-6a87204801b1,network=Network(f8515b70-2f25-40d8-bbe5-f4906df1b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde3de09-ac')
Jun 27 04:05:35.982178 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Deleting instance files /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2_del
Jun 27 04:05:35.983966 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Deletion of /opt/stack/data/nova/instances/a06a5350-861e-43b7-b679-118dd50490f2_del complete
Jun 27 04:05:36.167767 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.175333 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.175745 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533136.1753576, c1d90648-3e76-41e4-9f71-9178785a8979 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:05:36.181514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Start waiting for the detach event from libvirt for device tap7d2fe356-f6 with device alias net1 for instance c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:05:36.182134 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface> {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface>not found in domain: <domain type='qemu' id='3'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <name>instance-00000003</name>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <uuid>c1d90648-3e76-41e4-9f71-9178785a8979</uuid>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:09</nova:creationTime>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <nova:port uuid="7d2fe356-f649-4eeb-a8a8-28c9e2b502f5">
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.10.10.135" ipVersion="4"/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <memory unit='KiB'>196608</memory>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <vcpu placement='static'>1</vcpu>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <resource>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <partition>/machine</partition>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </resource>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <sysinfo type='smbios'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <entry name='product'>OpenStack Nova</entry>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <entry name='version'>33.1.0</entry>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <entry name='serial'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <entry name='uuid'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <entry name='family'>Virtual Machine</entry>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <boot dev='hd'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <smbios mode='sysinfo'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <vmcoreinfo state='on'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <cpu mode='custom' match='exact' check='full'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <model fallback='forbid'>Nehalem</model>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <feature policy='require' name='hypervisor'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <clock offset='utc'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <on_poweroff>destroy</on_poweroff>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <on_reboot>restart</on_reboot>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <on_crash>destroy</on_crash>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <disk type='file' device='disk'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk' index='2'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <backingStore type='file' index='3'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:         <format type='raw'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:         <source file='/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:         <backingStore/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       </backingStore>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <target dev='vda' bus='virtio'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='virtio-disk0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <disk type='file' device='cdrom'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <driver name='qemu' type='raw' cache='none'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config' index='1'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <backingStore/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <target dev='hda' bus='ide'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <readonly/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='ide0-0-0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <controller type='usb' index='0' model='none'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='usb'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <controller type='pci' index='0' model='pci-root'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='pci.0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <controller type='ide' index='0'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='ide'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <interface type='ethernet'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <mac address='fa:16:3e:ae:33:c8'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <target dev='tap192d7226-ce'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <model type='virtio'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <driver name='qemu'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <mtu size='1372'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='net0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <serial type='pty'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <target type='isa-serial' port='0'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:         <model name='isa-serial'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       </target>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <console type='pty' tty='/dev/pts/2'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <target type='serial' port='0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </console>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <input type='mouse' bus='ps2'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='input0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <input type='keyboard' bus='ps2'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='input1'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <listen type='address' address='0.0.0.0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <audio id='1' type='none'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <model type='virtio' heads='1' primary='yes'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='video0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <stats period='10'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='balloon0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <rng model='virtio'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <backend model='random'>/dev/urandom</backend>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <alias name='rng0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <label>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</label>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <imagelabel>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</imagelabel>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <label>+64055:+993</label>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:     <imagelabel>+64055:+993</imagelabel>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:36.190004 np0000003830 nova-compute[98984]:  {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully detached device tap7d2fe356-f6 from instance c1d90648-3e76-41e4-9f71-9178785a8979 from the live domain config.
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d2fe356-f6, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.196973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:36.199769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-03461879-e22c-490c-a477-9a92bcf8c789 tempest-VolumesAssistedSnapshotsTest-2048792395 tempest-VolumesAssistedSnapshotsTest-2048792395-project-member] Lock "a25fed18-f473-42b6-b7dd-e29c3712bc39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.158s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:36.202153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.204133 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.205173 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69c639c0-3d64-4475-8553-6bfb3d415bcf) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:36.206235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.207116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:36.231703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.232180 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.243796 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:36.245922 np0000003830 nova-compute[98984]: INFO os_vif [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6')
Jun 27 04:05:36.247159 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1270200106', uuid='c1d90648-3e76-41e4-9f71-9178785a8979'), owner=OwnerMeta(userid='e9a99814caeb41859b0a2000f52a4c38', username='tempest-TaggedAttachmentsTest-1939092029-project-member', projectid='20eaa28753124b488bd3e69bbc01af54', projectname='tempest-TaggedAttachmentsTest-1939092029'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533136.2464774) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:36</nova:creationTime>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:36.248838 np0000003830 nova-compute[98984]:  {{(pid=98984) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
Jun 27 04:05:36.251898 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:36.252209 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:36.372156 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-356be150-c6cb-4e1e-977b-384160e3f50d req-f22b9854-1623-4625-a8fe-7cbe17936236 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:36.372623 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-356be150-c6cb-4e1e-977b-384160e3f50d req-f22b9854-1623-4625-a8fe-7cbe17936236 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:36.372623 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-356be150-c6cb-4e1e-977b-384160e3f50d req-f22b9854-1623-4625-a8fe-7cbe17936236 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:36.372756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-356be150-c6cb-4e1e-977b-384160e3f50d req-f22b9854-1623-4625-a8fe-7cbe17936236 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:36.372940 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-356be150-c6cb-4e1e-977b-384160e3f50d req-f22b9854-1623-4625-a8fe-7cbe17936236 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-unplugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:36.373108 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-356be150-c6cb-4e1e-977b-384160e3f50d req-f22b9854-1623-4625-a8fe-7cbe17936236 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-unplugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 for instance with vm_state active and task_state None.
Jun 27 04:05:36.491916 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 27 04:05:36.493735 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:05:36.494004 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:05:36.494090 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a06a5350-861e-43b7-b679-118dd50490f2] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:05:36.494334 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:36.661596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:36.670113 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:36.803473 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Found WWN 3300000001327a596 for multipath device dm-6 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:36.804240 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.050s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:36.804240 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== connect_volume: return (2050ms) {'type': 'block', 'scsi_wwn': '3300000001327a596', 'path': '/dev/dm-6', 'multipath_id': '3300000001327a596'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:36.804819 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001327a596', 'path': '/dev/dm-6', 'multipath_id': '3300000001327a596'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:36.882837 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-deleted-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:36.882837 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Neutron deleted interface 7d2fe356-f649-4eeb-a8a8-28c9e2b502f5; detaching it from the instance and deleting it from the info cache
Jun 27 04:05:36.884139 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Lazy-loading 'system_metadata' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:37.315522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1870437479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1870437479',id=10,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:22Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-l6wcgi2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:23Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=58490b25-bc9d-4a48-aff3-3eb967088bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:2c:5b:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:37.315522 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:2c:5b:14"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:37.317071 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:37.318271 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'pci_devices' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:37.392965 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Lazy-loading 'flavor' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:37.576386 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-62d22a34-7d54-455c-a86c-6a09006c12be req-b1403529-e918-4d94-a7b8-92f4c99ca6f0 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:37.576386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-62d22a34-7d54-455c-a86c-6a09006c12be req-b1403529-e918-4d94-a7b8-92f4c99ca6f0 service nova] Acquiring lock "a06a5350-861e-43b7-b679-118dd50490f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:37.576386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-62d22a34-7d54-455c-a86c-6a09006c12be req-b1403529-e918-4d94-a7b8-92f4c99ca6f0 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:37.576989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-62d22a34-7d54-455c-a86c-6a09006c12be req-b1403529-e918-4d94-a7b8-92f4c99ca6f0 service nova] Lock "a06a5350-861e-43b7-b679-118dd50490f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:37.577646 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-62d22a34-7d54-455c-a86c-6a09006c12be req-b1403529-e918-4d94-a7b8-92f4c99ca6f0 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] No waiting events found dispatching network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:37.578307 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-62d22a34-7d54-455c-a86c-6a09006c12be req-b1403529-e918-4d94-a7b8-92f4c99ca6f0 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-unplugged-fde3de09-acd7-41da-91df-6a87204801b1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:37.745179 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:37.765159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:37.765381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:37.765677 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Attaching volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69 to /dev/vdb
Jun 27 04:05:37.822304 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <uuid>58490b25-bc9d-4a48-aff3-3eb967088bc8</uuid>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <name>instance-0000000a</name>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1870437479</nova:name>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:05:34</nova:creationTime>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:user uuid="6c2bd621defb420db9fd8345c5b36248">tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member</nova:user>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:project uuid="771234de69074fed81ffef19dcee2804">tempest-ServerBootFromVolumeStableRescueTest-2029132639</nova:project>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         <nova:port uuid="b4a8af07-d05c-4f98-98c1-0f087b0fcd54">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <entry name="serial">58490b25-bc9d-4a48-aff3-3eb967088bc8</entry>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <entry name="uuid">58490b25-bc9d-4a48-aff3-3eb967088bc8</entry>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <alias name="ua-42cf866d-9c6d-4cb7-a814-58d9c1f02365"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-6"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <serial>42cf866d-9c6d-4cb7-a814-58d9c1f02365</serial>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.rescue"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <boot order="1"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:2c:5b:14"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <target dev="tapb4a8af07-d0"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/console.log" append="off"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:37.824088 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:05:37.831069 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance destroyed successfully.
Jun 27 04:05:37.856777 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:37.873149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:37.896431 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Object Instance<c1d90648-3e76-41e4-9f71-9178785a8979> lazy-loaded attributes: system_metadata,flavor {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:37.897574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000003830',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:37.898161 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Converting VIF {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:37.898891 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:37.901120 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface> {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 27 04:05:37.904048 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface>not found in domain: <domain type='qemu' id='3'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <name>instance-00000003</name>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <uuid>c1d90648-3e76-41e4-9f71-9178785a8979</uuid>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:36</nova:creationTime>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <memory unit='KiB'>196608</memory>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <vcpu placement='static'>1</vcpu>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <resource>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <partition>/machine</partition>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </resource>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <sysinfo type='smbios'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <entry name='product'>OpenStack Nova</entry>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <entry name='version'>33.1.0</entry>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <entry name='serial'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <entry name='uuid'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <entry name='family'>Virtual Machine</entry>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <boot dev='hd'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <smbios mode='sysinfo'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <vmcoreinfo state='on'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <cpu mode='custom' match='exact' check='full'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <model fallback='forbid'>Nehalem</model>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <feature policy='require' name='hypervisor'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <clock offset='utc'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <on_poweroff>destroy</on_poweroff>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <on_reboot>restart</on_reboot>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <on_crash>destroy</on_crash>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <disk type='file' device='disk'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk' index='2'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <backingStore type='file' index='3'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:         <format type='raw'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:         <source file='/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:         <backingStore/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       </backingStore>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <target dev='vda' bus='virtio'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='virtio-disk0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <disk type='file' device='cdrom'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <driver name='qemu' type='raw' cache='none'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config' index='1'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <backingStore/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <target dev='hda' bus='ide'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <readonly/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='ide0-0-0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <controller type='usb' index='0' model='none'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='usb'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <controller type='pci' index='0' model='pci-root'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='pci.0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <controller type='ide' index='0'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='ide'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <interface type='ethernet'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <mac address='fa:16:3e:ae:33:c8'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <target dev='tap192d7226-ce'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <model type='virtio'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <driver name='qemu'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <mtu size='1372'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='net0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <serial type='pty'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <target type='isa-serial' port='0'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:         <model name='isa-serial'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       </target>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <console type='pty' tty='/dev/pts/2'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <target type='serial' port='0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </console>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <input type='mouse' bus='ps2'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='input0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <input type='keyboard' bus='ps2'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='input1'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <listen type='address' address='0.0.0.0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <audio id='1' type='none'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <model type='virtio' heads='1' primary='yes'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='video0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <stats period='10'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='balloon0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <rng model='virtio'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <backend model='random'>/dev/urandom</backend>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <alias name='rng0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <label>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</label>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <imagelabel>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</imagelabel>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <label>+64055:+993</label>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:     <imagelabel>+64055:+993</imagelabel>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:37.904730 np0000003830 nova-compute[98984]:  {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 27 04:05:37.907977 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface> {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:bf:67"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap7d2fe356-f6"/></interface>not found in domain: <domain type='qemu' id='3'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <name>instance-00000003</name>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <uuid>c1d90648-3e76-41e4-9f71-9178785a8979</uuid>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:36</nova:creationTime>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <memory unit='KiB'>196608</memory>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <currentMemory unit='KiB'>196608</currentMemory>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <vcpu placement='static'>1</vcpu>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <resource>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <partition>/machine</partition>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </resource>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <sysinfo type='smbios'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <entry name='product'>OpenStack Nova</entry>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <entry name='version'>33.1.0</entry>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <entry name='serial'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <entry name='uuid'>c1d90648-3e76-41e4-9f71-9178785a8979</entry>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <entry name='family'>Virtual Machine</entry>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <boot dev='hd'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <smbios mode='sysinfo'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <vmcoreinfo state='on'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <tb-cache unit='KiB'>131072</tb-cache>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <cpu mode='custom' match='exact' check='full'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <model fallback='forbid'>Nehalem</model>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <feature policy='require' name='hypervisor'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <clock offset='utc'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <on_poweroff>destroy</on_poweroff>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <on_reboot>restart</on_reboot>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <on_crash>destroy</on_crash>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <disk type='file' device='disk'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <driver name='qemu' type='qcow2' cache='none'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk' index='2'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <backingStore type='file' index='3'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:         <format type='raw'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:         <source file='/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:         <backingStore/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       </backingStore>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <target dev='vda' bus='virtio'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='virtio-disk0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <disk type='file' device='cdrom'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <driver name='qemu' type='raw' cache='none'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <source file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/disk.config' index='1'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <backingStore/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <target dev='hda' bus='ide'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <readonly/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='ide0-0-0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <controller type='usb' index='0' model='none'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='usb'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <controller type='pci' index='0' model='pci-root'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='pci.0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <controller type='ide' index='0'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='ide'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </controller>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <interface type='ethernet'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <mac address='fa:16:3e:ae:33:c8'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <target dev='tap192d7226-ce'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <model type='virtio'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <driver name='qemu'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <mtu size='1372'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='net0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <serial type='pty'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <target type='isa-serial' port='0'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:         <model name='isa-serial'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       </target>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <console type='pty' tty='/dev/pts/2'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <source path='/dev/pts/2'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <log file='/opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979/console.log' append='off'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <target type='serial' port='0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='serial0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </console>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <input type='mouse' bus='ps2'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='input0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <input type='keyboard' bus='ps2'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='input1'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </input>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <listen type='address' address='0.0.0.0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </graphics>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <audio id='1' type='none'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <model type='virtio' heads='1' primary='yes'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='video0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <stats period='10'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='balloon0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <rng model='virtio'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <backend model='random'>/dev/urandom</backend>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <alias name='rng0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <label>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</label>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <imagelabel>libvirt-c1d90648-3e76-41e4-9f71-9178785a8979</imagelabel>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <label>+64055:+993</label>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:     <imagelabel>+64055:+993</imagelabel>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:   </seclabel>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:37.923034 np0000003830 nova-compute[98984]:  {{(pid=98984) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
Jun 27 04:05:37.926068 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Detaching interface fa:16:3e:18:bf:67 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap7d2fe356-f6' not found.
Jun 27 04:05:37.926068 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000003830',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:37.927557 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Converting VIF {"id": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "address": "fa:16:3e:18:bf:67", "network": {"id": "00413ed2-7db2-47e8-ac42-81160431a2e3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1083891479", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d2fe356-f6", "ovs_interfaceid": "7d2fe356-f649-4eeb-a8a8-28c9e2b502f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:37.928594 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:37.929005 np0000003830 nova-compute[98984]: DEBUG os_vif [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:37.936896 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:37.937667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d2fe356-f6, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:37.937667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:37.941610 np0000003830 nova-compute[98984]: INFO os_vif [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:67,bridge_name='br-int',has_traffic_filtering=True,id=7d2fe356-f649-4eeb-a8a8-28c9e2b502f5,network=Network(00413ed2-7db2-47e8-ac42-81160431a2e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d2fe356-f6')
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1270200106', uuid='c1d90648-3e76-41e4-9f71-9178785a8979'), owner=OwnerMeta(userid='e9a99814caeb41859b0a2000f52a4c38', username='tempest-TaggedAttachmentsTest-1939092029-project-member', projectid='20eaa28753124b488bd3e69bbc01af54', projectname='tempest-TaggedAttachmentsTest-1939092029'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533137.9422896) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:package version="33.1.0"/>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:name>tempest-device-tagging-server-1270200106</nova:name>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:creationTime>2026-06-27 04:05:37</nova:creationTime>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:memory>192</nova:memory>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:disk>1</nova:disk>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:swap>0</nova:swap>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:extraSpecs>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     </nova:extraSpecs>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   </nova:flavor>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:minRam>0</nova:minRam>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:properties>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     </nova:properties>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   </nova:image>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:owner>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:user uuid="e9a99814caeb41859b0a2000f52a4c38">tempest-TaggedAttachmentsTest-1939092029-project-member</nova:user>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:project uuid="20eaa28753124b488bd3e69bbc01af54">tempest-TaggedAttachmentsTest-1939092029</nova:project>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   </nova:owner>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   <nova:ports>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     <nova:port uuid="192d7226-ce75-4535-b9af-861512f1c37c">
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:       <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:     </nova:port>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:   </nova:ports>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]: </nova:instance>
Jun 27 04:05:37.944632 np0000003830 nova-compute[98984]:  {{(pid=98984) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
Jun 27 04:05:37.947436 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9ae816b0-0946-49be-a621-3c06494298dd req-7d7cc188-966d-439e-b271-901ad997e8c1 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:37.953548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:37.958986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:37.970841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:37.972323 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:feae:33c8', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::acbe:3bff:fe3f:24b5', 'fe80::fc16:3eff:fe24:e00a', 'fe80::8c73:43ff:fe39:6430', 'fe80::fc16:3eff:fe42:fda4', 'fe80::fc16:3eff:fe63:9e91', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329'] 
Jun 27 04:05:37.972754 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:37.972754 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:37.972868 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:37.973038 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updating existing volume attachment record: 46037694-d881-4149-8fcf-b41c0cec9ab8 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:38.314116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:38.314297 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquired lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:38.314645 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:38.451816 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:38.452610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:38.453448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:38.453509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:38.454022 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-unplugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:38.454213 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-unplugged-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5 for instance with vm_state active and task_state None.
Jun 27 04:05:38.454381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Received event network-vif-deleted-fde3de09-acd7-41da-91df-6a87204801b1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:38.454580 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Neutron deleted interface fde3de09-acd7-41da-91df-6a87204801b1; detaching it from the instance and deleting it from the info cache
Jun 27 04:05:38.456601 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a053fe6a-ebd7-4100-b74f-3f1c0e7feaca req-7658f22d-eda3-4991-b66e-55d4cf014d69 service nova] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Detach interface failed, port_id=fde3de09-acd7-41da-91df-6a87204801b1, reason: Instance a06a5350-861e-43b7-b679-118dd50490f2 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:05:38.470236 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:38.552153 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:38.552646 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:38.552795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:38.553259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:38.553632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:38.567463 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:38.568375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:38.568972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:38.570168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:38.570566 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:38.570857 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:38.584120 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:38.590628 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:38.599732 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:38.604511 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.622042 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:38.622624 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:38.623003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:38.623670 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] HCTL ('12', '0', '0', 0) found on session 20 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:38.623841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:38.630475 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:38.631184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:38.631184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:38.632819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] HCTL ('11', '0', '0', 0) found on session 19 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:38.632819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:38.636173 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching for a device in session 20 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:38.636506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:38.647059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Searching for a device in session 19 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:38.647059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:38.817375 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:38.846991 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:38.972659 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Took 2.48 seconds to deallocate network for instance.
Jun 27 04:05:39.223610 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:39.238348 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:39.352778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:39.353201 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:39.355576 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:39.355576 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No VIF found with MAC fa:16:3e:2c:5b:14, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:39.355576 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Using config drive
Jun 27 04:05:39.426833 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [{"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:39.481862 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:39.482692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:39.569442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:05:39.859601 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'ec2_ids' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:39.929468 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Releasing lock "refresh_cache-c1d90648-3e76-41e4-9f71-9178785a8979" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:40.141925 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:40.141925 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:40.362810 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:40.362810 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'keypairs' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:40.432946 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3b381160-b6f8-4ff1-a6c5-1b580de374e7 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "interface-c1d90648-3e76-41e4-9f71-9178785a8979-7d2fe356-f649-4eeb-a8a8-28c9e2b502f5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.553s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:40.586760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Found WWN 3300000000a6b0dd1 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:05:40.586760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:40.586760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '3300000000a6b0dd1', 'path': '/dev/dm-4', 'multipath_id': '3300000000a6b0dd1'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:40.586760 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a6b0dd1', 'path': '/dev/dm-4', 'multipath_id': '3300000000a6b0dd1'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:05:40.588952 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'flavor' on Instance uuid a7ff3732-e89b-4c07-b215-daac79472845 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:40.640025 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:40.864369 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:40.866714 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:41.061106 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Creating config drive at /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config.rescue
Jun 27 04:05:41.064740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn7ao_gsr {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:41.093996 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Attempting to attach volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:   <alias name="ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69"/>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:   <serial>8d1afea0-388e-4672-a14b-0f4e53d1ff69</serial>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:41.095363 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:05:41.116925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn7ao_gsr" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:41.148740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.667s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:41.206346 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:41.305786 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Deleted allocations for instance a06a5350-861e-43b7-b679-118dd50490f2
Jun 27 04:05:41.747361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:41.784334 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:41.788668 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:41.864906 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:41.950068 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:41.953326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.171754 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-06e78ddc-d086-4b96-b1ac-e06466402ce1 req-fae9af2e-f079-420d-aa11-672e46e13050 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:42.172079 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-06e78ddc-d086-4b96-b1ac-e06466402ce1 req-fae9af2e-f079-420d-aa11-672e46e13050 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:42.172329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-06e78ddc-d086-4b96-b1ac-e06466402ce1 req-fae9af2e-f079-420d-aa11-672e46e13050 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:42.172462 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-06e78ddc-d086-4b96-b1ac-e06466402ce1 req-fae9af2e-f079-420d-aa11-672e46e13050 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:42.173027 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-06e78ddc-d086-4b96-b1ac-e06466402ce1 req-fae9af2e-f079-420d-aa11-672e46e13050 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:42.173442 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-06e78ddc-d086-4b96-b1ac-e06466402ce1 req-fae9af2e-f079-420d-aa11-672e46e13050 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state rescuing.
Jun 27 04:05:42.189624 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:42.192426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:42.192426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:42.192426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:42.192426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:42.194100 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Terminating instance
Jun 27 04:05:42.207103 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.314144 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e81dc241-c35a-4f22-b364-458e80d3abaf tempest-AttachSCSIVolumeTestJSON-1604028106 tempest-AttachSCSIVolumeTestJSON-1604028106-project-member] Lock "a06a5350-861e-43b7-b679-118dd50490f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.768s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:42.699839 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:05:42.722252 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.727225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.751630 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.755929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.786257 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.787836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:42.836057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:42.836057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:42.836057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:42.836057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] No VIF found with MAC fa:16:3e:24:e0:0a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:43.025090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 58490b25-bc9d-4a48-aff3-3eb967088bc8 due to new event <LifecycleEvent: 1782533143.0234058, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:05:43.025090 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533143.0234058, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:43.025090 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Resumed (Lifecycle Event)
Jun 27 04:05:43.031427 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-313e357a-e93b-4bd2-8c4d-10ddece69963 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:43.043424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.078053 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Instance destroyed successfully.
Jun 27 04:05:43.078885 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lazy-loading 'resources' on Instance uuid c1d90648-3e76-41e4-9f71-9178785a8979 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:43.085717 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.093332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.117726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.417839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.425815 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.432705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.459517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.472908 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.476811 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:43.477092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:43.526721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:43.529078 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:43.582745 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270200106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-1270200106',id=3,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0+6qA380wZQYXdLsAJrL1fppKY6HDV2f9tRKdGsHUhDoA1ryMekLZpsnouO0bqF4P3bidZck6yKKECiF3sjmgOlSVHOW2vbrAI6Y4LpsacRGCkzYlMJiJC8FNkq8+rHA==',key_name='tempest-keypair-223428080',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:21Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20eaa28753124b488bd3e69bbc01af54',ramdisk_id='',reservation_id='r-ptqpxo70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1939092029',owner_user_name='tempest-TaggedAttachmentsTest-1939092029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9a99814caeb41859b0a2000f52a4c38',uuid=c1d90648-3e76-41e4-9f71-9178785a8979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:43.582992 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converting VIF {"id": "192d7226-ce75-4535-b9af-861512f1c37c", "address": "fa:16:3e:ae:33:c8", "network": {"id": "ad3aabd5-7376-4e31-b025-45f4e312df56", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1315973391-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "20eaa28753124b488bd3e69bbc01af54", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap192d7226-ce", "ovs_interfaceid": "192d7226-ce75-4535-b9af-861512f1c37c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:43.584582 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:43.584582 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:43.586984 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.587606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap192d7226-ce, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:43.588603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.601376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:43.605724 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.610872 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.610872 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.611456 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85fe8042-add2-48f4-bd45-5857f1c6a110) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:43.612195 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.612871 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:43.631355 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.637755 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.641975 np0000003830 nova-compute[98984]: INFO os_vif [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:33:c8,bridge_name='br-int',has_traffic_filtering=True,id=192d7226-ce75-4535-b9af-861512f1c37c,network=Network(ad3aabd5-7376-4e31-b025-45f4e312df56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192d7226-ce')
Jun 27 04:05:43.642733 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Deleting instance files /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979_del
Jun 27 04:05:43.646424 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Deletion of /opt/stack/data/nova/instances/c1d90648-3e76-41e4-9f71-9178785a8979_del complete
Jun 27 04:05:43.850007 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:43.898853 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0006856659999812109 future=<Future at 0x7ec518738740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.899726 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Emitting event <LifecycleEvent: 1782533128.8980281, a25fed18-f473-42b6-b7dd-e29c3712bc39 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:43.900044 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.900260 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] VM Stopped (Lifecycle Event)
Jun 27 04:05:43.913310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.2599053339999955 future=<Future at 0x7ec518447a70 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.913310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.259722421000106 future=<Future at 0x7ec518447a70 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.913310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.913310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=6.524159397999938 future=<Future at 0x7ec5382c9d60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.913310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=6.524066778999895 future=<Future at 0x7ec5382c9d60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:43.982270 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:05:44.035833 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533144.0349877, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:44.035833 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Started (Lifecycle Event)
Jun 27 04:05:44.154757 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Took 1.45 seconds to destroy the instance on the hypervisor.
Jun 27 04:05:44.155349 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:05:44.155570 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:05:44.155689 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:05:44.155977 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:44.247182 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:44.321522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:44.322234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:44.322234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:44.322423 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:44.322526 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:44.322603 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:05:44.322685 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:44.322805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:44.322938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:44.323021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:44.323175 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:44.323687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:44.323687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:44.323781 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:44.323907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:44.324042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:44.324211 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:44.324378 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:44.325515 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:44.325725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:44.325871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:44.326030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:44.326198 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:44.326354 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a251d5c7-a4d2-42d3-b172-6617e4e4bd61 req-f1afccf7-5296-45a4-840a-ae7c475c1409 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with vm_state active and task_state deleting.
Jun 27 04:05:44.403752 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0942fa56-c3d5-40ef-8d07-b621f8e41700 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: a25fed18-f473-42b6-b7dd-e29c3712bc39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:44.539185 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:44.544903 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:44.569998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:44.570198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:44.573617 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:05:44.573768 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Claim successful on node np0000003830
Jun 27 04:05:44.587517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a13748d1-7d82-44eb-8d9a-4a2cbc389078 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.822s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:44.641081 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Unrescuing
Jun 27 04:05:44.641256 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:44.641355 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:44.641475 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:45.053906 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 27 04:05:45.053906 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99977397900011 future=<Future at 0x7ec5381d65d0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:45.144464 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:45.190300 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9dffa99f-5468-4d49-8f4c-b256108da658 req-b4713a88-4420-46b3-88ac-8cf0125a8beb service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-deleted-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:45.190577 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-9dffa99f-5468-4d49-8f4c-b256108da658 req-b4713a88-4420-46b3-88ac-8cf0125a8beb service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Neutron deleted interface 192d7226-ce75-4535-b9af-861512f1c37c; detaching it from the instance and deleting it from the info cache
Jun 27 04:05:45.192125 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9dffa99f-5468-4d49-8f4c-b256108da658 req-b4713a88-4420-46b3-88ac-8cf0125a8beb service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Detach interface failed, port_id=192d7226-ce75-4535-b9af-861512f1c37c, reason: Instance c1d90648-3e76-41e4-9f71-9178785a8979 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:05:45.551361 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:45.606453 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:45.736145 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Updating instance_info_cache with network_info: [{"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:45.909793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:45.910385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:46.110334 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Took 1.95 seconds to deallocate network for instance.
Jun 27 04:05:46.125172 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:46.125574 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:46.237855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-58490b25-bc9d-4a48-aff3-3eb967088bc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:46.238268 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'flavor' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:46.250337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:46.398758 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:46.400041 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:46.400467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:46.400467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:46.400611 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:46.400664 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-plugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with vm_state deleted and task_state None.
Jun 27 04:05:46.400807 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:46.400947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:46.401372 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:46.401583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:46.402095 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:46.402302 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with vm_state deleted and task_state None.
Jun 27 04:05:46.402446 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:46.402660 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Acquiring lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:46.402876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:46.403118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] Lock "c1d90648-3e76-41e4-9f71-9178785a8979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:46.403297 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] No waiting events found dispatching network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:46.403453 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ec326af6-d510-4f54-9fdc-4bb43e245ab6 req-a52c2c84-1f5d-4278-ad55-6d72bc1f3457 service nova] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Received unexpected event network-vif-unplugged-192d7226-ce75-4535-b9af-861512f1c37c for instance with vm_state deleted and task_state None.
Jun 27 04:05:46.414386 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Detaching volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69
Jun 27 04:05:46.500712 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Attempting to driver detach volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69 from mountpoint /dev/vdb
Jun 27 04:05:46.507434 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Found disk vdb by alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:46.510356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Found disk vdb by alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:46.510574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Attempting to detach device vdb from instance a7ff3732-e89b-4c07-b215-daac79472845 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <alias name="ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69"/>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <serial>8d1afea0-388e-4672-a14b-0f4e53d1ff69</serial>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:46.511030 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:46.521161 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully detached device vdb from instance a7ff3732-e89b-4c07-b215-daac79472845 from the persistent domain config.
Jun 27 04:05:46.521398 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] (1/8): Attempting to detach device vdb with device alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 from instance a7ff3732-e89b-4c07-b215-daac79472845 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <alias name="ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69"/>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <serial>8d1afea0-388e-4672-a14b-0f4e53d1ff69</serial>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:46.521731 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:46.621224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:46.630795 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:46.768226 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:46.771273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:46.796176 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:46.968507 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:46.981604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:46.996755 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:05:47.061660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:47.073659 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:47.141360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.571s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:47.142085 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:05:47.144809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.525s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:47.204325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533147.2022493, a7ff3732-e89b-4c07-b215-daac79472845 => ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:05:47.207807 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 for instance a7ff3732-e89b-4c07-b215-daac79472845 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:05:47.209538 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99911887799999 future=<Future at 0x7ec51873be60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:47.220786 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance destroyed successfully.
Jun 27 04:05:47.221432 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'numa_topology' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:47.222516 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully detached device vdb from instance a7ff3732-e89b-4c07-b215-daac79472845 from the live domain config.
Jun 27 04:05:47.653553 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:05:47.654004 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:05:47.654004 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:47.654282 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:47.725176 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<58490b25-bc9d-4a48-aff3-3eb967088bc8> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:05:47.774884 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:47.774884 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:47.786145 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a996571fb63c4c6e993f1fa02549a086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469d72ff5a3640dbb2193b8a91deeac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:05:47.795883 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Detected multiple connections on this host for volume: 8d1afea0-388e-4672-a14b-0f4e53d1ff69, skipping target disconnect.
Jun 27 04:05:48.157026 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:05:48.244701 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.275786 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.277462 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:48.286943 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.396728 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.453263 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'flavor' on Instance uuid a7ff3732-e89b-4c07-b215-daac79472845 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:48.475188 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.505990 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:48.505990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:48.505990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:48.505990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:48.505990 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:48.506429 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:05:48.506429 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:48.507412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:48.507412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:48.507412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:48.515190 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:48.515190 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-80b4d47d-1896-4247-a392-60b208428d2b req-b88ad41d-2756-4ae6-9337-e318c2e7894a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:05:48.614217 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.662269 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Successfully created port: bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:05:48.665562 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:05:48.796073 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.651s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:48.852162 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:48.959653 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Deleted allocations for instance c1d90648-3e76-41e4-9f71-9178785a8979
Jun 27 04:05:49.371950 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:49.464595 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d86b9a85-7424-4558-a8cc-c8f00de43a00 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.553s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:49.656703 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 58490b25-bc9d-4a48-aff3-3eb967088bc8 due to new event <LifecycleEvent: 1782533149.6563303, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:05:49.657000 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533149.6563303, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:49.657196 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Resumed (Lifecycle Event)
Jun 27 04:05:49.660561 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b9a3a82f-c67c-4fe4-b470-81cf5c8f3f8f tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:49.685733 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:05:49.687222 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:05:49.687616 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Creating image(s)
Jun 27 04:05:49.688273 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:49.688543 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:49.689224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:49.689932 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:49.693916 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:49.695560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:49.801755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:49.805605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:49.805605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:49.805605 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:49.811906 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:49.812645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:49.923170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:49.926586 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:49.976523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07611272-14d9-46ee-b4c7-bd71f0269763 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Lock "c1d90648-3e76-41e4-9f71-9178785a8979" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.786s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:50.033228 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk 1073741824" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:50.037686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:50.037686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:50.065030 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Successfully updated port: bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:05:50.121184 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:50.121351 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing instance network info cache due to event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:05:50.121889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:50.125651 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:50.125651 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:05:50.142173 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:50.148796 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:05:50.148796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:50.163271 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:50.166319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:50.234311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:50.235338 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Cannot resize image /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:05:50.236729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:05:50.236729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:05:50.236729 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:50.236729 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:50.237081 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:50.426709 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000467157999992196 future=<Future at 0x7ec5382c9d60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:50.427265 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] Emitting event <LifecycleEvent: 1782533135.4260945, a06a5350-861e-43b7-b679-118dd50490f2 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:50.427406 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:50.427630 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] VM Stopped (Lifecycle Event)
Jun 27 04:05:50.429152 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.619243590999986 future=<Future at 0x7ec5381d65d0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:50.429252 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.619109066999954 future=<Future at 0x7ec5381d65d0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:50.569262 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:50.593858 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:50.594206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:50.594568 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:50.594767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:50.595051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:50.595408 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state None.
Jun 27 04:05:50.596425 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:50.596717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:50.599669 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:50.600478 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:50.601202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:50.601385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:50.601607 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:50.601781 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-68891429-625d-4c32-aa6b-172214abd187 req-74ef1868-9542-4f63-bfbe-40ce4f18653c service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state None.
Jun 27 04:05:50.628265 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:50.670243 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533150.6699476, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:50.670384 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Started (Lifecycle Event)
Jun 27 04:05:50.699997 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:05:50.847888 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:50.930879 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-09724a28-0dfb-428c-bf33-73032edea380 tempest-TaggedAttachmentsTest-1939092029 tempest-TaggedAttachmentsTest-1939092029-project-member] [instance: a06a5350-861e-43b7-b679-118dd50490f2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:51.104210 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Detaching volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69
Jun 27 04:05:51.163908 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Attempting to driver detach volume 8d1afea0-388e-4672-a14b-0f4e53d1ff69 from mountpoint /dev/vdb
Jun 27 04:05:51.173753 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:51.178868 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Found disk vdb by alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:51.179676 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:51.181986 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Found disk vdb by alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Attempting to detach device vdb from instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <alias name="ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69"/>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <serial>8d1afea0-388e-4672-a14b-0f4e53d1ff69</serial>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:51.183076 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully detached device vdb from instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 from the persistent domain config.
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] (1/8): Attempting to detach device vdb with device alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 from instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <alias name="ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69"/>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <serial>8d1afea0-388e-4672-a14b-0f4e53d1ff69</serial>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:05:51.198550 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:05:51.350103 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e7bc662d-5f69-495d-aa43-e2dc5e013652 req-35a93157-f9fd-4bbb-97dd-2e0058c7f66a service nova] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:51.355735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:51.355735 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:51.950812 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:05:52.181533 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:52.374431 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:52.671413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:52.878184 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:05:52.878518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance network_info: |[{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:05:52.881125 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Start _get_guest_xml network_info=[{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:05:52.886575 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:05:52.886575 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-730649319', uuid='f2a4a001-7934-403f-9b26-6b4ed727e22f'), owner=OwnerMeta(userid='a996571fb63c4c6e993f1fa02549a086', username='tempest-AttachVolumeShelveTestJSON-1443827218-project-member', projectid='469d72ff5a3640dbb2193b8a91deeac0', projectname='tempest-AttachVolumeShelveTestJSON-1443827218'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533152.8844395) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:05:52.886575 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:05:52.886915 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:05:52.888518 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:05:52.888518 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:05:52.889740 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:05:52.890203 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:05:52.890376 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:05:52.890560 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:05:52.890759 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:05:52.890872 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:05:52.896434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:05:52.896434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:05:52.896434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:05:52.896434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:05:52.896434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:05:52.896434 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:05:52.903925 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-730649319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-730649319',id=12,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGxs0vSaOLHtuQdOTSUvhM94RLL2OkChlIMhMQu9jKceEWYn7zdvETRnv7ji+7V/bmD9GnYnOws4r7cvDGn9+GQuzyBayOrSwdw/YJJ6IKT1u+wBoJDzp8TSXpvjOruGw==',key_name='tempest-keypair-1297937537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-m4l5pg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=f2a4a001-7934-403f-9b26-6b4ed727e22f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:05:52.904198 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:52.904973 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:52.905549 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'pci_devices' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:53.340036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:53.340036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <uuid>f2a4a001-7934-403f-9b26-6b4ed727e22f</uuid>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <name>instance-0000000c</name>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-730649319</nova:name>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:05:52</nova:creationTime>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:user uuid="a996571fb63c4c6e993f1fa02549a086">tempest-AttachVolumeShelveTestJSON-1443827218-project-member</nova:user>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:project uuid="469d72ff5a3640dbb2193b8a91deeac0">tempest-AttachVolumeShelveTestJSON-1443827218</nova:project>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         <nova:port uuid="bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <entry name="serial">f2a4a001-7934-403f-9b26-6b4ed727e22f</entry>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <entry name="uuid">f2a4a001-7934-403f-9b26-6b4ed727e22f</entry>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:ad:db:6c"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <target dev="tapbcdcb8d4-1f"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/console.log" append="off"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:05:53.408764 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Preparing to wait for external event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-730649319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-730649319',id=12,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGxs0vSaOLHtuQdOTSUvhM94RLL2OkChlIMhMQu9jKceEWYn7zdvETRnv7ji+7V/bmD9GnYnOws4r7cvDGn9+GQuzyBayOrSwdw/YJJ6IKT1u+wBoJDzp8TSXpvjOruGw==',key_name='tempest-keypair-1297937537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-m4l5pg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=f2a4a001-7934-403f-9b26-6b4ed727e22f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:53.413025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:05:53.414153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.414413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a60e06-3398-5553-9064-7d6118c508c4', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:53.416093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.417084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:53.419745 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.423245 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.423245 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcdcb8d4-1f, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:53.423245 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcdcb8d4-1f, col_values=(('qos', UUID('221ffb5c-ce4e-4ce7-b34a-674371660366')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:53.423245 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcdcb8d4-1f, col_values=(('external_ids', {'iface-id': 'bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:db:6c', 'vm-uuid': 'f2a4a001-7934-403f-9b26-6b4ed727e22f'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:53.425126 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.426868 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:53.434194 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.435345 np0000003830 nova-compute[98984]: INFO os_vif [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f')
Jun 27 04:05:53.512994 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533153.5125268, 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 => ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:05:53.515124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8d1afea0-388e-4672-a14b-0f4e53d1ff69 for instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:05:53.517862 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully detached device vdb from instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 from the live domain config.
Jun 27 04:05:53.610842 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:05:53.611222 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:53.611386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:53.611885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:53.612207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8d1afea0-388e-4672-a14b-0f4e53d1ff69', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:05:53.612350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:53.644584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69 (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:53.645050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:05:53.645313 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '20')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:53.646229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69', '19')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:05:53.647617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5382e2a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'): ({'sdf'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:05:53.647617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:05:53.647826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Flush multipath device 3300000000a6b0dd1 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:05:53.680678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:53.740013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:05:53.793237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:05:53.793365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:05:53.794737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:05:53.806873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:05:53.807153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:05:53.820489 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:53.843033 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:05:53.856190 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:53.862211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.40.100,3260]
Jun 27 04:05:53.862211 np0000003830 nova-compute[98984]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:53.862211 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:53.880622 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:53.903571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:53.936999 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.50.100,3260]
Jun 27 04:05:53.936999 np0000003830 nova-compute[98984]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-8d1afea0-388e-4672-a14b-0f4e53d1ff69, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:53.936999 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:53.961116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:53.961533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:53.961958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] <== disconnect_volume: return (349ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:53.961958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:05:54.416592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:54.419325 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:54.422606 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:05:54.423056 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Claim successful on node np0000003830
Jun 27 04:05:54.542977 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'flavor' on Instance uuid 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:54.829120 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:54.829630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:54.977401 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:54.977668 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:05:54.977884 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No VIF found with MAC fa:16:3e:ad:db:6c, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:05:54.978317 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Using config drive
Jun 27 04:05:55.336711 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'flavor' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:55.484416 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:55.521025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:55.551593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-77e12338-fa14-4c3e-9655-9b2312ab574d tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.955s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:55.747051 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Creating config drive at /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config
Jun 27 04:05:55.751445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf63fx0ds {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:55.806031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf63fx0ds" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:56.136485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:56.136485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:56.136485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:56.136712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:56.137124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:56.139813 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Terminating instance
Jun 27 04:05:56.156426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:05:56.156426 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:05:56.305097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:56.305269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:56.305454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:56.306101 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:56.306101 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:56.308346 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Terminating instance
Jun 27 04:05:56.350884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:56.359911 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.401173 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.510971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.644846 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:05:56.661142 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:05:56.678694 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.683271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.719118 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.778410 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d237e2be-8b94-4e78-aa9e-fb2701f0dddd req-73f86393-3960-4c50-89fd-37b03a9655ca service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:56.778624 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d237e2be-8b94-4e78-aa9e-fb2701f0dddd req-73f86393-3960-4c50-89fd-37b03a9655ca service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:56.778891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d237e2be-8b94-4e78-aa9e-fb2701f0dddd req-73f86393-3960-4c50-89fd-37b03a9655ca service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:56.779012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d237e2be-8b94-4e78-aa9e-fb2701f0dddd req-73f86393-3960-4c50-89fd-37b03a9655ca service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:56.779179 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d237e2be-8b94-4e78-aa9e-fb2701f0dddd req-73f86393-3960-4c50-89fd-37b03a9655ca service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Processing event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:05:56.815472 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:05:56.842426 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.872124 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.882442 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.918806 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.937921 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:56.941465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.019202 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999638534000042 future=<Future at 0x7ec538318500 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:57.028348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-82a19723-776b-49d5-a760-67fe08ccde1f req-9db27618-55a0-467b-83ac-a2d762d5084a service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-unplugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:57.028348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-82a19723-776b-49d5-a760-67fe08ccde1f req-9db27618-55a0-467b-83ac-a2d762d5084a service nova] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:57.029071 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-82a19723-776b-49d5-a760-67fe08ccde1f req-9db27618-55a0-467b-83ac-a2d762d5084a service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:57.029410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-82a19723-776b-49d5-a760-67fe08ccde1f req-9db27618-55a0-467b-83ac-a2d762d5084a service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:57.029548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-82a19723-776b-49d5-a760-67fe08ccde1f req-9db27618-55a0-467b-83ac-a2d762d5084a service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] No waiting events found dispatching network-vif-unplugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:57.031129 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Instance destroyed successfully.
Jun 27 04:05:57.031129 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-82a19723-776b-49d5-a760-67fe08ccde1f req-9db27618-55a0-467b-83ac-a2d762d5084a service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-unplugged-425ad7c7-90d4-4d00-b524-d76651842a89 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:57.033115 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'resources' on Instance uuid a7ff3732-e89b-4c07-b215-daac79472845 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:57.102909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.142899 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.174593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.754s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:57.174593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:05:57.193741 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99963678999984 future=<Future at 0x7ec538462570 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:05:57.206038 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Instance destroyed successfully.
Jun 27 04:05:57.208029 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lazy-loading 'resources' on Instance uuid 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:05:57.281620 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b06b0fe2-0166-4deb-a342-342726ed5ffb req-e2cb87f1-dbf1-4a50-9ca2-d4e7fe54d3ae service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:57.281620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b06b0fe2-0166-4deb-a342-342726ed5ffb req-e2cb87f1-dbf1-4a50-9ca2-d4e7fe54d3ae service nova] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:57.281620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b06b0fe2-0166-4deb-a342-342726ed5ffb req-e2cb87f1-dbf1-4a50-9ca2-d4e7fe54d3ae service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:57.281620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b06b0fe2-0166-4deb-a342-342726ed5ffb req-e2cb87f1-dbf1-4a50-9ca2-d4e7fe54d3ae service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:57.282033 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b06b0fe2-0166-4deb-a342-342726ed5ffb req-e2cb87f1-dbf1-4a50-9ca2-d4e7fe54d3ae service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] No waiting events found dispatching network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:57.286857 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b06b0fe2-0166-4deb-a342-342726ed5ffb req-e2cb87f1-dbf1-4a50-9ca2-d4e7fe54d3ae service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:57.545304 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1711362097-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testmultiattachvolumeswap-server-1711362097-1',id=6,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSulVs7ZzRNnOca1kWH/bzgx84tnVtnl8YSHaFdVGw/O0CI6OX5kbEb+9hSIzsuCaQfUBhtLlgqF32mfif8Y7AtJ5eN/rF6zNk81pfCiYYyOSGLSxuVxpAvC26aAOJJjQ==',key_name='tempest-keypair-1975695241',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:33Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e178f8e50d4b57805cd6cbabe007ba',ramdisk_id='',reservation_id='r-wl9zu1xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-2127186776',owner_user_name='tempest-TestMultiAttachVolumeSwap-2127186776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='077264f43bdd4466af81374e8380fc8d',uuid=a7ff3732-e89b-4c07-b215-daac79472845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:57.546397 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converting VIF {"id": "425ad7c7-90d4-4d00-b524-d76651842a89", "address": "fa:16:3e:24:e0:0a", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap425ad7c7-90", "ovs_interfaceid": "425ad7c7-90d4-4d00-b524-d76651842a89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:57.546664 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:57.547834 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:57.548977 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:57.549681 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:57.550080 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attaching volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 to /dev/vdb
Jun 27 04:05:57.553231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.553626 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap425ad7c7-90, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:57.557462 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:57.564647 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.565885 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.566221 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a384427c-7211-40b7-bf86-4a262034ea3a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:57.570464 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:57.578411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.581650 np0000003830 nova-compute[98984]: INFO os_vif [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:e0:0a,bridge_name='br-int',has_traffic_filtering=True,id=425ad7c7-90d4-4d00-b524-d76651842a89,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap425ad7c7-90')
Jun 27 04:05:57.582192 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Deleting instance files /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845_del
Jun 27 04:05:57.583180 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Deletion of /opt/stack/data/nova/instances/a7ff3732-e89b-4c07-b215-daac79472845_del complete
Jun 27 04:05:57.621339 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:57.636841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:05:57.666162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:57.693984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:05:57.694830 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:05:57.699981 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:57.701156 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:57.712521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1711362097-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testmultiattachvolumeswap-server-1711362097-2',id=7,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSulVs7ZzRNnOca1kWH/bzgx84tnVtnl8YSHaFdVGw/O0CI6OX5kbEb+9hSIzsuCaQfUBhtLlgqF32mfif8Y7AtJ5eN/rF6zNk81pfCiYYyOSGLSxuVxpAvC26aAOJJjQ==',key_name='tempest-keypair-1975695241',keypairs=<?>,launch_index=1,launched_at=2026-06-27T04:04:43Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e178f8e50d4b57805cd6cbabe007ba',ramdisk_id='',reservation_id='r-wl9zu1xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-2127186776',owner_user_name='tempest-TestMultiAttachVolumeSwap-2127186776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='077264f43bdd4466af81374e8380fc8d',uuid=4e7bc7eb-135e-4f40-8a1c-1a9845dfb216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:05:57.712749 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converting VIF {"id": "b7ad965d-b785-4081-aede-59ad6a86188b", "address": "fa:16:3e:42:fd:a4", "network": {"id": "c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1495466579-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "60e178f8e50d4b57805cd6cbabe007ba", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ad965d-b7", "ovs_interfaceid": "b7ad965d-b785-4081-aede-59ad6a86188b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:05:57.713527 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:05:57.713958 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:05:57.719321 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:05:57.719745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:05:57.728092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.728689 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7ad965d-b7, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:57.740715 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:57.743635 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.743873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d05ea1f-11b2-4c73-9662-d8e9add1322b) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:05:57.745046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:05:57.748035 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe63:9e91', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa'] 
Jun 27 04:05:57.748035 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:05:57.749755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:05:57.750418 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:05:57.750418 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updating existing volume attachment record: 6557c23a-9e4f-4170-a2a6-91d7484d30ef {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:05:57.751956 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:57.755395 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:05:57.764944 np0000003830 nova-compute[98984]: INFO os_vif [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=b7ad965d-b785-4081-aede-59ad6a86188b,network=Network(c9adecd6-8c4d-4f28-bc22-e0fb0bbbd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ad965d-b7')
Jun 27 04:05:57.765330 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Deleting instance files /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216_del
Jun 27 04:05:57.766170 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Deletion of /opt/stack/data/nova/instances/4e7bc7eb-135e-4f40-8a1c-1a9845dfb216_del complete
Jun 27 04:05:57.836054 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2bd621defb420db9fd8345c5b36248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771234de69074fed81ffef19dcee2804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:05:57.871998 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:05:57.871998 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533157.8708162, f2a4a001-7934-403f-9b26-6b4ed727e22f => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:57.871998 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Started (Lifecycle Event)
Jun 27 04:05:57.877434 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:05:57.882340 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance spawned successfully.
Jun 27 04:05:57.883190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:05:58.091977 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Took 1.45 seconds to destroy the instance on the hypervisor.
Jun 27 04:05:58.092689 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:05:58.093020 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:05:58.093177 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a7ff3732-e89b-4c07-b215-daac79472845] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:05:58.093407 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:58.174840 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:58.202081 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:05:58.274935 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Took 1.46 seconds to destroy the instance on the hypervisor.
Jun 27 04:05:58.275510 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:05:58.276391 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:05:58.276391 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:05:58.276391 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:58.341956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:05:58.342362 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:05:58.342617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:58.343128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:58.343410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:05:58.360244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:58.360947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:05:58.361638 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:58.361955 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:58.363428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:05:58.363695 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:58.380556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:58.380556 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:58.386421 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:58.389270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:05:58.389270 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:58.395065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:58.395065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:58.396209 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:58.396209 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:58.398723 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:58.398723 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:58.399008 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3] added
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:58.409762 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:58.410519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:58.410519 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0483(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:58.411385 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3] added
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:05:58.412284 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:58.412626 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:05:58.413002 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0492(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:05:58.413406 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:05:58.473529 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Successfully created port: 253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:05:58.623234 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:05:58.707451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:05:58.859131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:58.912832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-18a37e1a-96ac-431b-8941-5c1d9f3b59fb req-9c5b2f1c-b00b-4af3-9a9f-5d2e770eda59 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:58.914511 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-18a37e1a-96ac-431b-8941-5c1d9f3b59fb req-9c5b2f1c-b00b-4af3-9a9f-5d2e770eda59 service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:58.914733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-18a37e1a-96ac-431b-8941-5c1d9f3b59fb req-9c5b2f1c-b00b-4af3-9a9f-5d2e770eda59 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:58.915114 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-18a37e1a-96ac-431b-8941-5c1d9f3b59fb req-9c5b2f1c-b00b-4af3-9a9f-5d2e770eda59 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:58.915801 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Took 9.23 seconds to spawn the instance on the hypervisor.
Jun 27 04:05:58.916404 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:05:58.916906 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-18a37e1a-96ac-431b-8941-5c1d9f3b59fb req-9c5b2f1c-b00b-4af3-9a9f-5d2e770eda59 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] No waiting events found dispatching network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:58.917472 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:58.920919 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533158.9165401, f2a4a001-7934-403f-9b26-6b4ed727e22f => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:58.921089 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Paused (Lifecycle Event)
Jun 27 04:05:58.922117 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-18a37e1a-96ac-431b-8941-5c1d9f3b59fb req-9c5b2f1c-b00b-4af3-9a9f-5d2e770eda59 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received unexpected event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 for instance with vm_state building and task_state spawning.
Jun 27 04:05:58.947282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6950859d-503b-49cc-a937-02c989dab593 req-a1c598b6-807d-439c-b45d-e2027464b497 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-deleted-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:58.947390 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-6950859d-503b-49cc-a937-02c989dab593 req-a1c598b6-807d-439c-b45d-e2027464b497 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Neutron deleted interface 425ad7c7-90d4-4d00-b524-d76651842a89; detaching it from the instance and deleting it from the info cache
Jun 27 04:05:58.948938 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6950859d-503b-49cc-a937-02c989dab593 req-a1c598b6-807d-439c-b45d-e2027464b497 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Detach interface failed, port_id=425ad7c7-90d4-4d00-b524-d76651842a89, reason: Instance a7ff3732-e89b-4c07-b215-daac79472845 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:05:58.971490 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:05:59.121245 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28265386-2b1e-42fe-93d3-cb91512651d5 req-153606db-ae2c-4c7c-8ca6-8937832abfa4 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-unplugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:59.121834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28265386-2b1e-42fe-93d3-cb91512651d5 req-153606db-ae2c-4c7c-8ca6-8937832abfa4 service nova] Acquiring lock "a7ff3732-e89b-4c07-b215-daac79472845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:59.122078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28265386-2b1e-42fe-93d3-cb91512651d5 req-153606db-ae2c-4c7c-8ca6-8937832abfa4 service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:59.122311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28265386-2b1e-42fe-93d3-cb91512651d5 req-153606db-ae2c-4c7c-8ca6-8937832abfa4 service nova] Lock "a7ff3732-e89b-4c07-b215-daac79472845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:59.122451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28265386-2b1e-42fe-93d3-cb91512651d5 req-153606db-ae2c-4c7c-8ca6-8937832abfa4 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] No waiting events found dispatching network-vif-unplugged-425ad7c7-90d4-4d00-b524-d76651842a89 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:59.122646 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28265386-2b1e-42fe-93d3-cb91512651d5 req-153606db-ae2c-4c7c-8ca6-8937832abfa4 service nova] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Received event network-vif-unplugged-425ad7c7-90d4-4d00-b524-d76651842a89 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:59.351191 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Successfully updated port: 253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:05:59.369058 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:59.369226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] Acquiring lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:59.369386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:59.369512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:59.370004 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] No waiting events found dispatching network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:05:59.370004 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-unplugged-b7ad965d-b785-4081-aede-59ad6a86188b for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:05:59.370004 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Received event network-vif-deleted-b7ad965d-b785-4081-aede-59ad6a86188b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:05:59.370134 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Neutron deleted interface b7ad965d-b785-4081-aede-59ad6a86188b; detaching it from the instance and deleting it from the info cache
Jun 27 04:05:59.371831 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f57322df-7243-43ad-a9ed-f2daf451c971 req-c4089ccf-d190-458d-8e90-72867fca8674 service nova] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Detach interface failed, port_id=b7ad965d-b785-4081-aede-59ad6a86188b, reason: Instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:05:59.372649 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:59.412164 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:05:59.413935 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:05:59.426292 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:59.428015 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533159.4277525, f2a4a001-7934-403f-9b26-6b4ed727e22f => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:05:59.428261 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Resumed (Lifecycle Event)
Jun 27 04:05:59.443311 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Took 14.95 seconds to build instance.
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:59.447389 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:05:59.455460 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.467756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.474822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.489227 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.497933 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.498743 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:59.563754 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260]
Jun 27 04:05:59.563754 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260] successful.
Jun 27 04:05:59.563754 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.566213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260]
Jun 27 04:05:59.566213 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260] successful.
Jun 27 04:05:59.566213 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.590941 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.598023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.613703 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.614161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:59.614561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.253s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:59.614561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:59.616016 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('11', '-', '-', 0) found on session 21 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:59.616192 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.624343 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:05:59.625358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:05:59.625887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:05:59.627323 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('12', '-', '-', 0) found on session 22 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:05:59.627490 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:05:59.646236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 21 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:59.646236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:59.666520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 22 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:05:59.666520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:05:59.700963 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:05:59.717530 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:05:59.728071 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:05:59.728071 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Creating image(s)
Jun 27 04:05:59.730789 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:59.730982 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:59.732312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:59.736662 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:59.742404 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:59.748594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:59.851265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.103s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:59.852057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:05:59.852348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:05:59.853104 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:59.855163 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-2b2205db-f373-46fc-88c2-414fc5a376e2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:05:59.855369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-2b2205db-f373-46fc-88c2-414fc5a376e2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:05:59.855555 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:05:59.859632 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:05:59.860030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:05:59.886844 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Took 1.79 seconds to deallocate network for instance.
Jun 27 04:05:59.950546 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:05:59.956749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.477s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:05:59.967015 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:05:59.972620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:05:59.975524 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:00.033443 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk 1073741824" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:00.033824 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:00.034385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:00.050155 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.001421201999846744 future=<Future at 0x7ec5381d65d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.050155 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.050613 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.1580485480001244 future=<Future at 0x7ec51873be60 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.050613 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.1578950489999897 future=<Future at 0x7ec51873be60 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.050613 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.050881 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.967089657000088 future=<Future at 0x7ec538318500 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.050881 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.966968275999989 future=<Future at 0x7ec538318500 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:00.052034 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782533145.0483108, c1d90648-3e76-41e4-9f71-9178785a8979 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:00.052034 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] VM Stopped (Lifecycle Event)
Jun 27 04:06:00.059039 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:00.134111 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:00.134606 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:06:00.134921 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:00.207885 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Took 1.93 seconds to deallocate network for instance.
Jun 27 04:06:00.227953 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:00.228612 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Cannot resize image /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:06:00.228954 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:06:00.229105 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Ensure instance console log exists: /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:00.229379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:00.229627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:00.229746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:00.363421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:06:00.403816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:00.404063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:00.492818 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:00.563196 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: c1d90648-3e76-41e4-9f71-9178785a8979] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:00.716405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:00.776974 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:00.979080 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Updating instance_info_cache with network_info: [{"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:00.987265 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-changed-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:00.987524 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Refreshing instance network info cache due to event network-changed-253bf142-4243-4f79-9c0d-0884ae4da836. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:00.989969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] Acquiring lock "refresh_cache-2b2205db-f373-46fc-88c2-414fc5a376e2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:01.142640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:01.143038 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:01.381505 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found WWN 3300000007e545aa9 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:06:01.382094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:01.382467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000007e545aa9', 'path': '/dev/dm-4', 'multipath_id': '3300000007e545aa9'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:01.382767 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007e545aa9', 'path': '/dev/dm-4', 'multipath_id': '3300000007e545aa9'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:06:01.385392 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'flavor' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:01.490678 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-2b2205db-f373-46fc-88c2-414fc5a376e2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:01.490678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Instance network_info: |[{"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:06:01.494086 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Start _get_guest_xml network_info=[{"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:01.494086 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] Acquired lock "refresh_cache-2b2205db-f373-46fc-88c2-414fc5a376e2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:01.494086 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Refreshing network info cache for port 253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:01.500466 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:01.501609 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-825458655', uuid='2b2205db-f373-46fc-88c2-414fc5a376e2'), owner=OwnerMeta(userid='6c2bd621defb420db9fd8345c5b36248', username='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member', projectid='771234de69074fed81ffef19dcee2804', projectname='tempest-ServerBootFromVolumeStableRescueTest-2029132639'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533161.501146) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:01.503929 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:01.504133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:01.505963 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:01.505963 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:01.508360 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:01.509682 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:01.510208 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:01.510345 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:01.510537 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:01.510756 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:01.511700 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:01.512154 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:01.512154 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:01.512730 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:01.512730 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:01.512730 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:01.538915 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-825458655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-825458655',id=13,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-rek1gxiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:59Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=2b2205db-f373-46fc-88c2-414fc5a376e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:01.541039 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:01.542676 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:01.543617 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b2205db-f373-46fc-88c2-414fc5a376e2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:01.646971 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:01.889143 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attempting to attach volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]:   <alias name="ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3"/>
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]:   <serial>0f4c8d2a-5f3d-4903-85de-3f93adcda6a3</serial>
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:06:01.891185 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:06:02.002251 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <uuid>2b2205db-f373-46fc-88c2-414fc5a376e2</uuid>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <name>instance-0000000d</name>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-825458655</nova:name>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:01</nova:creationTime>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:user uuid="6c2bd621defb420db9fd8345c5b36248">tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member</nova:user>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:project uuid="771234de69074fed81ffef19dcee2804">tempest-ServerBootFromVolumeStableRescueTest-2029132639</nova:project>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         <nova:port uuid="253bf142-4243-4f79-9c0d-0884ae4da836">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <entry name="serial">2b2205db-f373-46fc-88c2-414fc5a376e2</entry>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <entry name="uuid">2b2205db-f373-46fc-88c2-414fc5a376e2</entry>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.config"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:b4:7b:38"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <target dev="tap253bf142-42"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/console.log" append="off"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:02.046408 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Preparing to wait for external event network-vif-plugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-825458655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-825458655',id=13,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-rek1gxiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:05:59Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=2b2205db-f373-46fc-88c2-414fc5a376e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:02.050773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:02.052471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:02.052471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b67a655c-f8ef-5a7b-af2f-a20eaf2f4faa', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:02.054190 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:02.054905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:02.057945 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:02.058285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap253bf142-42, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:02.058839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap253bf142-42, col_values=(('qos', UUID('7f5053d6-7966-42c8-8f5c-96a766303ba7')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:02.059444 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap253bf142-42, col_values=(('external_ids', {'iface-id': '253bf142-4243-4f79-9c0d-0884ae4da836', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:7b:38', 'vm-uuid': '2b2205db-f373-46fc-88c2-414fc5a376e2'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:02.062459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:02.068413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:02.068751 np0000003830 nova-compute[98984]: INFO os_vif [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42')
Jun 27 04:06:02.159403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.752s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:02.159403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.442s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:02.251671 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Deleted allocations for instance a7ff3732-e89b-4c07-b215-daac79472845
Jun 27 04:06:02.471846 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:02.720120 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Updated VIF entry in instance network info cache for port 253bf142-4243-4f79-9c0d-0884ae4da836. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:06:02.720565 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Updating instance_info_cache with network_info: [{"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:02.821997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:02.822252 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:03.223323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] Releasing lock "refresh_cache-2b2205db-f373-46fc-88c2-414fc5a376e2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:03.223851 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:03.223851 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing instance network info cache due to event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:03.223966 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:03.224328 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:03.224512 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:03.265057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bae7781-6c43-4c36-b7d5-87929e513d49 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "a7ff3732-e89b-4c07-b215-daac79472845" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.128s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:03.325314 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:03.605946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:03.606114 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:03.606173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No VIF found with MAC fa:16:3e:b4:7b:38, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:03.606617 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Using config drive
Jun 27 04:06:03.609990 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:03.610133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:03.610532 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:03.610532 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No VIF found with MAC fa:16:3e:63:9e:91, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:03.719855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:03.726813 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:03.833380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.675s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:03.862614 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:03.911785 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Deleted allocations for instance 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216
Jun 27 04:06:04.112861 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:04.153179 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:04.330954 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Creating config drive at /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.config
Jun 27 04:06:04.340208 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9vczykb3 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:04.370063 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updated VIF entry in instance network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:06:04.370063 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:04.393367 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9vczykb3" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:04.874367 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4c884bfe-87f3-42c7-9202-d30ab99bdd57 req-059f5adc-a686-4ea6-b809-3b4ba2bfae6e service nova] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:04.923078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c2e387-552c-4c00-aca4-7545f177f2f8 tempest-TestMultiAttachVolumeSwap-2127186776 tempest-TestMultiAttachVolumeSwap-2127186776-project-member] Lock "4e7bc7eb-135e-4f40-8a1c-1a9845dfb216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.618s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:04.939370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:04.982586 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:04.987636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:05.096971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:05.183619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:05.186274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c791c55-da47-4e4e-b407-0a3944dfcc66 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.637s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:05.187038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:05.627101 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45b7b024-6e50-4fdb-bf1b-a63df1ebd048 req-86e672dc-5453-40e5-abe7-94b4d4e455cb service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-plugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:05.627842 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45b7b024-6e50-4fdb-bf1b-a63df1ebd048 req-86e672dc-5453-40e5-abe7-94b4d4e455cb service nova] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:05.629320 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45b7b024-6e50-4fdb-bf1b-a63df1ebd048 req-86e672dc-5453-40e5-abe7-94b4d4e455cb service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:05.629716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45b7b024-6e50-4fdb-bf1b-a63df1ebd048 req-86e672dc-5453-40e5-abe7-94b4d4e455cb service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:05.630974 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45b7b024-6e50-4fdb-bf1b-a63df1ebd048 req-86e672dc-5453-40e5-abe7-94b4d4e455cb service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Processing event network-vif-plugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:06:06.142646 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:06.143425 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533166.1427639, 2b2205db-f373-46fc-88c2-414fc5a376e2 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:06.143425 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] VM Started (Lifecycle Event)
Jun 27 04:06:06.148203 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:06.149156 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Instance spawned successfully.
Jun 27 04:06:06.149156 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:06.653248 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:06.669296 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:06.677038 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:06.677213 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:06.677656 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:06.679801 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:06.680467 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:06.682306 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:07.062927 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:07.173145 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:07.173145 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533167.172713, 2b2205db-f373-46fc-88c2-414fc5a376e2 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:07.173382 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] VM Paused (Lifecycle Event)
Jun 27 04:06:07.189381 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Took 7.47 seconds to spawn the instance on the hypervisor.
Jun 27 04:06:07.189381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:07.199915 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Rebuilding instance
Jun 27 04:06:07.422026 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:07.584308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:07.657999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:07.676381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:07.679219 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533167.6787832, 2b2205db-f373-46fc-88c2-414fc5a376e2 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:07.679396 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] VM Resumed (Lifecycle Event)
Jun 27 04:06:07.707573 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Took 13.35 seconds to build instance.
Jun 27 04:06:07.762792 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dfa98daa-4f2b-4e45-a1da-1847d50c758c req-ab383e3c-4f18-4d97-a53c-0a0c5b7d715a service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-plugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:07.763323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dfa98daa-4f2b-4e45-a1da-1847d50c758c req-ab383e3c-4f18-4d97-a53c-0a0c5b7d715a service nova] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:07.763323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dfa98daa-4f2b-4e45-a1da-1847d50c758c req-ab383e3c-4f18-4d97-a53c-0a0c5b7d715a service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:07.763431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dfa98daa-4f2b-4e45-a1da-1847d50c758c req-ab383e3c-4f18-4d97-a53c-0a0c5b7d715a service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:07.763571 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dfa98daa-4f2b-4e45-a1da-1847d50c758c req-ab383e3c-4f18-4d97-a53c-0a0c5b7d715a service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] No waiting events found dispatching network-vif-plugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:07.763779 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-dfa98daa-4f2b-4e45-a1da-1847d50c758c req-ab383e3c-4f18-4d97-a53c-0a0c5b7d715a service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received unexpected event network-vif-plugged-253bf142-4243-4f79-9c0d-0884ae4da836 for instance with vm_state active and task_state None.
Jun 27 04:06:08.183581 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:08.190117 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:08.214175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c303c3d-0e81-4a4f-a43e-6fd518cf0056 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.875s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:08.462108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.472777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.495239 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.672683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.681535 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.788402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.810537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.833923 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999561592999953 future=<Future at 0x7ec53afd9dc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:08.835811 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance destroyed successfully.
Jun 27 04:06:08.866283 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:08.873778 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7cdeff20-1c94-4eda-a9b2-a6085d4fdc01 req-2777b76e-22c9-45e1-9cdd-3aa5b16c2fa4 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:08.874632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7cdeff20-1c94-4eda-a9b2-a6085d4fdc01 req-2777b76e-22c9-45e1-9cdd-3aa5b16c2fa4 service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:08.874632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7cdeff20-1c94-4eda-a9b2-a6085d4fdc01 req-2777b76e-22c9-45e1-9cdd-3aa5b16c2fa4 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:08.874816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7cdeff20-1c94-4eda-a9b2-a6085d4fdc01 req-2777b76e-22c9-45e1-9cdd-3aa5b16c2fa4 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:08.875098 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7cdeff20-1c94-4eda-a9b2-a6085d4fdc01 req-2777b76e-22c9-45e1-9cdd-3aa5b16c2fa4 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:08.875307 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-7cdeff20-1c94-4eda-a9b2-a6085d4fdc01 req-2777b76e-22c9-45e1-9cdd-3aa5b16c2fa4 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received unexpected event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with vm_state active and task_state rebuilding.
Jun 27 04:06:08.945339 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Detaching volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3
Jun 27 04:06:09.031142 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attempting to driver detach volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 from mountpoint /dev/vdb
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found disk vdb by alias ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Attempting to detach device vdb from instance 9f560b0d-dc54-4d68-a06b-71401abd49eb from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:   <alias name="ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3"/>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:   <serial>0f4c8d2a-5f3d-4903-85de-3f93adcda6a3</serial>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:06:09.047006 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully detached device vdb from instance 9f560b0d-dc54-4d68-a06b-71401abd49eb from the persistent domain config.
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '22')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '21')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538153100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'): ({'sdf'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flush multipath device 3300000007e545aa9 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:06:09.780159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260]
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260]
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== disconnect_volume: return (394ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:09.785567 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:06:10.343981 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.513624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.594556 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance destroyed successfully.
Jun 27 04:06:10.597056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1323519502',display_name='tempest-ServerActionsTestOtherA-server-1695091996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-tempest-common-compute-instance-1323519502',id=11,image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI9xfxfD6g5hHXvRwB1cGd+3Ord0BopOOvhperZGd/ghdEcMyEp1xbdxEVjA/3QZyaRwnT7dLUUdrrnyVKJXYDGNJzWn8jrrRHLF1SlO5BgRPvlwjOpfHMYPHjDmELizw==',key_name='tempest-keypair-625566794',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-830mrx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=9f560b0d-dc54-4d68-a06b-71401abd49eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:10.597457 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:10.598320 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:10.598566 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:10.602003 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.602254 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcae96b34-24, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:10.604219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.609650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:10.609650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.609650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c97a590-9e4e-407e-abc4-bde077aaf3a1) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:10.611100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.611999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:10.613150 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:10.615946 np0000003830 nova-compute[98984]: INFO os_vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24')
Jun 27 04:06:10.618202 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:06:10.618202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:10.618455 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:10.618764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:10.619278 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:06:10.619475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:10.666281 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:10.666872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:06:10.666872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:10.667807 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:06:10.667807 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:10.667807 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:06:10.668063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538152200>, {}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:06:10.669840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Disconnecting from: [] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:06:10.670198 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:10.670198 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== disconnect_volume: return (51ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:10.670577 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:06:10.671152 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Deleting instance files /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb_del
Jun 27 04:06:10.672034 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Deletion of /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb_del complete
Jun 27 04:06:10.769386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:10.769658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:10.847622 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:10.980113 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e15c471e-732c-4181-9487-2c3c39610d55 req-586823c3-a61a-4375-b86f-4057ad8326ed service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:10.980113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e15c471e-732c-4181-9487-2c3c39610d55 req-586823c3-a61a-4375-b86f-4057ad8326ed service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:10.981368 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e15c471e-732c-4181-9487-2c3c39610d55 req-586823c3-a61a-4375-b86f-4057ad8326ed service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:10.981368 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e15c471e-732c-4181-9487-2c3c39610d55 req-586823c3-a61a-4375-b86f-4057ad8326ed service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:10.981368 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e15c471e-732c-4181-9487-2c3c39610d55 req-586823c3-a61a-4375-b86f-4057ad8326ed service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:10.981368 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e15c471e-732c-4181-9487-2c3c39610d55 req-586823c3-a61a-4375-b86f-4057ad8326ed service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received unexpected event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with vm_state active and task_state rebuilding.
Jun 27 04:06:11.272949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:06:11.355539 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] instance snapshotting
Jun 27 04:06:11.496417 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Beginning live snapshot process
Jun 27 04:06:11.693787 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Booting with volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 at /dev/vdb
Jun 27 04:06:11.746856 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:11.762196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:06:11.789387 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:11.829616 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:06:11.829616 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:06:11.842468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:06:11.844176 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:feb4:7b38'] 
Jun 27 04:06:11.844304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:06:11.844600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:06:11.844702 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:11.844998 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updating existing volume attachment record: 11d9f741-d7db-4de8-b9ea-b6210a7230ca {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:06:11.877128 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:11.877592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:11.890040 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:06:11.890350 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Claim successful on node np0000003830
Jun 27 04:06:12.016919 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:12.017150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:12.019946 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0019799719998445653 future=<Future at 0x7ec538318500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.021246 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Emitting event <LifecycleEvent: 1782533157.0177836, a7ff3732-e89b-4c07-b215-daac79472845 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:12.023126 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.023126 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] VM Stopped (Lifecycle Event)
Jun 27 04:06:12.023126 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.1706668179999724 future=<Future at 0x7ec538462570 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.023126 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.1703652599999259 future=<Future at 0x7ec538462570 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.193912 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00047252600006686407 future=<Future at 0x7ec538462570 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.194061 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.194208 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.633286847000136 future=<Future at 0x7ec53afd9dc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.194321 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.633171046000143 future=<Future at 0x7ec53afd9dc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:12.198171 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] Emitting event <LifecycleEvent: 1782533157.1929095, 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:12.198171 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] VM Stopped (Lifecycle Event)
Jun 27 04:06:12.523066 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:06:12.528625 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bcca9959-94aa-4e9b-8838-03fe1e2b47d9 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: a7ff3732-e89b-4c07-b215-daac79472845] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:12.705081 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] [instance: 4e7bc7eb-135e-4f40-8a1c-1a9845dfb216] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:13.029812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:13.132405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:13.147236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json -f qcow2" returned: 0 in 0.117s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:13.149381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:13.252719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:13.253613 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:13.257570 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:13.258213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:13.368930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:13.369637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5db8ad6r/9476d488026d4b56bcced6688042224e.delta 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:13.494046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5db8ad6r/9476d488026d4b56bcced6688042224e.delta 1073741824" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:13.494046 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 27 04:06:13.636122 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:13.670178 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:13.670657 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:13.833691 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:06:13.841570 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 27 04:06:13.868869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:13.925822 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:06:13.926220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5db8ad6r/9476d488026d4b56bcced6688042224e.delta /opt/stack/data/nova/instances/snapshots/tmp5db8ad6r/9476d488026d4b56bcced6688042224e {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:14.017025 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:06:14.017290 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Creating image(s)
Jun 27 04:06:14.017962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:14.018282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:14.018891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:14.019247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "595c370a5a17abc8a639741c588788f5798dc927" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:14.027177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "595c370a5a17abc8a639741c588788f5798dc927" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.008s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:14.175450 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:14.275227 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5db8ad6r/9476d488026d4b56bcced6688042224e.delta /opt/stack/data/nova/instances/snapshots/tmp5db8ad6r/9476d488026d4b56bcced6688042224e" returned: 0 in 0.349s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:14.275886 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Snapshot extracted, beginning image upload
Jun 27 04:06:14.686964 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.808s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:14.686964 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:06:14.704863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.559s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:14.704863 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:06:14.704863 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Claim successful on node np0000003830
Jun 27 04:06:15.088762 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:15.092024 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:15.092425 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:15.183315 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.part --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:15.183858 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] 45a2fcb3-a65c-47e5-9cfb-4f177d29598e was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:06:15.184573 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:06:15.184938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.part /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:15.199381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:06:15.208854 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:06:15.211037 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:15.211461 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:15.473138 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbf0c322917e4ba7bcc7ea1f87d988dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf5d509927f4ab2983be169557da9f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:06:15.611231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:15.712823 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:06:15.988146 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:16.220070 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:06:16.409023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.part /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.converted" returned: 0 in 1.224s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:16.418939 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.455073 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:16.456166 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:16.547947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927.converted --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:16.547947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "595c370a5a17abc8a639741c588788f5798dc927" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.501s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:16.547947 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:16.547947 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:16.547947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.628564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927 --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:16.628564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "595c370a5a17abc8a639741c588788f5798dc927" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:16.628564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "595c370a5a17abc8a639741c588788f5798dc927" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:16.630537 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:16.645249 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:16.645249 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.725142 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Booting with volume 81413347-a5d7-4f6a-89bf-c25380d721df at /dev/vda
Jun 27 04:06:16.742453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:16.742453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927,backing_fmt=raw /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.820773 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:16.821584 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927,backing_fmt=raw /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk 1073741824" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:16.823647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "595c370a5a17abc8a639741c588788f5798dc927" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:16.823647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.842068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:06:16.858217 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Successfully created port: 5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:06:16.881627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.916991 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:06:16.917643 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:06:16.928076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:06:16.931108 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:feb4:7b38'] 
Jun 27 04:06:16.931234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:06:16.931397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:06:16.932909 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:16.933532 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Updating existing volume attachment record: b97c93a7-1db9-4183-a462-a2aebd1c20f3 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:06:16.936832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/595c370a5a17abc8a639741c588788f5798dc927 --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:16.937635 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:06:16.938104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:16.964325 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:17.045988 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:17.049677 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Cannot resize image /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:06:17.049677 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:06:17.049677 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Ensure instance console log exists: /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:17.050237 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:17.050627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:17.050886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:17.054143 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Start _get_guest_xml network_info=[{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-27T04:01:43Z,direct_url=<?>,disk_format='qcow2',id=45a2fcb3-a65c-47e5-9cfb-4f177d29598e,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-27T04:01:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '11d9f741-d7db-4de8-b9ea-b6210a7230ca', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9f560b0d-dc54-4d68-a06b-71401abd49eb', 'attached_at': '', 'detached_at': '', 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'serial': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:17.061602 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jun 27 04:06:17.062606 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='45a2fcb3-a65c-47e5-9cfb-4f177d29598e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1695091996', uuid='9f560b0d-dc54-4d68-a06b-71401abd49eb'), owner=OwnerMeta(userid='ebb2d09351b2447bbfce95b09ad97b23', username='tempest-ServerActionsTestOtherA-1390022329-project-member', projectid='4b76ce35cec84d189228639d70c6be45', projectname='tempest-ServerActionsTestOtherA-1390022329'), image=ImageMeta(id='45a2fcb3-a65c-47e5-9cfb-4f177d29598e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533177.0617323) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:17.067056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:17.067472 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:17.068586 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:17.068834 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:17.069916 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:17.070276 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-27T04:01:43Z,direct_url=<?>,disk_format='qcow2',id=45a2fcb3-a65c-47e5-9cfb-4f177d29598e,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-27T04:01:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:17.071483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:17.072158 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:17.072366 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:17.072550 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:17.072810 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:17.479745 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Snapshot image upload complete
Jun 27 04:06:17.480148 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9282d97e-f4be-4ec2-9428-8eaade0fa766 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Took 6.12 seconds to snapshot the instance on the hypervisor.
Jun 27 04:06:17.498930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.809s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:17.499139 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:06:17.587608 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:06:17.588329 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:17.588329 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:17.588529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:17.588849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:06:17.600744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:17.601204 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:17.601934 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:17.602283 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:17.602678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:17.602873 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:17.615371 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:17.615371 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:17.632516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:17.632516 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3] added
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:17.641721 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:17.642294 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3] added
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:17.649255 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:17.649655 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:17.649655 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0466(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:17.649839 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:18.011475 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:06:18.011475 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:06:18.011475 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:18.011475 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:18.128236 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7132d5dcadb043838976141746b8a26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a05730e4d204004b6dbe4c1389b8397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:06:18.155175 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:18.506361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:18.516867 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:06:18.642648 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:18.650967 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:18.661906 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:18.673883 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:18.682158 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:18.691757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.703997 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.704861 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.714227 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.721719 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:18.770370 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260]
Jun 27 04:06:18.770370 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:18.770370 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:18.787215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:18.813815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:18.817916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('11', '-', '-', 0) found on session 25 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:18.817916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:18.860735 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 25 and hctl ['11', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:18.873483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:18.887409 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Successfully updated port: 5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:06:18.983930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-changed-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:18.983930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Refreshing instance network info cache due to event network-changed-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:18.984099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] Acquiring lock "refresh_cache-2f06654b-01a1-42d8-bcbc-ac8cd4f54748" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:18.984525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] Acquired lock "refresh_cache-2f06654b-01a1-42d8-bcbc-ac8cd4f54748" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:18.984525 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Refreshing network info cache for port 5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:19.019911 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:06:19.061213 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Successfully created port: 391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:06:19.266322 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:06:19.268046 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:06:19.268046 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Creating image(s)
Jun 27 04:06:19.269340 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:06:19.269340 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Ensure instance console log exists: /opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:19.270396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:19.271523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:19.272220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:19.390887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "refresh_cache-2f06654b-01a1-42d8-bcbc-ac8cd4f54748" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:19.490126 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:19.525129 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Booting with volume 699fda4a-1d32-4e5c-88bb-8d412310cf13 at /dev/vda
Jun 27 04:06:19.581191 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:19.598990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:06:19.605552 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:19.625210 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:19.658872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:06:19.659590 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:06:19.673577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:06:19.677684 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe7d:307d', 'fe80::fc16:3eff:fe03:a7ea', 'fe80::34c7:cff:fe5c:6adf', 'fe80::fc16:3eff:fe46:623c', 'fe80::fc16:3eff:fe99:58e6', 'fe80::fc16:3eff:fe9e:c184', 'fe80::fc16:3eff:fe43:7e69', 'fe80::fc16:3eff:fe46:6c7a', 'fe80::68e4:8ff:fef1:1392', 'fe80::7030:fdff:fedc:6329', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:feb4:7b38'] 
Jun 27 04:06:19.677684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:06:19.677684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:06:19.677971 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:19.678394 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Updating existing volume attachment record: f42eada5-a788-4638-8671-2bbe2226e012 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:06:19.780917 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260]
Jun 27 04:06:19.780917 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:19.780917 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:19.796169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:19.819996 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:19.822675 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:19.823856 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:19.824350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.222s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:19.825732 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:19.827320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('12', '-', '-', 0) found on session 26 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:19.827428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:19.854306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 25 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:19.855258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:19.859989 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 26 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:19.932993 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Successfully updated port: 391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:06:20.009966 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-changed-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:20.009966 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Refreshing instance network info cache due to event network-changed-391135c1-35b6-4234-b241-4376de6f6fe6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:20.010570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] Acquiring lock "refresh_cache-a243ff55-7b82-43af-a0b8-158eb4b8d030" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:20.010845 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] Acquired lock "refresh_cache-a243ff55-7b82-43af-a0b8-158eb4b8d030" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:20.011058 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Refreshing network info cache for port 391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:20.326129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fa6da9e4-2c18-4470-b0c3-8f009879a277 req-89f78e74-abbe-4c77-8400-d316491b54d2 service nova] Releasing lock "refresh_cache-2f06654b-01a1-42d8-bcbc-ac8cd4f54748" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:20.326979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquired lock "refresh_cache-2f06654b-01a1-42d8-bcbc-ac8cd4f54748" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:20.327179 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:20.436990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-a243ff55-7b82-43af-a0b8-158eb4b8d030" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:20.516620 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:20.616391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:20.626978 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:20.798532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:20.800290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:20.832388 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:20.832388 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 27 04:06:20.860516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 26 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:20.865860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:20.894925 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:20.935349 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:21.143933 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:21.306757 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:06:21.332864 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Updating instance_info_cache with network_info: [{"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:21.338001 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] There are 0 instances to clean {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 27 04:06:21.341935 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:21.341935 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=98984) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 27 04:06:21.399488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2a807a2-445d-44c0-9800-257d9e0eac36 req-c25312f4-8d90-4070-8b39-68a3f230b871 service nova] Releasing lock "refresh_cache-a243ff55-7b82-43af-a0b8-158eb4b8d030" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:21.399989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-a243ff55-7b82-43af-a0b8-158eb4b8d030" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:21.399989 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:21.624730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found WWN 3300000007e545aa9 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:06:21.625150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.036s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:21.625291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== connect_volume: return (4036ms) {'type': 'block', 'scsi_wwn': '3300000007e545aa9', 'path': '/dev/dm-4', 'multipath_id': '3300000007e545aa9'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:21.625519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007e545aa9', 'path': '/dev/dm-4', 'multipath_id': '3300000007e545aa9'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:06:21.841803 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:06:21.844434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Releasing lock "refresh_cache-2f06654b-01a1-42d8-bcbc-ac8cd4f54748" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:21.844967 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Instance network_info: |[{"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:06:21.845606 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:21.848325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Start _get_guest_xml network_info=[{"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'b97c93a7-1db9-4183-a462-a2aebd1c20f3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2f06654b-01a1-42d8-bcbc-ac8cd4f54748', 'attached_at': '', 'detached_at': '', 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'serial': '81413347-a5d7-4f6a-89bf-c25380d721df'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:21.853946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:06:21.859744 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Creating image(s)
Jun 27 04:06:21.860057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:06:21.860057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Ensure instance console log exists: /opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:21.860247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:21.860461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:21.860670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:21.861938 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:21.863651 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='2f06654b-01a1-42d8-bcbc-ac8cd4f54748'), owner=OwnerMeta(userid='dbf0c322917e4ba7bcc7ea1f87d988dd', username='tempest-ImageDependencyTests-15655490-project-member', projectid='4cf5d509927f4ab2983be169557da9f2', projectname='tempest-ImageDependencyTests-15655490'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533181.8630974) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:21.868162 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:21.868162 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:21.874520 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:21.874520 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:21.875280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:21.879292 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:21.879738 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:21.880700 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:21.881041 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:21.881321 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:21.881798 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:21.881989 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:21.882239 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:21.882470 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:21.882650 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:21.882820 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:21.902065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:06:21.904199 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:21.904629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:21.907049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:21.907281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:21.912186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:21.913213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:06:21.917272 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:06:21.917272 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Claim successful on node np0000003830
Jun 27 04:06:21.931386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:21.932549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:21.934299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:21.935855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:21.936027 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:21.936363 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:21.952785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:21.952785 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:21.960701 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:21.960701 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df] added
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:21.968552 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:21.968887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:21.969047 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:21.969246 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df] added
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:21.975840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:21.976112 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0405(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:21.976182 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:21.979011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.015538 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:22.139105 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1323519502',display_name='tempest-ServerActionsTestOtherA-server-1695091996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-tempest-common-compute-instance-1323519502',id=11,image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI9xfxfD6g5hHXvRwB1cGd+3Ord0BopOOvhperZGd/ghdEcMyEp1xbdxEVjA/3QZyaRwnT7dLUUdrrnyVKJXYDGNJzWn8jrrRHLF1SlO5BgRPvlwjOpfHMYPHjDmELizw==',key_name='tempest-keypair-625566794',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-830mrx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=9f560b0d-dc54-4d68-a06b-71401abd49eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:22.139105 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:22.139105 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <uuid>9f560b0d-dc54-4d68-a06b-71401abd49eb</uuid>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <name>instance-0000000b</name>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherA-server-1695091996</nova:name>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:17</nova:creationTime>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:image uuid="45a2fcb3-a65c-47e5-9cfb-4f177d29598e">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:user uuid="ebb2d09351b2447bbfce95b09ad97b23">tempest-ServerActionsTestOtherA-1390022329-project-member</nova:user>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:project uuid="4b76ce35cec84d189228639d70c6be45">tempest-ServerActionsTestOtherA-1390022329</nova:project>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="45a2fcb3-a65c-47e5-9cfb-4f177d29598e"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         <nova:port uuid="cae96b34-24ed-4e2c-bbb8-8659432395f6">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <entry name="serial">9f560b0d-dc54-4d68-a06b-71401abd49eb</entry>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <entry name="uuid">9f560b0d-dc54-4d68-a06b-71401abd49eb</entry>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <alias name="ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-4"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <serial>0f4c8d2a-5f3d-4903-85de-3f93adcda6a3</serial>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:63:9e:91"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <target dev="tapcae96b34-24"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/console.log" append="off"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:22.141615 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:22.147428 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1323519502',display_name='tempest-ServerActionsTestOtherA-server-1695091996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-tempest-common-compute-instance-1323519502',id=11,image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI9xfxfD6g5hHXvRwB1cGd+3Ord0BopOOvhperZGd/ghdEcMyEp1xbdxEVjA/3QZyaRwnT7dLUUdrrnyVKJXYDGNJzWn8jrrRHLF1SlO5BgRPvlwjOpfHMYPHjDmELizw==',key_name='tempest-keypair-625566794',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-830mrx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=9f560b0d-dc54-4d68-a06b-71401abd49eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:22.147428 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:22.148440 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:22.148440 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:22.148440 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.149226 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:22.149447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:22.154319 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.154607 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e517e3c-27b5-5b58-a196-7856a5b79b44', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:22.155385 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.157909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:22.160518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.160773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcae96b34-24, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:22.163642 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcae96b34-24, col_values=(('qos', UUID('cc6c4d7f-62f3-4f8f-8066-21aa7cfba94b')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:22.163884 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcae96b34-24, col_values=(('external_ids', {'iface-id': 'cae96b34-24ed-4e2c-bbb8-8659432395f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:9e:91', 'vm-uuid': '9f560b0d-dc54-4d68-a06b-71401abd49eb'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:22.165128 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.171585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:22.173063 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:22.175322 np0000003830 nova-compute[98984]: INFO os_vif [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24')
Jun 27 04:06:22.257417 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:22.352207 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:06:22.482975 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Updating instance_info_cache with network_info: [{"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:22.971947 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:22.976745 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:22.988525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-a243ff55-7b82-43af-a0b8-158eb4b8d030" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:22.988525 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Instance network_info: |[{"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:06:22.990445 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Start _get_guest_xml network_info=[{"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'f42eada5-a788-4638-8671-2bbe2226e012', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a243ff55-7b82-43af-a0b8-158eb4b8d030', 'attached_at': '', 'detached_at': '', 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'serial': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'multiattach': True}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:22.992256 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:22.995315 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1972415158', uuid='a243ff55-7b82-43af-a0b8-158eb4b8d030'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533182.996217) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:22.998474 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.002373 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:23.003874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:23.005797 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:23.006212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:23.007382 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:23.008287 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:23.008287 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:23.008287 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:23.008287 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:23.008617 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:23.008617 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:23.008749 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:23.009069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.010183 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:23.010183 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:23.010183 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:23.010183 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:23.019357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.032270 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:06:23.032972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.034525 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.047904 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.048354 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:23.095410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.50.100,3260]
Jun 27 04:06:23.095410 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:23.095410 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.106846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.112699 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.40.100,3260]
Jun 27 04:06:23.112699 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:23.112699 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.127202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.132423 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.133281 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:23.133784 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:23.133940 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:23.139064 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] HCTL ('17', '-', '-', 0) found on session 27 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:23.139216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.149598 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:23.150109 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:23.150469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:23.150469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:23.152301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] HCTL ('18', '-', '-', 0) found on session 28 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:23.152301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:23.159242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Searching for a device in session 27 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:23.159242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:23.177446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Searching for a device in session 28 and hctl ['18', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:23.354296 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:23.355170 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:23.355980 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.47 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:06:23.584287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:23.584287 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:23.708007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:23.708130 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:23.708205 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:23.708370 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No VIF found with MAC fa:16:3e:63:9e:91, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:23.708891 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Using config drive
Jun 27 04:06:23.827925 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000434189999850787 future=<Future at 0x7ec53afd9dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:23.828072 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:23.828533 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Emitting event <LifecycleEvent: 1782533168.827348, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:23.828932 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Stopped (Lifecycle Event)
Jun 27 04:06:23.830471 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:23.831486 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:23.874828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:24.087481 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:24.177805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Searching for a device in session 28 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:24.177913 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:24.212044 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'ec2_ids' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:24.331928 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:24.333680 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:24.336150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:24.336842 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:24.595194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.688s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:24.595881 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:06:24.600077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.264s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:24.600315 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:24.600595 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:06:24.716309 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Object Instance<9f560b0d-dc54-4d68-a06b-71401abd49eb> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:24.717270 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'keypairs' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:24.839740 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jun 27 04:06:24.953167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Found WWN 33000000000ff7b46 for multipath device dm-7 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:06:24.953167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:24.953167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '33000000000ff7b46', 'path': '/dev/dm-7', 'multipath_id': '33000000000ff7b46'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:24.953167 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000000ff7b46', 'path': '/dev/dm-7', 'multipath_id': '33000000000ff7b46'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:06:24.953554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.920s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:24.953782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:06:24.966480 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:24.967270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:24.967769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:24.968054 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:24.969014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:24.969014 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:24.985801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:24.985801 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:24.993200 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:24.993200 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13] added
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:25.001887 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:25.002226 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:25.002597 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:25.002805 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13] added
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:25.006486 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:25.105466 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:06:25.108982 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:06:25.108982 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:25.108982 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:25.201442 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2bd621defb420db9fd8345c5b36248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '771234de69074fed81ffef19dcee2804', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:06:25.221092 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Object Instance<9f560b0d-dc54-4d68-a06b-71401abd49eb> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:25.228393 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
Jun 27 04:06:25.449580 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Creating config drive at /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config
Jun 27 04:06:25.458005 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbabiz2ba {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:25.474444 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='instance-depend-image',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cf5d509927f4ab2983be169557da9f2',ramdisk_id='',reservation_id='r-60siwnfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-15655490',owner_user_name='tempest-ImageDependencyTests-15655490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:16Z,user_data=None,user_id='dbf0c322917e4ba7bcc7ea1f87d988dd',uuid=2f06654b-01a1-42d8-bcbc-ac8cd4f54748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:25.475088 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Converting VIF {"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:25.477236 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:25.479055 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:25.516190 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbabiz2ba" returned: 0 in 0.058s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:25.609821 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:06:25.663447 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:25.773583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:25.775133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:25.883858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:25.894382 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Successfully created port: 513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:06:25.897378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:06:25.897778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:06:25.897948 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-5 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:06:25.901949 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:06:25.904306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:25.924933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <uuid>2f06654b-01a1-42d8-bcbc-ac8cd4f54748</uuid>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <name>instance-0000000e</name>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:name>instance-depend-image</nova:name>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:21</nova:creationTime>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:properties/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:user uuid="dbf0c322917e4ba7bcc7ea1f87d988dd">tempest-ImageDependencyTests-15655490-project-member</nova:user>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:project uuid="4cf5d509927f4ab2983be169557da9f2">tempest-ImageDependencyTests-15655490</nova:project>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         <nova:port uuid="5e3755fe-37b1-4ae3-93e7-1ee8c73e04df">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="192.168.233.119" ipVersion="4"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <entry name="serial">2f06654b-01a1-42d8-bcbc-ac8cd4f54748</entry>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <entry name="uuid">2f06654b-01a1-42d8-bcbc-ac8cd4f54748</entry>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748/disk.config"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <alias name="ua-81413347-a5d7-4f6a-89bf-c25380d721df"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-7"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <serial>81413347-a5d7-4f6a-89bf-c25380d721df</serial>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:e6:71:dc"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <target dev="tap5e3755fe-37"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748/console.log" append="off"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:25.986526 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Preparing to wait for external event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='instance-depend-image',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4cf5d509927f4ab2983be169557da9f2',ramdisk_id='',reservation_id='r-60siwnfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-15655490',owner_user_name='tempest-ImageDependencyTests-15655490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:16Z,user_data=None,user_id='dbf0c322917e4ba7bcc7ea1f87d988dd',uuid=2f06654b-01a1-42d8-bcbc-ac8cd4f54748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Converting VIF {"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:25.990409 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:25.990790 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:25.991318 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:25.992753 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:25.993081 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:25.996770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:25.997033 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23ecae7f-2390-52aa-b21d-60f851c65bd3', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:25.998192 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:25.999003 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:26.003411 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:26.006707 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.007617 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:26.009621 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.009928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e3755fe-37, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:26.010351 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e3755fe-37, col_values=(('qos', UUID('d3fbccd4-45e2-4a20-97d7-6c9910f1f7ee')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:26.011333 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e3755fe-37, col_values=(('external_ids', {'iface-id': '5e3755fe-37b1-4ae3-93e7-1ee8c73e04df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:71:dc', 'vm-uuid': '2f06654b-01a1-42d8-bcbc-ac8cd4f54748'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:26.013598 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.015952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:26.022324 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.024169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.024392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.040564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:26.048358 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.050555 np0000003830 nova-compute[98984]: INFO os_vif [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37')
Jun 27 04:06:26.054124 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.065232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.083821 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.084207 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:26.087767 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.100132 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:26.116331 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:06:26.135975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.156250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.50.100,3260]
Jun 27 04:06:26.156250 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:26.156250 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.164572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.40.100,3260]
Jun 27 04:06:26.164572 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:26.164572 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.164572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.171768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.172441 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.192349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.209011 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.211958 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:26.212796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:26.213129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.220898 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:26.222789 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:26.223184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.255s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:26.223538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:26.227070 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('19', '-', '-', 0) found on session 29 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:26.227070 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:26.227332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('20', '-', '-', 0) found on session 30 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:26.227482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 29 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 30 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.287291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.319438 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.331572 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:26.387152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.393057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.484195 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d84074f7-2a85-407d-af58-58fb40a590e6 req-5b0f4186-ecea-492c-8b8b-b99d9df6802f service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:26.485059 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d84074f7-2a85-407d-af58-58fb40a590e6 req-5b0f4186-ecea-492c-8b8b-b99d9df6802f service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:26.485967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d84074f7-2a85-407d-af58-58fb40a590e6 req-5b0f4186-ecea-492c-8b8b-b99d9df6802f service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:26.485967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d84074f7-2a85-407d-af58-58fb40a590e6 req-5b0f4186-ecea-492c-8b8b-b99d9df6802f service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:26.485967 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d84074f7-2a85-407d-af58-58fb40a590e6 req-5b0f4186-ecea-492c-8b8b-b99d9df6802f service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:26.488664 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d84074f7-2a85-407d-af58-58fb40a590e6 req-5b0f4186-ecea-492c-8b8b-b99d9df6802f service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received unexpected event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with vm_state active and task_state rebuild_spawning.
Jun 27 04:06:26.508986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.508986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.628144 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Booting with volume-backed-image ebd84a34-fa18-42ad-a673-89aa8032841e at /dev/vda
Jun 27 04:06:26.638937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.647713 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.781037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.781621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.887869 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.888514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:06:26.894974 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:26.896832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:26.943475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:26.943475 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51023MB free_disk=74.23744583129883GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:06:26.943984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:26.943984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:26.968868 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:06:27.157885 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Successfully updated port: 513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:06:27.385941 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533187.3854268, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:27.387950 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:27.388093 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Resumed (Lifecycle Event)
Jun 27 04:06:27.389229 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:27.395988 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance spawned successfully.
Jun 27 04:06:27.396382 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:27.594183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:27.594183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:27.594183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] No VIF found with MAC fa:16:3e:e6:71:dc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:27.594183 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Using config drive
Jun 27 04:06:27.661804 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:27.661936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:27.662094 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:27.893663 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:27.899023 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:27.905937 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:27.906068 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:27.906509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:27.906905 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:27.907282 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:27.907597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:27.998325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000ff7f258d for multipath device dm-8 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:06:27.998325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:27.998325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (4961ms) {'type': 'block', 'scsi_wwn': '330000000ff7f258d', 'path': '/dev/dm-8', 'multipath_id': '330000000ff7f258d'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:27.998325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ff7f258d', 'path': '/dev/dm-8', 'multipath_id': '330000000ff7f258d'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:06:28.069599 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6ce1c75a-8520-40b5-a060-9580f2f789ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.069806 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 99670311-67bb-4d60-b854-655dc01f2722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.070355 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 0bdb15c0-e951-4850-963b-2439b99b93f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 58490b25-bc9d-4a48-aff3-3eb967088bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 9f560b0d-dc54-4d68-a06b-71401abd49eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f2a4a001-7934-403f-9b26-6b4ed727e22f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 2b2205db-f373-46fc-88c2-414fc5a376e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6a29bf7b-b8b2-41df-b546-800f5174319a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:06:28.073439 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2432MB phys_disk=95GB used_disk=5GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:06:26 up 29 min,  2 users,  load average: 11.23, 5.82, 2.71\n', 'num_instances': '10', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '10', 'num_proj_771234de69074fed81ffef19dcee2804': '4', 'io_workload': '3', 'num_proj_4b76ce35cec84d189228639d70c6be45': '2', 'num_proj_97026720e5114b53a1aa2cd0d93104ea': '1', 'num_task_rebuild_spawning': '1', 'num_proj_469d72ff5a3640dbb2193b8a91deeac0': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_4cf5d509927f4ab2983be169557da9f2': '1', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '1', 'num_task_block_device_mapping': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:06:28.102549 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:28.112050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:28.112050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:28.112050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:28.112610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:28.112610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:28.121043 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Terminating instance
Jun 27 04:06:28.317192 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:28.354268 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Creating config drive at /opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748/disk.config
Jun 27 04:06:28.361720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1huoe8jt {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:28.408119 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jun 27 04:06:28.414892 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533188.4144878, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:28.416050 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Started (Lifecycle Event)
Jun 27 04:06:28.417465 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:28.427288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1huoe8jt" returned: 0 in 0.066s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:28.443474 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.511023 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1972415158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumemultiattachtest-server-1972415158',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-hlpugoq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:19Z,user_data=None,user_id='7132d5dcadb043838976141746b8a26a',uuid=a243ff55-7b82-43af-a0b8-158eb4b8d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:28.511804 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:28.512679 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:28.513925 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'pci_devices' on Instance uuid a243ff55-7b82-43af-a0b8-158eb4b8d030 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:28.577136 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:28.577379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:28.577604 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:28.578395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:28.581883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:28.582056 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received unexpected event network-vif-plugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with vm_state active and task_state None.
Jun 27 04:06:28.582214 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-changed-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:28.582347 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Refreshing instance network info cache due to event network-changed-513ca15c-8969-4cfb-a8fc-b778700527e3. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:28.582515 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] Acquiring lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:28.620184 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:06:28.645693 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:28.661766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.666601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.702463 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.731952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.748081 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.757924 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.858304 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.886252 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updating instance_info_cache with network_info: [{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:28.929293 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:28.944923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:28.947990 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:28.961771 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.969850 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:28.974112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <uuid>a243ff55-7b82-43af-a0b8-158eb4b8d030</uuid>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <name>instance-0000000f</name>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1972415158</nova:name>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:22</nova:creationTime>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         <nova:port uuid="391135c1-35b6-4234-b241-4376de6f6fe6">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <entry name="serial">a243ff55-7b82-43af-a0b8-158eb4b8d030</entry>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <entry name="uuid">a243ff55-7b82-43af-a0b8-158eb4b8d030</entry>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030/disk.config"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <alias name="ua-699fda4a-1d32-4e5c-88bb-8d412310cf13"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-8"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <serial>699fda4a-1d32-4e5c-88bb-8d412310cf13</serial>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <shareable/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:29:7f:60"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <target dev="tap391135c1-35"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030/console.log" append="off"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:29.018834 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:29.022677 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Preparing to wait for external event network-vif-plugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:06:29.022677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:29.022677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:29.022677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:29.022677 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1972415158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumemultiattachtest-server-1972415158',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-hlpugoq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:19Z,user_data=None,user_id='7132d5dcadb043838976141746b8a26a',uuid=a243ff55-7b82-43af-a0b8-158eb4b8d030,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:29.023665 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:29.023665 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:29.023880 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:29.024528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.025078 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:29.025329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:29.028784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.028784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '232dfd3b-ea82-5f84-872d-3b42af47f304', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:29.030668 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.030668 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:29.031893 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:29.032180 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:29.034375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.057681 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.131308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.136155 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.136692 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391135c1-35, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:29.137119 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391135c1-35, col_values=(('qos', UUID('2a7e2916-d11a-477c-87b4-29381b540899')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:29.137311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391135c1-35, col_values=(('external_ids', {'iface-id': '391135c1-35b6-4234-b241-4376de6f6fe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:7f:60', 'vm-uuid': 'a243ff55-7b82-43af-a0b8-158eb4b8d030'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:29.140346 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.140346 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:29.175640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.309202 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.314718 np0000003830 nova-compute[98984]: INFO os_vif [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35')
Jun 27 04:06:29.388538 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:29.389160 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance network_info: |[{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:06:29.389160 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] Acquired lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:29.390206 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Refreshing network info cache for port 513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:29.522122 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999487891999934 future=<Future at 0x7ec53831adb0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:29.522781 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998929288 future=<Future at 0x7ec53831adb0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:29.522781 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998749361999899 future=<Future at 0x7ec53831adb0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:29.525828 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Instance destroyed successfully.
Jun 27 04:06:29.527574 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lazy-loading 'resources' on Instance uuid 0bdb15c0-e951-4850-963b-2439b99b93f7 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:29.536859 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:29.758793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6b99825a-bf61-4cb6-b84c-3dd168da5182 req-f455e4c3-9b33-4ff5-a802-0c8d9963804b service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:29.758793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6b99825a-bf61-4cb6-b84c-3dd168da5182 req-f455e4c3-9b33-4ff5-a802-0c8d9963804b service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:29.758793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6b99825a-bf61-4cb6-b84c-3dd168da5182 req-f455e4c3-9b33-4ff5-a802-0c8d9963804b service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:29.758793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6b99825a-bf61-4cb6-b84c-3dd168da5182 req-f455e4c3-9b33-4ff5-a802-0c8d9963804b service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:29.758793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6b99825a-bf61-4cb6-b84c-3dd168da5182 req-f455e4c3-9b33-4ff5-a802-0c8d9963804b service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:29.758793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6b99825a-bf61-4cb6-b84c-3dd168da5182 req-f455e4c3-9b33-4ff5-a802-0c8d9963804b service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-34c66af1-878e-42c8-ab08-32e34e085f38 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:29.812945 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.833371 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:29.898122 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:29.964057 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.026887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.047882 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.047882 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "address": "fa:16:3e:7d:30:7d", "network": {"id": "7a465de4-e86c-4478-a764-ce8c32d87530", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-237166004-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb889b1b6-e6", "ovs_interfaceid": "b889b1b6-e646-47d0-a58a-deb2c27cb567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.047882 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.047882 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.047882 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.047882 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb889b1b6-e6, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.052690 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:06:30.052690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.108s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:30.052690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.061435 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.061435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.112s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:30.061435 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:06:30.061435 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98984) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
Jun 27 04:06:30.123890 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.178573 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.185381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.185381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a87a932-9aec-454b-a43f-21fc464d22f2) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.185381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.185381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.243878 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.247622 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=b889b1b6-e646-47d0-a58a-deb2c27cb567,network=Network(7a465de4-e86c-4478-a764-ce8c32d87530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb889b1b6-e6')
Jun 27 04:06:30.249855 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.249855 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "34c66af1-878e-42c8-ab08-32e34e085f38", "address": "fa:16:3e:03:a7:ea", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34c66af1-87", "ovs_interfaceid": "34c66af1-878e-42c8-ab08-32e34e085f38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.251358 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.257135 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.258649 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.258649 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34c66af1-87, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.262084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.263343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.306599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.307635 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.307869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9d69c51-cd46-480b-88e1-7e4e88141df5) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.309333 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.310229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.355033 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.360294 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a7:ea,bridge_name='br-int',has_traffic_filtering=True,id=34c66af1-878e-42c8-ab08-32e34e085f38,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34c66af1-87')
Jun 27 04:06:30.363525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.363525 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "address": "fa:16:3e:46:62:3c", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c0ad82-96", "ovs_interfaceid": "e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.363525 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.363525 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.364968 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.365367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4c0ad82-96, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.370149 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.371836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.416849 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.419538 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.419713 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=276631e2-d0d7-49c5-8fd1-863df66946b7) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.421869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.423434 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.460842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.465179 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:62:3c,bridge_name='br-int',has_traffic_filtering=True,id=e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape4c0ad82-96')
Jun 27 04:06:30.465179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.465179 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "address": "fa:16:3e:99:58:e6", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4345c6-eb", "ovs_interfaceid": "8e4345c6-eb4c-4b2e-8017-7bd5340110a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.467210 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.467354 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.468390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.468639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e4345c6-eb, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.470010 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.472272 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.501204 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.504179 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.504475 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36de346b-f3a4-4063-9f99-3f277be4f622) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.510809 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.510809 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.536310 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.542941 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:58:e6,bridge_name='br-int',has_traffic_filtering=True,id=8e4345c6-eb4c-4b2e-8017-7bd5340110a6,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4345c6-eb')
Jun 27 04:06:30.544638 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.547864 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "2a748cfd-0098-4b02-ae17-e5818b112843", "address": "fa:16:3e:9e:c1:84", "network": {"id": "a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e", "bridge": "br-int", "label": "tempest-device-tagging-net1-56417016", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a748cfd-00", "ovs_interfaceid": "2a748cfd-0098-4b02-ae17-e5818b112843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.548097 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.548406 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.552075 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.552772 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a748cfd-00, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.556074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.556074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.576654 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.581418 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.582660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c333f1f6-1616-4d2f-ad8c-ac212b78addd) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.586939 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.586939 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.602658 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.609268 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:c1:84,bridge_name='br-int',has_traffic_filtering=True,id=2a748cfd-0098-4b02-ae17-e5818b112843,network=Network(a6a0bfbe-e3e5-4ac5-bb98-f0fa4310313e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a748cfd-00')
Jun 27 04:06:30.610198 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.610673 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "752f568e-442f-482f-bee6-23258b2a5023", "address": "fa:16:3e:43:7e:69", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap752f568e-44", "ovs_interfaceid": "752f568e-442f-482f-bee6-23258b2a5023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.612295 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.612295 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.613134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.613475 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap752f568e-44, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.615455 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.618653 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.642604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.645336 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.645336 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67ca67fc-e81a-4025-a9cb-bc106613e75a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.653097 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.653649 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.669240 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.672182 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:7e:69,bridge_name='br-int',has_traffic_filtering=True,id=752f568e-442f-482f-bee6-23258b2a5023,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap752f568e-44')
Jun 27 04:06:30.672919 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131578094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-131578094',id=8,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdyUh0hPF+bT4SSxNwo7rGn4PekiV6gzTZS+2JwMPfIzGSf6hUu2NK2X6Bg9zbQCXtBpIKp3bC6Y8dFrwnJHeO5LDtviZiFjqSMpt8f8Mjf0x+flaP2zpfDuTsY9E/SGQ==',key_name='tempest-keypair-1401018434',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:19Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97026720e5114b53a1aa2cd0d93104ea',ramdisk_id='',reservation_id='r-67u9o3fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1895596559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1895596559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2ca81daafb240d491c79ed8561982a1',uuid=0bdb15c0-e951-4850-963b-2439b99b93f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:30.673155 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converting VIF {"id": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "address": "fa:16:3e:46:6c:7a", "network": {"id": "bfaa32ac-ecd5-40ae-86fe-0a3028703a25", "bridge": "br-int", "label": "tempest-device-tagging-net2-1634111197", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "97026720e5114b53a1aa2cd0d93104ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e92a3f-1a", "ovs_interfaceid": "a1e92a3f-1a46-4ae7-ae73-158e544bfb94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:30.673858 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:30.674156 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:30.676418 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.680087 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1e92a3f-1a, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.680087 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.680087 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.687875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.689458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.689632 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=957432c9-77fa-4818-8da5-c5bd69cf7bc3) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:30.699128 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:30.702116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.703731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-e4c0ad82-96c3-46ba-9ea8-bdfcbf15cb95 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:30.712987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:30.715266 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:30.715681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:30.715928 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9a0aa4f-dcba-421f-b47e-8f4bc1b3f459 req-58639c00-55aa-44ff-ae79-afe21de56435 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:30.716766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:30.722530 np0000003830 nova-compute[98984]: INFO os_vif [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:6c:7a,bridge_name='br-int',has_traffic_filtering=True,id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94,network=Network(bfaa32ac-ecd5-40ae-86fe-0a3028703a25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e92a3f-1a')
Jun 27 04:06:30.730548 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:06:30.730905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:30.731048 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:30.731434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:30.731808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21edcccc-4546-4c75-8a26-aba5c952c93a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:06:30.731922 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:30.775832 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [4] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:30.776475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:06:30.776985 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '4')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:30.778372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a', '3')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:30.779818 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518736840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:06:30.780041 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:06:30.780322 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Flush multipath device 330000000b68bcf25 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:06:30.830669 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:30.835415 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:30.851584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:06:30.869200 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:30.869895 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:30.870163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:29:7f:60, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:30.870732 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Using config drive
Jun 27 04:06:30.883786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:30.884694 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:30.927030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:06:30.927924 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:06:30.938257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:06:30.939877 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:feb4:7b38', 'fe80::fc16:3eff:fe63:9e91', 'fe80::fc16:3eff:fee6:71dc', 'fe80::cc70:8eff:fea0:bf80'] 
Jun 27 04:06:30.940781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:06:30.940781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:06:30.941481 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:30.941481 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updating existing volume attachment record: ffec1345-0333-4292-b0c2-c7708be7189a {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:06:30.944230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:06:30.948115 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:06:30.950131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:06:30.957381 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updated VIF entry in instance network info cache for port 513ca15c-8969-4cfb-a8fc-b778700527e3. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:06:30.957381 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updating instance_info_cache with network_info: [{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:30.967769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:06:30.968257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:06:30.985040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.033109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.40.100,3260]
Jun 27 04:06:31.033109 np0000003830 nova-compute[98984]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:31.033109 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.057606 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:31.057846 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:31.058234 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:31.058984 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:06:31.059274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:06:31.061173 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.77 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:06:31.072878 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.088641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bbae5160-a68b-4e44-92cd-69e4eb076e61 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.032s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:31.090211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.108038 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533191.1076329, 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:31.111344 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] VM Started (Lifecycle Event)
Jun 27 04:06:31.138778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.50.100,3260]
Jun 27 04:06:31.138778 np0000003830 nova-compute[98984]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-21edcccc-4546-4c75-8a26-aba5c952c93a, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:31.138778 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.163859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.163859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:31.163859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== disconnect_volume: return (432ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:31.163859 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:06:31.165993 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:06:31.166383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:31.166573 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:31.167058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:31.167480 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:06:31.173879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.207364 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061 (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:06:31.207898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '5')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:31.209171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061', '6')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:31.210186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518736160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:06:31.210444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:06:31.210763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Flush multipath device 3300000006bf24e4f {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:06:31.251889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:31.320512 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:31.369393 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:06:31.369393 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:06:31.369740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:06:31.379860 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:31.395761 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:06:31.395761 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:06:31.397178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.434364 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.40.100,3260]
Jun 27 04:06:31.434364 np0000003830 nova-compute[98984]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:31.434364 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.459053 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a763bb86-cbf1-47d6-bcc8-779b2579d875 req-bf226dd2-c323-4364-b8e7-759a94e927c4 service nova] Releasing lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:31.461013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.472556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.512531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.50.100,3260]
Jun 27 04:06:31.512531 np0000003830 nova-compute[98984]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-b0b7b3a1-c205-4ea6-bbc1-b60973d55061, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:31.512531 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== disconnect_volume: return (364ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5bca00e-bc31-469e-9030-dcbd935f12df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:06:31.533980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:06:31.540144 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Creating config drive at /opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030/disk.config
Jun 27 04:06:31.543923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqi9j71b2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.575184 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df (non-flash)
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:31.575572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:06:31.575900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '10')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:31.577402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df', '9')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:31.579267 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870c5e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:06:31.579902 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:06:31.581249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Flush multipath device 3300000001be01518 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:06:31.597762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqi9j71b2" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:31.615359 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:31.615359 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:31.630563 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533191.6287775, 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:31.630563 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] VM Paused (Lifecycle Event)
Jun 27 04:06:31.673794 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:31.733620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:06:31.733620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:06:31.733620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:06:31.741773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:06:31.741773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:06:31.754347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.801168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.40.100,3260]
Jun 27 04:06:31.801168 np0000003830 nova-compute[98984]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:31.801168 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.812819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.827143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.841375 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:31.844058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:31.844567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:31.844567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:31.847699 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-34c66af1-878e-42c8-ab08-32e34e085f38 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:31.847844 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-34c66af1-878e-42c8-ab08-32e34e085f38 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:31.848008 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:31.848453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:31.848647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:31.848770 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:31.848882 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Processing event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-893bc9f9-90cd-4930-81c8-210448bf84c2 req-682dab48-7872-4aa6-8043-0fc08d5e717a service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received unexpected event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with vm_state building and task_state spawning.
Jun 27 04:06:31.851522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:31.860870 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:31.864443 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Instance spawned successfully.
Jun 27 04:06:31.864969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:31.878306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.50.100,3260]
Jun 27 04:06:31.878306 np0000003830 nova-compute[98984]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-f5bca00e-bc31-469e-9030-dcbd935f12df, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:31.878306 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.900554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:31.901031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:31.901337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] <== disconnect_volume: return (368ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:31.901976 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:06:31.902295 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Deleting instance files /opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7_del
Jun 27 04:06:31.903000 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Deletion of /opt/stack/data/nova/instances/0bdb15c0-e951-4850-963b-2439b99b93f7_del complete
Jun 27 04:06:32.111160 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.134139 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:32.137321 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533192.1367316, 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:32.137436 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] VM Resumed (Lifecycle Event)
Jun 27 04:06:32.145058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.256988 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.373548 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:32.373718 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:32.374063 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:32.374313 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:32.374634 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:32.374937 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:32.410184 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Took 3.79 seconds to destroy the instance on the hypervisor.
Jun 27 04:06:32.411107 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:06:32.411815 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:06:32.411955 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:06:32.412504 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:32.491326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.493638 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.494961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.519377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:32.641264 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:32.643117 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:32.647439 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:32.880767 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Took 13.61 seconds to spawn the instance on the hypervisor.
Jun 27 04:06:32.880942 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:33.148933 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:33.203509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:06:33.204736 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:06:33.205121 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Creating image(s)
Jun 27 04:06:33.205439 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:06:33.205618 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Ensure instance console log exists: /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:33.205956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:33.206158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:33.206322 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:33.206971 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Start _get_guest_xml network_info=[{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'ffec1345-0333-4292-b0c2-c7708be7189a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6a29bf7b-b8b2-41df-b546-800f5174319a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'serial': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:33.210730 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:33.212439 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-522076333', uuid='6a29bf7b-b8b2-41df-b546-800f5174319a'), owner=OwnerMeta(userid='6c2bd621defb420db9fd8345c5b36248', username='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member', projectid='771234de69074fed81ffef19dcee2804', projectname='tempest-ServerBootFromVolumeStableRescueTest-2029132639'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533193.211932) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:33.214173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:33.214629 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:33.215574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:33.215833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:33.217028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:33.217441 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:33.217994 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:33.217994 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:33.218133 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:33.218133 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:33.218286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:33.218465 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:33.218631 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:33.218780 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:33.218926 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:33.219089 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:33.231335 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:06:33.231673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:33.231811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:33.232158 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:33.232350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:06:33.245478 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:33.246557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:33.247172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:33.247308 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:33.248243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:33.248407 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:33.262782 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533193.26235, a243ff55-7b82-43af-a0b8-158eb4b8d030 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:33.263228 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] VM Started (Lifecycle Event)
Jun 27 04:06:33.265156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:33.265156 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:33.270889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:06:33.270889 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3] added
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:33.279519 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:33.279799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:33.280013 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:33.280206 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3] added
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:06:33.286942 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:33.287258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:06:33.287377 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:06:33.287631 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:06:33.397485 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Took 21.62 seconds to build instance.
Jun 27 04:06:33.768436 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:33.773349 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533193.7729986, a243ff55-7b82-43af-a0b8-158eb4b8d030 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:33.773536 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] VM Paused (Lifecycle Event)
Jun 27 04:06:33.899778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.130s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:33.929586 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-29e71bd6-5bf2-4520-b450-2038fb6947c7 req-439ad9b0-7f62-4895-aa14-f83bfc0b4983 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:33.929759 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-29e71bd6-5bf2-4520-b450-2038fb6947c7 req-439ad9b0-7f62-4895-aa14-f83bfc0b4983 service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:33.929924 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-29e71bd6-5bf2-4520-b450-2038fb6947c7 req-439ad9b0-7f62-4895-aa14-f83bfc0b4983 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:33.930055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-29e71bd6-5bf2-4520-b450-2038fb6947c7 req-439ad9b0-7f62-4895-aa14-f83bfc0b4983 service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:33.930194 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-29e71bd6-5bf2-4520-b450-2038fb6947c7 req-439ad9b0-7f62-4895-aa14-f83bfc0b4983 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:33.930329 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-29e71bd6-5bf2-4520-b450-2038fb6947c7 req-439ad9b0-7f62-4895-aa14-f83bfc0b4983 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:34.043776 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:34.276184 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:34.277654 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:34.280860 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:34.288596 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:34.300314 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:34.312288 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.318030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.330259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.336668 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.337368 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.356363 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.356948 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:34.387940 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.40.100,3260]
Jun 27 04:06:34.387940 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:34.387940 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.403072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.419784 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.50.100,3260]
Jun 27 04:06:34.419784 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:34.419784 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.428355 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:34.428976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:34.430024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('7', '-', '-', 0) found on session 31 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:34.430024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:34.437214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:34.449446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 31 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:34.467825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:34.468343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:34.468343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:34.470280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('8', '-', '-', 0) found on session 32 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:34.470280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:34.485604 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:34.485836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:34.490767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 32 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:34.490767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:34.780922 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:34.971825 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-66f45a67-4a58-47b5-8803-eeddcca8fee7 req-2feec933-ea4b-4232-b801-58e39bf252f3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-deleted-a1e92a3f-1a46-4ae7-ae73-158e544bfb94 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:34.973225 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-66f45a67-4a58-47b5-8803-eeddcca8fee7 req-2feec933-ea4b-4232-b801-58e39bf252f3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Neutron deleted interface a1e92a3f-1a46-4ae7-ae73-158e544bfb94; detaching it from the instance and deleting it from the info cache
Jun 27 04:06:34.976051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-66f45a67-4a58-47b5-8803-eeddcca8fee7 req-2feec933-ea4b-4232-b801-58e39bf252f3 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Detach interface failed, port_id=a1e92a3f-1a46-4ae7-ae73-158e544bfb94, reason: Instance 0bdb15c0-e951-4850-963b-2439b99b93f7 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:06:34.988625 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:06:35.207210 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:35.352653 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a7db309-955f-4c82-ab1c-574492cae0e0 req-62c3add4-e263-4be1-9279-3f6b79557d15 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-deleted-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:35.352840 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-9a7db309-955f-4c82-ab1c-574492cae0e0 req-62c3add4-e263-4be1-9279-3f6b79557d15 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Neutron deleted interface 752f568e-442f-482f-bee6-23258b2a5023; detaching it from the instance and deleting it from the info cache
Jun 27 04:06:35.354297 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a7db309-955f-4c82-ab1c-574492cae0e0 req-62c3add4-e263-4be1-9279-3f6b79557d15 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Detach interface failed, port_id=752f568e-442f-482f-bee6-23258b2a5023, reason: Instance 0bdb15c0-e951-4850-963b-2439b99b93f7 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:06:35.448987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 31 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:35.449971 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:35.571566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:35.572569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:35.574524 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:06:35.575014 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Claim successful on node np0000003830
Jun 27 04:06:35.692174 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:36.010225 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.011089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.011089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.011384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.011569 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:36.011702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-b889b1b6-e646-47d0-a58a-deb2c27cb567 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:36.011841 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-deleted-2a748cfd-0098-4b02-ae17-e5818b112843 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.011991 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Neutron deleted interface 2a748cfd-0098-4b02-ae17-e5818b112843; detaching it from the instance and deleting it from the info cache
Jun 27 04:06:36.013199 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Detach interface failed, port_id=2a748cfd-0098-4b02-ae17-e5818b112843, reason: Instance 0bdb15c0-e951-4850-963b-2439b99b93f7 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:06:36.013388 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.013580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.013730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.013925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.014077 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:36.014180 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:36.014281 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.014552 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.014940 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.015167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.015276 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:36.015419 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:36.015801 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.015801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.015928 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.016080 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.016222 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:36.016410 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-752f568e-442f-482f-bee6-23258b2a5023 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:36.017108 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.017108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.017108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.017227 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.017353 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] No waiting events found dispatching network-vif-unplugged-752f568e-442f-482f-bee6-23258b2a5023 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:36.017473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-unplugged-752f568e-442f-482f-bee6-23258b2a5023 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:36.017774 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-plugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.017850 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.017981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.018157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.018278 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Processing event network-vif-plugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:06:36.018380 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-plugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:36.018652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:36.018776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:36.018903 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:36.019037 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] No waiting events found dispatching network-vif-plugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:36.019177 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-debff6f5-fa5d-436e-aff9-39e6cb170f14 req-02034b55-60c7-4847-9e14-be2c26c9700a service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received unexpected event network-vif-plugged-391135c1-35b6-4234-b241-4376de6f6fe6 for instance with vm_state building and task_state spawning.
Jun 27 04:06:36.021124 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:36.024436 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533196.0240571, a243ff55-7b82-43af-a0b8-158eb4b8d030 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:36.024742 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] VM Resumed (Lifecycle Event)
Jun 27 04:06:36.026069 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:36.029241 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Instance spawned successfully.
Jun 27 04:06:36.030178 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:36.274412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Found WWN 330000000dc0460c8 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:06:36.274725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:36.275001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000dc0460c8', 'path': '/dev/dm-0', 'multipath_id': '330000000dc0460c8'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:36.275277 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dc0460c8', 'path': '/dev/dm-0', 'multipath_id': '330000000dc0460c8'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:06:36.529734 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:36.533679 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:36.548603 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:36.548831 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:36.549118 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:36.549354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:36.549596 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:36.549812 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:36.590783 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:36.785048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-522076333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-522076333',id=16,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-ahja7564',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:26Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6a29bf7b-b8b2-41df-b546-800f5174319a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:36.785268 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:36.786154 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:36.790170 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:37.040690 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:37.057588 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Took 15.21 seconds to spawn the instance on the hypervisor.
Jun 27 04:06:37.057827 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:37.066473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ed1ee68-26cf-40f5-a6f2-e5549f02fd91 req-d6ea29c1-6bc2-4176-82f4-b779cbe76c7f service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-deleted-8e4345c6-eb4c-4b2e-8017-7bd5340110a6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:37.095545 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Took 4.68 seconds to deallocate network for instance.
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <uuid>6a29bf7b-b8b2-41df-b546-800f5174319a</uuid>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <name>instance-00000010</name>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-522076333</nova:name>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:33</nova:creationTime>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:user uuid="6c2bd621defb420db9fd8345c5b36248">tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member</nova:user>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:project uuid="771234de69074fed81ffef19dcee2804">tempest-ServerBootFromVolumeStableRescueTest-2029132639</nova:project>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         <nova:port uuid="513ca15c-8969-4cfb-a8fc-b778700527e3">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <entry name="serial">6a29bf7b-b8b2-41df-b546-800f5174319a</entry>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <entry name="uuid">6a29bf7b-b8b2-41df-b546-800f5174319a</entry>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <alias name="ua-b3cb033a-10ae-4b8e-a03d-d217017f9ec3"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <serial>b3cb033a-10ae-4b8e-a03d-d217017f9ec3</serial>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d9:5e:65"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <target dev="tap513ca15c-89"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/console.log" append="off"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:37.293126 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Preparing to wait for external event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-522076333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-522076333',id=16,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-ahja7564',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:26Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6a29bf7b-b8b2-41df-b546-800f5174319a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:37.295585 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:37.296844 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.297057 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:37.297447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:37.298775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.300129 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2102cabe-29a1-57bc-8687-28c5e4d6cf55', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:37.303238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.304281 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:37.310940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.311390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap513ca15c-89, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:37.311925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap513ca15c-89, col_values=(('qos', UUID('52538d55-1e6f-4edc-b784-7a63622b0f2c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:37.312110 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap513ca15c-89, col_values=(('external_ids', {'iface-id': '513ca15c-8969-4cfb-a8fc-b778700527e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:5e:65', 'vm-uuid': '6a29bf7b-b8b2-41df-b546-800f5174319a'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:37.313388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.314467 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:37.324546 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.326850 np0000003830 nova-compute[98984]: INFO os_vif [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89')
Jun 27 04:06:37.431426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:37.432170 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:37.443078 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cd76f951-0b8c-489a-bb97-e87c39cab187 req-37da92a5-02de-4dc0-a6d1-a29e46f88a12 service nova] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Received event network-vif-deleted-b889b1b6-e646-47d0-a58a-deb2c27cb567 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:37.462535 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:37.566461 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Took 24.54 seconds to build instance.
Jun 27 04:06:37.942155 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:38.069734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-96c1696d-defa-4088-8867-d5369841bb11 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.052s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:38.452475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.881s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:38.453007 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:06:38.857941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:38.858093 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:38.858183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No VIF found with MAC fa:16:3e:d9:5e:65, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:38.858996 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Using config drive
Jun 27 04:06:38.869609 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Took 1.77 seconds to detach 3 volumes for instance.
Jun 27 04:06:38.961338 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:06:38.961338 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:06:38.961801 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:38.962666 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:39.045785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:39.079967 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2d46125fda94029b2d5b7c8fdaf56fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fa5127b52042afb5b60ff945958fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:06:39.367379 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:39.378320 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:39.378569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:39.470118 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:06:39.607524 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Creating config drive at /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config
Jun 27 04:06:39.610142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz3zfqj03 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:39.665630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz3zfqj03" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:39.976276 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:06:40.024657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:40.024657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:40.024806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:40.024856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:40.025440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:40.028722 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Terminating instance
Jun 27 04:06:40.069864 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Successfully created port: 5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:06:40.187409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.225844 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.227707 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.337527 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.401171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.402182 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.542777 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:06:40.566558 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.566558 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.570330 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d90aa94d-7301-44ed-9e80-ed133b2d67c5 req-d193828d-4133-493f-b842-a831c39eed66 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:40.571034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d90aa94d-7301-44ed-9e80-ed133b2d67c5 req-d193828d-4133-493f-b842-a831c39eed66 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:40.571034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d90aa94d-7301-44ed-9e80-ed133b2d67c5 req-d193828d-4133-493f-b842-a831c39eed66 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:40.571034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d90aa94d-7301-44ed-9e80-ed133b2d67c5 req-d193828d-4133-493f-b842-a831c39eed66 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:40.572031 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d90aa94d-7301-44ed-9e80-ed133b2d67c5 req-d193828d-4133-493f-b842-a831c39eed66 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Processing event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:06:40.600878 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.614489 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.630688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:40.631335 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:40.647922 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.874015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.913360 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999627975999829 future=<Future at 0x7ec518795a00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:40.916642 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.924391 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Instance destroyed successfully.
Jun 27 04:06:40.924391 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lazy-loading 'resources' on Instance uuid 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:40.925109 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.948624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:40.968819 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28e236c8-e967-4ebe-aa9c-5b1fdf704cbc req-769d4d97-2961-48c8-af80-4f5637601916 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:40.969306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28e236c8-e967-4ebe-aa9c-5b1fdf704cbc req-769d4d97-2961-48c8-af80-4f5637601916 service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:40.969306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28e236c8-e967-4ebe-aa9c-5b1fdf704cbc req-769d4d97-2961-48c8-af80-4f5637601916 service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:40.969306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28e236c8-e967-4ebe-aa9c-5b1fdf704cbc req-769d4d97-2961-48c8-af80-4f5637601916 service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:40.971613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28e236c8-e967-4ebe-aa9c-5b1fdf704cbc req-769d4d97-2961-48c8-af80-4f5637601916 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:40.971613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28e236c8-e967-4ebe-aa9c-5b1fdf704cbc req-769d4d97-2961-48c8-af80-4f5637601916 service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:40.998753 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:06:41.003390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:06:41.004151 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Creating image(s)
Jun 27 04:06:41.005861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:41.005861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:41.006610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:41.007288 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:41.011016 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:41.016000 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:41.136365 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:41.151781 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.136s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:41.152246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:41.152702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:41.153107 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:41.161200 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:41.162321 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:41.224199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:41.224912 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:41.278155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:41.279618 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:41.346485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk 1073741824" returned: 0 in 0.067s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:41.348304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:41.348304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:41.424710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.431325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='instance-depend-image',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:32Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4cf5d509927f4ab2983be169557da9f2',ramdisk_id='',reservation_id='r-60siwnfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-15655490',owner_user_name='tempest-ImageDependencyTests-15655490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:06:33Z,user_data=None,user_id='dbf0c322917e4ba7bcc7ea1f87d988dd',uuid=2f06654b-01a1-42d8-bcbc-ac8cd4f54748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:41.431572 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Converting VIF {"id": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "address": "fa:16:3e:e6:71:dc", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3755fe-37", "ovs_interfaceid": "5e3755fe-37b1-4ae3-93e7-1ee8c73e04df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:41.435012 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:41.435414 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:41.438897 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.439690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e3755fe-37, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:41.441794 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:41.461744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:41.462535 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:06:41.462899 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:41.484915 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.502034 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Successfully updated port: 5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:06:41.507048 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.508071 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3fbccd4-45e2-4a20-97d7-6c9910f1f7ee) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:41.509356 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.509907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:41.511751 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.517448 np0000003830 nova-compute[98984]: INFO os_vif [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:dc,bridge_name='br-int',has_traffic_filtering=True,id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3755fe-37')
Jun 27 04:06:41.522701 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:06:41.522701 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:41.522701 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:41.523323 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:41.523910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '81413347-a5d7-4f6a-89bf-c25380d721df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:06:41.524129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:41.571252 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '32')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:06:41.572944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '28')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:41.573687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df', '27')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:06:41.574195 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5384219e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'): ({'sdl'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:06:41.574449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Removing multipathed devices sdl, sdm {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:06:41.574886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Flush multipath device 33000000000ff7b46 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:06:41.581011 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:41.581011 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Cannot resize image /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:06:41.581011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:06:41.581011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Ensure instance console log exists: /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:41.581011 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:41.581448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:41.581448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:41.612693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.612693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:41.659711 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.281s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:41.668056 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:06:41.689338 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:41.711176 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:06:41.711368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:06:41.712828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:06:41.747613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:41.747613 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533201.7293365, 6a29bf7b-b8b2-41df-b546-800f5174319a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:41.747613 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:06:41.747613 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Started (Lifecycle Event)
Jun 27 04:06:41.747613 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:06:41.747613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:06:41.754950 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:41.757847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:41.780034 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance spawned successfully.
Jun 27 04:06:41.780563 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:41.800365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.40.100,3260]
Jun 27 04:06:41.800365 np0000003830 nova-compute[98984]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.40.100,3260] successful.
Jun 27 04:06:41.800365 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:41.819193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:41.837791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:41.849453 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Deleted allocations for instance 0bdb15c0-e951-4850-963b-2439b99b93f7
Jun 27 04:06:41.880169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.50.100,3260]
Jun 27 04:06:41.880169 np0000003830 nova-compute[98984]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-81413347-a5d7-4f6a-89bf-c25380d721df, portal: 192.168.50.100,3260] successful.
Jun 27 04:06:41.880169 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:41.912899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:41.912899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:41.912899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] <== disconnect_volume: return (383ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:41.912899 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:06:41.913839 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Deleting instance files /opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748_del
Jun 27 04:06:41.914912 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Deletion of /opt/stack/data/nova/instances/2f06654b-01a1-42d8-bcbc-ac8cd4f54748_del complete
Jun 27 04:06:41.925331 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:42.009034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:42.009517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:42.009748 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:42.239464 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:42.249939 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:42.286958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:42.287022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:42.287329 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:42.287632 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:42.288023 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:42.288350 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:42.315193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:42.315193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:42.317801 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:06:42.317801 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Claim successful on node np0000003830
Jun 27 04:06:42.430947 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Took 1.89 seconds to destroy the instance on the hypervisor.
Jun 27 04:06:42.432231 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:06:42.432964 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:06:42.433053 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:06:42.433337 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:42.636837 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state building and task_state spawning.
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing instance network info cache due to event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:42.732274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:42.753372 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:42.753681 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533202.753427, 6a29bf7b-b8b2-41df-b546-800f5174319a => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:42.753868 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Paused (Lifecycle Event)
Jun 27 04:06:42.765634 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:42.801215 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Took 9.60 seconds to spawn the instance on the hypervisor.
Jun 27 04:06:42.801215 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:42.872789 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fef73a2e-71f7-432d-9a16-4c6bd7d55412 tempest-TaggedBootDevicesTest_v242-1895596559 tempest-TaggedBootDevicesTest_v242-1895596559-project-member] Lock "0bdb15c0-e951-4850-963b-2439b99b93f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.749s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.059150 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:43.131351 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:43.132612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:43.133069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:43.133338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.133534 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:43.133773 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:43.134273 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:43.134767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:43.135605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:43.135605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.136411 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:43.136640 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received unexpected event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with vm_state active and task_state deleting.
Jun 27 04:06:43.136830 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:43.137058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:43.137166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:43.137331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.137639 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:43.137786 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received unexpected event network-vif-plugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with vm_state active and task_state deleting.
Jun 27 04:06:43.138002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:43.138986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Acquiring lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] No waiting events found dispatching network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:43.145539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f5f47d6-c264-4fda-b4bc-2385728952d8 req-b94719ed-c6c1-43d3-a858-81b1b5a0852f service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-unplugged-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:06:43.259052 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:43.265412 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533203.2649398, 6a29bf7b-b8b2-41df-b546-800f5174319a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:43.265625 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Resumed (Lifecycle Event)
Jun 27 04:06:43.317870 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Took 21.50 seconds to build instance.
Jun 27 04:06:43.445531 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Refreshing inventories for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 27 04:06:43.458641 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:43.525693 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Updating ProviderTree inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 27 04:06:43.525693 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:06:43.623016 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Refreshing aggregate associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, aggregates: None {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 27 04:06:43.735816 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Refreshing trait associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, traits: HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_PPC64LE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NODE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 27 04:06:43.785570 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:43.785570 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5d04c669-2a45-4d1c-b956-24000f4556f4 req-2eb96378-6652-4ff4-9729-e4c866680d2b service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Received event network-vif-deleted-5e3755fe-37b1-4ae3-93e7-1ee8c73e04df {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:43.785570 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-5d04c669-2a45-4d1c-b956-24000f4556f4 req-2eb96378-6652-4ff4-9729-e4c866680d2b service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Neutron deleted interface 5e3755fe-37b1-4ae3-93e7-1ee8c73e04df; detaching it from the instance and deleting it from the info cache
Jun 27 04:06:43.785570 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5d04c669-2a45-4d1c-b956-24000f4556f4 req-2eb96378-6652-4ff4-9729-e4c866680d2b service nova] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Detach interface failed, port_id=5e3755fe-37b1-4ae3-93e7-1ee8c73e04df, reason: Instance 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:06:43.788302 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:43.821146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9e210d88-00fa-4e99-aaff-4db033e35607 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.021s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:43.960643 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:43.960643 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance network_info: |[{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:06:43.962685 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Start _get_guest_xml network_info=[{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:43.964475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:43.964475 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:43.967102 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:43.968531 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2117052605', uuid='1dcb49d8-f1f8-435f-a9b9-13d640d8857a'), owner=OwnerMeta(userid='b2d46125fda94029b2d5b7c8fdaf56fa', username='tempest-ServerStableDeviceRescueTest-266477854-project-member', projectid='68fa5127b52042afb5b60ff945958fe1', projectname='tempest-ServerStableDeviceRescueTest-266477854'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533203.9680955) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:43.969748 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:43.970085 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:43.975517 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:43.975517 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:43.975517 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:43.975936 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:43.976521 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:43.976673 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:43.976862 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:43.976995 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:43.977154 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:43.977393 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:43.977582 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:43.977849 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:43.978014 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:43.980296 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:44.019000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2117052605',display_name='tempest-ServerStableDeviceRescueTest-server-2117052605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverstabledevicerescuetest-server-2117052605',id=17,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSFYd/JkH+Vz3YsGvTwO9jit43qVKUlHw0XT+6lNosIG0v40wc3s9VfFpr/hClJBHRnYZTS/XpX5bvytocfQkLZlpKa5rDe2MI/579Dc1a5pubKxHCtUVE13jqffmeUiQ==',key_name='tempest-keypair-857089329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68fa5127b52042afb5b60ff945958fe1',ramdisk_id='',reservation_id='r-6geb1f7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-266477854',owner_user_name='tempest-ServerStableDeviceRescueTest-266477854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2d46125fda94029b2d5b7c8fdaf56fa',uuid=1dcb49d8-f1f8-435f-a9b9-13d640d8857a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:44.019000 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converting VIF {"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:44.019000 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:44.019000 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:44.049665 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:44.181661 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:44.467114 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <uuid>1dcb49d8-f1f8-435f-a9b9-13d640d8857a</uuid>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <name>instance-00000011</name>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2117052605</nova:name>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:43</nova:creationTime>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:user uuid="b2d46125fda94029b2d5b7c8fdaf56fa">tempest-ServerStableDeviceRescueTest-266477854-project-member</nova:user>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:project uuid="68fa5127b52042afb5b60ff945958fe1">tempest-ServerStableDeviceRescueTest-266477854</nova:project>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         <nova:port uuid="5c588384-6b02-40d8-ac17-e99ed811d602">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <entry name="serial">1dcb49d8-f1f8-435f-a9b9-13d640d8857a</entry>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <entry name="uuid">1dcb49d8-f1f8-435f-a9b9-13d640d8857a</entry>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:cc:24:49"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <target dev="tap5c588384-6b"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/console.log" append="off"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:44.516649 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:44.520514 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Preparing to wait for external event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:06:44.520514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:44.520514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:44.520514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:44.520514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2117052605',display_name='tempest-ServerStableDeviceRescueTest-server-2117052605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverstabledevicerescuetest-server-2117052605',id=17,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSFYd/JkH+Vz3YsGvTwO9jit43qVKUlHw0XT+6lNosIG0v40wc3s9VfFpr/hClJBHRnYZTS/XpX5bvytocfQkLZlpKa5rDe2MI/579Dc1a5pubKxHCtUVE13jqffmeUiQ==',key_name='tempest-keypair-857089329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68fa5127b52042afb5b60ff945958fe1',ramdisk_id='',reservation_id='r-6geb1f7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-266477854',owner_user_name='tempest-ServerStableDeviceRescueTest-266477854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2d46125fda94029b2d5b7c8fdaf56fa',uuid=1dcb49d8-f1f8-435f-a9b9-13d640d8857a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:44.520514 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converting VIF {"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:44.520944 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:44.521237 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:44.521721 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:44.521964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:44.522436 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:44.523458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:44.523676 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23bf1ba3-b9f2-53a2-afad-8a6a63c8a043', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:44.524537 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0029701509999995324 future=<Future at 0x7ec53831adb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:44.526526 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:44.527471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:44.527668 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] Emitting event <LifecycleEvent: 1782533189.5214167, 0bdb15c0-e951-4850-963b-2439b99b93f7 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.383049518999997 future=<Future at 0x7ec518795a00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.382880822999823 future=<Future at 0x7ec518795a00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] VM Stopped (Lifecycle Event)
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c588384-6b, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c588384-6b, col_values=(('qos', UUID('80c7129f-dd95-40c4-ab03-b7ddb916b1ad')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:44.536606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c588384-6b, col_values=(('external_ids', {'iface-id': '5c588384-6b02-40d8-ac17-e99ed811d602', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:24:49', 'vm-uuid': '1dcb49d8-f1f8-435f-a9b9-13d640d8857a'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:44.538350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:44.540005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:44.548148 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:44.550447 np0000003830 nova-compute[98984]: INFO os_vif [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b')
Jun 27 04:06:44.632711 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:44.632942 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:44.685018 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Took 2.25 seconds to deallocate network for instance.
Jun 27 04:06:45.031951 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: 0bdb15c0-e951-4850-963b-2439b99b93f7] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:45.109556 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:45.136589 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:45.370599 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updated VIF entry in instance network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:06:45.377028 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:45.406692 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Took 0.72 seconds to detach 1 volumes for instance.
Jun 27 04:06:45.413196 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Deleting volume: 81413347-a5d7-4f6a-89bf-c25380d721df {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:06:45.647484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.335s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:45.649577 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:06:45.875293 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83aeb434-0810-44ed-8804-b4d72e2c84f5 req-edde85a2-c175-4bba-bef4-237e21a2e8a4 service nova] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:46.020893 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:46.021136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:46.101461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:46.101913 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:46.102120 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No VIF found with MAC fa:16:3e:cc:24:49, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:46.102732 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Using config drive
Jun 27 04:06:46.152405 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Rescuing
Jun 27 04:06:46.153267 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:46.153459 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:46.154305 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:46.159155 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:06:46.162638 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:06:46.163001 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:46.164306 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:46.302626 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7132d5dcadb043838976141746b8a26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a05730e4d204004b6dbe4c1389b8397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:06:46.612875 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:46.661001 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:46.668009 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:06:46.843125 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:06:46.843706 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:06:46.925993 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Creating config drive at /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config
Jun 27 04:06:46.932620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:46.932803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:46.932975 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Shelving
Jun 27 04:06:46.936561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5xhbey9z {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:47.013282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5xhbey9z" returned: 0 in 0.076s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:47.057404 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Successfully created port: 92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:06:47.178338 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:06:47.348690 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:06:47.362456 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:47.632202 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:47.665711 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:47.671603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:47.680216 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updating instance_info_cache with network_info: [{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:47.795137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:47.875110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.854s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:47.984612 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Deleted allocations for instance 2f06654b-01a1-42d8-bcbc-ac8cd4f54748
Jun 27 04:06:47.987543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:47.993761 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.014633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.027563 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Successfully updated port: 92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:06:48.093540 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f6db8b8b-efde-4dc1-8e01-65be7cebc11e req-87f2c8c5-b646-4a8d-b1d3-f470f1fe60ce service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:48.093983 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f6db8b8b-efde-4dc1-8e01-65be7cebc11e req-87f2c8c5-b646-4a8d-b1d3-f470f1fe60ce service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:48.094292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f6db8b8b-efde-4dc1-8e01-65be7cebc11e req-87f2c8c5-b646-4a8d-b1d3-f470f1fe60ce service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:48.094410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f6db8b8b-efde-4dc1-8e01-65be7cebc11e req-87f2c8c5-b646-4a8d-b1d3-f470f1fe60ce service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:48.094626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f6db8b8b-efde-4dc1-8e01-65be7cebc11e req-87f2c8c5-b646-4a8d-b1d3-f470f1fe60ce service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Processing event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:06:48.099234 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-changed-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:48.099844 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Refreshing instance network info cache due to event network-changed-92555b08-0c16-4c81-b96f-0e1888a7a365. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:48.100887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] Acquiring lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:48.101029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] Acquired lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:48.101243 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Refreshing network info cache for port 92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:48.127715 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.136307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.142469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.172721 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.173954 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.182189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:48.195338 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:06:48.198610 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:06:48.198610 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Creating image(s)
Jun 27 04:06:48.198610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "/opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:48.198610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:48.198610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:48.199222 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:48.205339 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:48.207038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:48.314516 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999282929999936 future=<Future at 0x7ec538133a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:48.317434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:48.318243 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:48.318862 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:48.319362 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:48.324947 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:48.326277 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:48.326756 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance destroyed successfully.
Jun 27 04:06:48.346561 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'numa_topology' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:48.351983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.359470 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.360696 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.432621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:48.433312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:48.504099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk 1073741824" returned: 0 in 0.070s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:48.506640 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:48.508563 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:48.534177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:48.606663 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:48.618232 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:48.619400 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:06:48.619685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:48.740215 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:48.740695 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Cannot resize image /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:06:48.742412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:06:48.743000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Ensure instance console log exists: /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:06:48.743146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:48.744402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:48.744402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:48.785313 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:48.801780 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:48.998582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0274832c-4eab-45a7-acdd-77ce80e8c6bd tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Lock "2f06654b-01a1-42d8-bcbc-ac8cd4f54748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.974s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:49.028089 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Beginning cold snapshot process
Jun 27 04:06:49.031064 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533209.0302403, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:49.031064 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Started (Lifecycle Event)
Jun 27 04:06:49.039562 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:49.049287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:49.054137 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance spawned successfully.
Jun 27 04:06:49.056542 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:49.059615 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:49.104631 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:49.539451 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:49.544754 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:49.546702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:49.566269 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:49.567486 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:49.569108 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:49.569474 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:49.570137 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:49.570560 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:49.607915 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-421fbd31-3480-4f98-aa79-75b682fa4da6 req-a2443ed5-7ac1-41f0-bb15-6aab035851ad service nova] Releasing lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:49.608949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:49.609614 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:49.955526 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:49.958284 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:49.993219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:50.055354 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:50.057353 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533210.057067, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:50.057510 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Paused (Lifecycle Event)
Jun 27 04:06:50.078321 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Took 9.08 seconds to spawn the instance on the hypervisor.
Jun 27 04:06:50.078809 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:50.193776 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:50.206853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:50.213698 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:50.217485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:50.217768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:50.218254 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:50.218254 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:50.218254 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state active and task_state None.
Jun 27 04:06:50.218452 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:50.218624 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:50.218784 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:50.218853 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:50.218948 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] No waiting events found dispatching network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:50.219110 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received unexpected event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 for instance with vm_state active and task_state shelving_image_pending_upload.
Jun 27 04:06:50.219262 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:50.219408 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:50.219819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:50.219819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:50.219967 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] No waiting events found dispatching network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:50.220040 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-60fcc868-6e4a-4433-9a63-8775215cf6bd req-d569af1f-c074-46e2-be79-07d7815bc037 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received unexpected event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 for instance with vm_state active and task_state shelving_image_pending_upload.
Jun 27 04:06:50.232065 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:06:50.286683 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance destroyed successfully.
Jun 27 04:06:50.287394 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:50.370067 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1f888a74-883f-4189-9a6b-bd59aff5b238 req-958b98d6-f069-43e7-bf15-697ee94223f6 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:50.370294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1f888a74-883f-4189-9a6b-bd59aff5b238 req-958b98d6-f069-43e7-bf15-697ee94223f6 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:50.370511 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1f888a74-883f-4189-9a6b-bd59aff5b238 req-958b98d6-f069-43e7-bf15-697ee94223f6 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:50.370666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1f888a74-883f-4189-9a6b-bd59aff5b238 req-958b98d6-f069-43e7-bf15-697ee94223f6 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:50.370892 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1f888a74-883f-4189-9a6b-bd59aff5b238 req-958b98d6-f069-43e7-bf15-697ee94223f6 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:50.370968 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-1f888a74-883f-4189-9a6b-bd59aff5b238 req-958b98d6-f069-43e7-bf15-697ee94223f6 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state rescuing.
Jun 27 04:06:50.474912 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:50.556636 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:06:50.556826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk /opt/stack/data/nova/instances/snapshots/tmpvyl587g7/95793c702d6b46b4bd8585e0778ab102 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:50.580953 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:50.607939 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Took 15.11 seconds to build instance.
Jun 27 04:06:50.615418 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533210.6142778, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:50.615418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Resumed (Lifecycle Event)
Jun 27 04:06:50.715608 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updating instance_info_cache with network_info: [{"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:50.796046 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Attempting a stable device rescue
Jun 27 04:06:50.940868 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98984) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 27 04:06:50.949442 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:06:50.949442 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Creating image(s)
Jun 27 04:06:50.950435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:50.950435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:50.950836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:50.951060 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:51.035067 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk /opt/stack/data/nova/instances/snapshots/tmpvyl587g7/95793c702d6b46b4bd8585e0778ab102" returned: 0 in 0.478s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:51.036251 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Snapshot extracted, beginning image upload
Jun 27 04:06:51.114805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8d254b3-b66f-4471-858e-130e23a59e7a tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.629s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:51.117600 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:51.120255 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:51.218521 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:51.218521 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Instance network_info: |[{"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:06:51.222354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Start _get_guest_xml network_info=[{"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:51.230703 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:51.232470 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='c702a025-f366-4383-9aa7-4fe61cfb64b8'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533211.231965) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:51.233666 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:51.234114 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:51.235467 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:51.235680 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:51.236748 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:51.237489 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:51.237791 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:51.238061 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:51.238243 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:51.238513 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:51.238513 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:51.238786 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:51.238926 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:51.239093 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:51.239244 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:51.239405 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:51.252104 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=18,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-584bxo0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=c702a025-f366-4383-9aa7-4fe61cfb64b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:51.252558 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:51.253535 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:51.254143 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'pci_devices' on Instance uuid c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:51.453278 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:51.453605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "cc543639adeae839f34d2fdd1f50cc30748303d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:51.454090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "cc543639adeae839f34d2fdd1f50cc30748303d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:51.627547 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99842238999986 future=<Future at 0x7ec5382c83b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <uuid>c702a025-f366-4383-9aa7-4fe61cfb64b8</uuid>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <name>instance-00000012</name>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:name>multiattach-server-0</nova:name>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:51</nova:creationTime>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         <nova:port uuid="92555b08-0c16-4c81-b96f-0e1888a7a365">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <entry name="serial">c702a025-f366-4383-9aa7-4fe61cfb64b8</entry>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <entry name="uuid">c702a025-f366-4383-9aa7-4fe61cfb64b8</entry>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.config"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:91:f1:28"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <target dev="tap92555b08-0c"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/console.log" append="off"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:51.757490 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:51.760324 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Preparing to wait for external event network-vif-plugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:06:51.760324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:51.760324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:51.760324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:51.760324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=18,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-584bxo0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=c702a025-f366-4383-9aa7-4fe61cfb64b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:06:51.760815 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:51.761239 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:51.761744 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:06:51.763640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.763640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.763640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:51.763640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:06:51.765591 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.765591 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4216af1-5a90-5806-af6c-027cc64f73a9', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:51.766898 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.767397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:51.780525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.785238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.785571 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92555b08-0c, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:51.786076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92555b08-0c, col_values=(('qos', UUID('6170106e-65b3-4873-acc7-51d8fd24a0e6')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:51.786303 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92555b08-0c, col_values=(('external_ids', {'iface-id': '92555b08-0c16-4c81-b96f-0e1888a7a365', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f1:28', 'vm-uuid': 'c702a025-f366-4383-9aa7-4fe61cfb64b8'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:51.790402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.792139 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:51.810997 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:51.811907 np0000003830 nova-compute[98984]: INFO os_vif [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c')
Jun 27 04:06:52.127240 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:52.129405 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing instance network info cache due to event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:52.129405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:52.129405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:52.129405 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:52.469699 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-072cc74a-d801-47fc-8c8e-ee2bc36ce6e7 req-4fdfd5de-3c0c-4984-a31e-402445a51569 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:52.470840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-072cc74a-d801-47fc-8c8e-ee2bc36ce6e7 req-4fdfd5de-3c0c-4984-a31e-402445a51569 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:52.470840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-072cc74a-d801-47fc-8c8e-ee2bc36ce6e7 req-4fdfd5de-3c0c-4984-a31e-402445a51569 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:52.470840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-072cc74a-d801-47fc-8c8e-ee2bc36ce6e7 req-4fdfd5de-3c0c-4984-a31e-402445a51569 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:52.470840 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-072cc74a-d801-47fc-8c8e-ee2bc36ce6e7 req-4fdfd5de-3c0c-4984-a31e-402445a51569 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:52.470840 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-072cc74a-d801-47fc-8c8e-ee2bc36ce6e7 req-4fdfd5de-3c0c-4984-a31e-402445a51569 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state rescuing.
Jun 27 04:06:52.488054 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:52.491956 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:52.492356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:52.599785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.part --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:52.600219 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] f1af0988-38f4-40db-b908-68f74f8e7e20 was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:06:52.600881 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:06:52.601255 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.part /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:52.634111 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:52.708573 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.part /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.converted" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:52.724161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:52.829538 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9.converted --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:52.831031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "cc543639adeae839f34d2fdd1f50cc30748303d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.377s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:52.833075 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:52.841148 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:52.842871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "cc543639adeae839f34d2fdd1f50cc30748303d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:52.843381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "cc543639adeae839f34d2fdd1f50cc30748303d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:52.844068 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:52.847598 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:06:52.847878 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:52.959453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9 --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:52.959453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9,backing_fmt=raw /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.rescue {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:53.026159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc543639adeae839f34d2fdd1f50cc30748303d9,backing_fmt=raw /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.rescue" returned: 0 in 0.067s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:53.027049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "cc543639adeae839f34d2fdd1f50cc30748303d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:53.028458 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'migration_context' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:53.163520 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:53.352260 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updated VIF entry in instance network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:06:53.353301 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:53.358707 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:53.358707 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:53.359547 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:91:f1:28, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:53.361210 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Using config drive
Jun 27 04:06:53.531359 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:53.531803 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:06:53.532753 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Start _get_guest_xml network_info=[{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:d9:5e:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1af0988-38f4-40db-b908-68f74f8e7e20', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'ffec1345-0333-4292-b0c2-c7708be7189a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '6a29bf7b-b8b2-41df-b546-800f5174319a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'serial': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:06:53.533171 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'resources' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:53.866537 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-028d99ee-f3aa-48a5-badf-a144749c0002 req-47d47bee-ed9a-4e3d-8a1e-c06e60815106 service nova] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:53.871897 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:54.035987 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:54.043412 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:06:54.043412 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-522076333', uuid='6a29bf7b-b8b2-41df-b546-800f5174319a'), owner=OwnerMeta(userid='6c2bd621defb420db9fd8345c5b36248', username='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member', projectid='771234de69074fed81ffef19dcee2804', projectname='tempest-ServerBootFromVolumeStableRescueTest-2029132639'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:d9:5e:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533214.0418081) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:06:54.047058 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Creating config drive at /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.config
Jun 27 04:06:54.050737 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:06:54.052841 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:06:54.054508 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:06:54.054508 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:06:54.058111 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:06:54.061601 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:54.062608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:54.067725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz42ar4xb {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:54.128020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz42ar4xb" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:54.337825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:54.567653 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:54.590726 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:06:54.709571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:06:54.710410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:54.711121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:54.711475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:54.712298 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:06:54.712783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:06:54.712987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:54.713368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:54.713688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:06:54.740191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:54.740191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:54.740191 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:06:54.742096 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:06:54.747673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:06:54.747673 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:06:54.763969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:06:54.797904 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:54.809638 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:54.809638 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:06:54.809638 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.087s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('8', '0', '0', 0) found on session 32 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.108s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] HCTL ('7', '0', '0', 0) found on session 31 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 32 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:54.852138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:54.870536 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Searching for a device in session 31 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:06:54.870536 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:06:54.912171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:54.912171 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Snapshot image upload complete
Jun 27 04:06:54.912171 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:54.994964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:55.011779 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:55.105516 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-183fec37-c94d-4dae-837c-7a39447def1d req-f48aa4ae-154a-4ce0-8460-5baa20470716 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-plugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:55.106670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-183fec37-c94d-4dae-837c-7a39447def1d req-f48aa4ae-154a-4ce0-8460-5baa20470716 service nova] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:55.107222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-183fec37-c94d-4dae-837c-7a39447def1d req-f48aa4ae-154a-4ce0-8460-5baa20470716 service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:55.107222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-183fec37-c94d-4dae-837c-7a39447def1d req-f48aa4ae-154a-4ce0-8460-5baa20470716 service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:55.108186 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-183fec37-c94d-4dae-837c-7a39447def1d req-f48aa4ae-154a-4ce0-8460-5baa20470716 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Processing event network-vif-plugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:06:55.433709 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Shelve offloading
Jun 27 04:06:55.758650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:06:55.912607 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00047513100003016007 future=<Future at 0x7ec518795a00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:55.912607 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:55.912607 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=7.400914112999999 future=<Future at 0x7ec538133a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:55.912607 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=7.400779088999798 future=<Future at 0x7ec538133a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:06:55.913134 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533200.9116023, 2f06654b-01a1-42d8-bcbc-ac8cd4f54748 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:55.913343 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] VM Stopped (Lifecycle Event)
Jun 27 04:06:55.950937 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance destroyed successfully.
Jun 27 04:06:55.951490 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:55.954192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:55.954192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:55.954192 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:06:56.083361 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:06:56.085227 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533216.0841715, c702a025-f366-4383-9aa7-4fe61cfb64b8 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:56.085724 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] VM Started (Lifecycle Event)
Jun 27 04:06:56.088125 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:06:56.098125 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Instance spawned successfully.
Jun 27 04:06:56.098418 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:06:56.417088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 2f06654b-01a1-42d8-bcbc-ac8cd4f54748] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:56.459546 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:56.594733 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:56.599536 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:56.611881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:56.612095 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:56.612611 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:56.612956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:56.613344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:56.614000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:06:56.768847 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Found WWN 330000000dc0460c8 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:06:56.772528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.056s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:06:56.772528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== connect_volume: return (2056ms) {'type': 'block', 'scsi_wwn': '330000000dc0460c8', 'path': '/dev/dm-0', 'multipath_id': '330000000dc0460c8'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:06:56.772528 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dc0460c8', 'path': '/dev/dm-0', 'multipath_id': '330000000dc0460c8'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:06:56.789124 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:56.994028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:57.104048 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:06:57.105444 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533217.1033032, c702a025-f366-4383-9aa7-4fe61cfb64b8 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:57.105885 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] VM Paused (Lifecycle Event)
Jun 27 04:06:57.123414 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Took 8.93 seconds to spawn the instance on the hypervisor.
Jun 27 04:06:57.123414 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:57.179472 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:57.221403 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-358cceab-3084-4b05-b44b-cf4181fbe398 req-24868be2-3872-4630-884f-9faefd0f16ce service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-plugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:57.223027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-358cceab-3084-4b05-b44b-cf4181fbe398 req-24868be2-3872-4630-884f-9faefd0f16ce service nova] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:06:57.223750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-358cceab-3084-4b05-b44b-cf4181fbe398 req-24868be2-3872-4630-884f-9faefd0f16ce service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:06:57.224190 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-358cceab-3084-4b05-b44b-cf4181fbe398 req-24868be2-3872-4630-884f-9faefd0f16ce service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:57.224598 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-358cceab-3084-4b05-b44b-cf4181fbe398 req-24868be2-3872-4630-884f-9faefd0f16ce service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] No waiting events found dispatching network-vif-plugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:06:57.225820 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-358cceab-3084-4b05-b44b-cf4181fbe398 req-24868be2-3872-4630-884f-9faefd0f16ce service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received unexpected event network-vif-plugged-92555b08-0c16-4c81-b96f-0e1888a7a365 for instance with vm_state active and task_state None.
Jun 27 04:06:57.288799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-522076333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-522076333',id=16,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:42Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-ahja7564',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:06:43Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6a29bf7b-b8b2-41df-b546-800f5174319a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:d9:5e:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:06:57.288799 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "vif_mac": "fa:16:3e:d9:5e:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:57.289757 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:57.293002 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:57.417715 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:06:57.498657 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:57.611282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:57.617229 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533217.6164212, c702a025-f366-4383-9aa7-4fe61cfb64b8 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:06:57.617229 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] VM Resumed (Lifecycle Event)
Jun 27 04:06:57.634548 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Took 15.39 seconds to build instance.
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <uuid>6a29bf7b-b8b2-41df-b546-800f5174319a</uuid>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <name>instance-00000010</name>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-522076333</nova:name>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:06:54</nova:creationTime>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:user uuid="6c2bd621defb420db9fd8345c5b36248">tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member</nova:user>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:project uuid="771234de69074fed81ffef19dcee2804">tempest-ServerBootFromVolumeStableRescueTest-2029132639</nova:project>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         <nova:port uuid="513ca15c-8969-4cfb-a8fc-b778700527e3">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <entry name="serial">6a29bf7b-b8b2-41df-b546-800f5174319a</entry>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <entry name="uuid">6a29bf7b-b8b2-41df-b546-800f5174319a</entry>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <alias name="ua-b3cb033a-10ae-4b8e-a03d-d217017f9ec3"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <serial>b3cb033a-10ae-4b8e-a03d-d217017f9ec3</serial>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.rescue"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <boot order="1"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d9:5e:65"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <target dev="tap513ca15c-89"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/console.log" append="off"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:06:57.800173 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:06:57.825588 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance destroyed successfully.
Jun 27 04:06:57.922238 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:06:57.922598 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:57.922772 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:58.124259 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:06:58.129644 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:06:58.139857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7ae6ea97-c24e-46c3-a3c2-1dbf3e6b1869 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.914s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:06:59.070443 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.091034 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance destroyed successfully.
Jun 27 04:06:59.091034 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'resources' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:06:59.195118 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:59.195118 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing instance network info cache due to event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:59.195330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:59.195403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:59.195665 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:59.216849 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-changed-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:06:59.216849 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Refreshing instance network info cache due to event network-changed-92555b08-0c16-4c81-b96f-0e1888a7a365. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:06:59.216849 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] Acquiring lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:06:59.216849 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] Acquired lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:06:59.216849 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Refreshing network info cache for port 92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:06:59.369887 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:59.370106 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:59.370245 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:06:59.370391 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] No VIF found with MAC fa:16:3e:d9:5e:65, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:06:59.371226 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Using config drive
Jun 27 04:06:59.604283 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: numa_topology,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:06:59.604283 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-730649319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-730649319',id=12,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGxs0vSaOLHtuQdOTSUvhM94RLL2OkChlIMhMQu9jKceEWYn7zdvETRnv7ji+7V/bmD9GnYnOws4r7cvDGn9+GQuzyBayOrSwdw/YJJ6IKT1u+wBoJDzp8TSXpvjOruGw==',key_name='tempest-keypair-1297937537',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:58Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-m4l5pg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member',shelved_at='2026-06-27T04:06:54.911568',shelved_host='np0000003830',shelved_image_id='2f671a53-6d1c-4e01-a652-2f172f4ef3bb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=f2a4a001-7934-403f-9b26-6b4ed727e22f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:06:59.604283 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:06:59.604283 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:06:59.604283 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcdcb8d4-1f, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=221ffb5c-ce4e-4ce7-b34a-674371660366) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.621698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:06:59.628720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:06:59.632291 np0000003830 nova-compute[98984]: INFO os_vif [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f')
Jun 27 04:06:59.632291 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Deleting instance files /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f_del
Jun 27 04:06:59.638316 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Deletion of /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f_del complete
Jun 27 04:06:59.705033 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:59.722214 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:06:59.876930 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'ec2_ids' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:00.224405 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:00.268712 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:00.274391 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Deleted allocations for instance f2a4a001-7934-403f-9b26-6b4ed727e22f
Jun 27 04:07:00.304929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:00.384942 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:00.384942 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'keypairs' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:00.515673 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updated VIF entry in instance network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:00.515933 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:00.546038 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updated VIF entry in instance network info cache for port 92555b08-0c16-4c81-b96f-0e1888a7a365. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:00.546038 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updating instance_info_cache with network_info: [{"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:00.780046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:00.780046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:00.889821 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:00.894132 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:01.019472 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-15d194ab-5d85-4ae9-8843-8c8b627baadb req-18508d6d-996d-48aa-a3af-bc09c7749173 service nova] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:01.039710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-15ae73f3-0086-4667-8c1c-d3cbc25781f0 req-f01a7924-d0e9-4e5c-bc82-fae71462aa8e service nova] Releasing lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:01.075706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:01.081913 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:01.242882 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Creating config drive at /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config.rescue
Jun 27 04:07:01.246874 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcbdxfxts {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:01.310610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcbdxfxts" returned: 0 in 0.063s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:01.592562 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:01.592868 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:01.596962 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:07:01.851594 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:01.881744 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:01.992784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:02.052803 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:02.097247 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:02.188889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:02.628883 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.846s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:02.628883 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.440s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:02.644440 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:02.644440 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Claim successful on node np0000003830
Jun 27 04:07:02.868125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:02.868344 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:03.110722 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 6a29bf7b-b8b2-41df-b546-800f5174319a due to new event <LifecycleEvent: 1782533223.108744, 6a29bf7b-b8b2-41df-b546-800f5174319a => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:07:03.110722 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533223.108744, 6a29bf7b-b8b2-41df-b546-800f5174319a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:03.110722 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Resumed (Lifecycle Event)
Jun 27 04:07:03.115216 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-68a987ae-11ab-4aa8-8a1f-30623c683b31 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:03.133113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecda8a92-ee99-4aea-bdec-7b491a457c64 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 16.200s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:03.314014 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004918360000374378 future=<Future at 0x7ec538133a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:03.314348 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:03.315205 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.309606889999941 future=<Future at 0x7ec5382c83b0 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:03.315205 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.309472125999946 future=<Future at 0x7ec5382c83b0 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:03.315205 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:03.315205 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533208.3132885, f2a4a001-7934-403f-9b26-6b4ed727e22f => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:03.315205 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Stopped (Lifecycle Event)
Jun 27 04:07:03.370997 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:07:03.616456 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:03.618603 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:03.819439 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:03.972215 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:04.072813 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:04.124320 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533224.1239116, 6a29bf7b-b8b2-41df-b546-800f5174319a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:04.124660 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Started (Lifecycle Event)
Jun 27 04:07:04.447883 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:04.447999 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:04.502252 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Unrescuing
Jun 27 04:07:04.502575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:04.502731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquired lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:04.502937 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:04.620933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:04.628487 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:04.630076 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:04.951937 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:05.005649 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:05.107262 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:05.107475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:05.107672 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Unshelving
Jun 27 04:07:05.132806 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 27 04:07:05.399657 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:05.460691 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.832s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:05.461393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.491s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:05.462065 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:07:05.469833 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:05.470015 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Claim successful on node np0000003830
Jun 27 04:07:05.598853 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updating instance_info_cache with network_info: [{"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:05.775616 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:05.968994 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:07:05.969821 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:07:05.970127 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:05.970411 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:06.100255 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7132d5dcadb043838976141746b8a26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a05730e4d204004b6dbe4c1389b8397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:07:06.103295 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Releasing lock "refresh_cache-6a29bf7b-b8b2-41df-b546-800f5174319a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:06.103911 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'flavor' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:06.473260 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:07:06.624834 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Booting with volume a85a04e9-dffd-44ca-b15b-231ca95dbcd7 at /dev/vdc
Jun 27 04:07:06.657716 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:06.699726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:06.735695 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:06.755327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:07:06.799792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:06.856111 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:07:06.856875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:07:06.877557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:07:06.877557 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:feb4:7b38', 'fe80::fc16:3eff:fe63:9e91', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe91:f128'] 
Jun 27 04:07:06.877557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:07:06.877557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:07:06.877557 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:06.878306 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating existing volume attachment record: 42ba033b-9dbf-4936-a4b8-c3f104788f45 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:07:06.894082 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:06.908184 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Successfully created port: 2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:07:06.922792 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:06.950613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:06.980153 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:07:07.010942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:07.030608 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99895424400006 future=<Future at 0x7ec538182630 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:07.036210 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.994993134000197 future=<Future at 0x7ec538182630 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:07.036210 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99478092000004 future=<Future at 0x7ec538182630 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:07.039765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:07.042162 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance destroyed successfully.
Jun 27 04:07:07.044850 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:07.237637 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:07.246103 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:07.476159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:07.487294 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:07.555271 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Object Instance<6a29bf7b-b8b2-41df-b546-800f5174319a> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:07.565960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:07.566378 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:08.010754 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:07:08.013090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:07:08.013090 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Creating image(s)
Jun 27 04:07:08.013090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "/opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:08.014021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:08.017633 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1b5ef274-7b56-4f67-a94b-7c8b529f7ab1 req-dcc4afa8-8c10-4bfc-8faf-1b080e5d3edc service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:08.017922 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1b5ef274-7b56-4f67-a94b-7c8b529f7ab1 req-dcc4afa8-8c10-4bfc-8faf-1b080e5d3edc service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:08.018615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1b5ef274-7b56-4f67-a94b-7c8b529f7ab1 req-dcc4afa8-8c10-4bfc-8faf-1b080e5d3edc service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:08.018615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1b5ef274-7b56-4f67-a94b-7c8b529f7ab1 req-dcc4afa8-8c10-4bfc-8faf-1b080e5d3edc service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:08.019478 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1b5ef274-7b56-4f67-a94b-7c8b529f7ab1 req-dcc4afa8-8c10-4bfc-8faf-1b080e5d3edc service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:08.019478 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-1b5ef274-7b56-4f67-a94b-7c8b529f7ab1 req-dcc4afa8-8c10-4bfc-8faf-1b080e5d3edc service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:07:08.021135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:08.022588 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:08.026463 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:08.028713 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:08.071642 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:08.159779 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:08.188704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.144s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:08.188704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:08.188704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:08.188704 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:08.188704 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:08.188704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:08.218464 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:08.302980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.121s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:08.303612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:08.341656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:08.386192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk 1073741824" returned: 0 in 0.082s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:08.388344 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:08.388344 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:08.423589 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Successfully updated port: 2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:07:08.441372 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:08.509638 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-changed-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:08.511017 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Refreshing instance network info cache due to event network-changed-2c75c4dc-87e1-4fc7-9a88-307115ff819c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:08.511017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] Acquiring lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:08.511017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] Acquired lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:08.511017 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Refreshing network info cache for port 2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:08.521124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.133s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:08.521888 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:07:08.522302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:08.573620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:08.575823 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:08.591773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.131s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:08.593785 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:07:08.629716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:08.630265 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Cannot resize image /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:07:08.630669 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:07:08.630890 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Ensure instance console log exists: /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:07:08.631205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:08.631407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:08.632488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:08.684941 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:08.684941 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:08.695899 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'pci_requests' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:08.930358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:09.017166 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:09.074935 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:09.085743 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Detaching volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3
Jun 27 04:07:09.098095 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:09.105683 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:07:09.105840 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:07:09.107330 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:09.107692 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:09.154239 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Attempting to driver detach volume 0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 from mountpoint /dev/vdb
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found disk vdb by alias ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found disk vdb by alias ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Attempting to detach device vdb from instance 9f560b0d-dc54-4d68-a06b-71401abd49eb from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:   <alias name="ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3"/>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:   <serial>0f4c8d2a-5f3d-4903-85de-3f93adcda6a3</serial>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:09.166530 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:07:09.177855 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully detached device vdb from instance 9f560b0d-dc54-4d68-a06b-71401abd49eb from the persistent domain config.
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] (1/8): Attempting to detach device vdb with device alias ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 from instance 9f560b0d-dc54-4d68-a06b-71401abd49eb from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:   <alias name="ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3"/>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:   <serial>0f4c8d2a-5f3d-4903-85de-3f93adcda6a3</serial>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:09.178424 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:07:09.195677 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'numa_topology' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:09.225015 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5b3e3af38a04d3ca28522d8a8f096cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3236f5b95c214c7b9d427a0edbbd0be3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:07:09.324526 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:09.367413 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 6a29bf7b-b8b2-41df-b546-800f5174319a due to new event <LifecycleEvent: 1782533229.3669114, 6a29bf7b-b8b2-41df-b546-800f5174319a => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:07:09.368349 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533229.3669114, 6a29bf7b-b8b2-41df-b546-800f5174319a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:09.368893 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Resumed (Lifecycle Event)
Jun 27 04:07:09.374797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d3bfb580-26de-433f-81ef-070b81f57c03 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:09.611630 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:07:09.622953 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:09.698775 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:09.698775 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Claim successful on node np0000003830
Jun 27 04:07:09.829090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e9cf4e77-ee85-4832-8ce4-069d0d168a4f req-8b62b2c8-57d9-4096-855c-e5c83e4ca481 service nova] Releasing lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:09.829090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:09.829317 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:09.847800 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Successfully created port: 201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:07:09.876426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:09.883818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:09.972156 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 for instance 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:07:10.114945 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state deleting.
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:10.159686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:10.160575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:10.161704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:10.162628 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:10.164594 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-279af228-ce1b-49eb-adda-9e2b799ff375 req-ace1e3e1-a72d-49f6-8057-9944c188375d service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:10.399408 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533230.3982549, 6a29bf7b-b8b2-41df-b546-800f5174319a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:10.399408 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Started (Lifecycle Event)
Jun 27 04:07:10.442406 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:10.645768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:10.646054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:10.646252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:10.646510 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:10.646895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:10.667400 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Terminating instance
Jun 27 04:07:10.791612 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:10.822023 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Successfully updated port: 201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:07:10.914665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:10.916334 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-changed-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:10.916738 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Refreshing instance network info cache due to event network-changed-201269ed-ada5-4a0f-8314-e35fd2e65d29. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:10.917118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] Acquiring lock "refresh_cache-3a600689-63f3-47f6-8769-bd67329eb0a4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:10.917427 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] Acquired lock "refresh_cache-3a600689-63f3-47f6-8769-bd67329eb0a4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:10.917737 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Refreshing network info cache for port 201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:10.929069 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:11.044031 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updating instance_info_cache with network_info: [{"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:11.133444 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:07:11.135587 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:07:11.142232 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Creating image(s)
Jun 27 04:07:11.143860 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:11.145090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "/opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:11.145279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "/opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:11.146534 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:11.152678 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:11.155177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:11.183953 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:07:11.228510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.233459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.263428 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.266026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:11.266937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:11.267305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:11.267889 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:11.277792 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:11.278543 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:11.329087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "refresh_cache-3a600689-63f3-47f6-8769-bd67329eb0a4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:11.397456 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:11.398259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:11.438106 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 27 04:07:11.443170 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:11.449152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533231.4418428, 9f560b0d-dc54-4d68-a06b-71401abd49eb => ua-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:07:11.466161 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully detached device vdb from instance 9f560b0d-dc54-4d68-a06b-71401abd49eb from the live domain config.
Jun 27 04:07:11.469428 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:07:11.470174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:11.470174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:11.470547 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:11.475159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:07:11.475380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:07:11.476056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk 1073741824" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:11.476867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:11.477658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:11.499266 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.527464 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:11.532941 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:11.533337 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:11.533599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '32')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:07:11.533688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '26')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:11.535281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3', '25')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:11.536789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec54da85da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'): ({'sdf'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:07:11.537136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:07:11.537465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flush multipath device 3300000007e545aa9 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:07:11.542522 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.547096 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:11.547826 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Instance network_info: |[{"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:07:11.553962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Start _get_guest_xml network_info=[{"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:07:11.557981 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999506205999978 future=<Future at 0x7ec5183633b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:11.561080 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:11.563775 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='1be2d4c5-613b-40a0-97f5-e9776d36a813'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533231.5627918) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:07:11.571474 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Instance destroyed successfully.
Jun 27 04:07:11.571474 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'resources' on Instance uuid 6a29bf7b-b8b2-41df-b546-800f5174319a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:11.577388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:07:11.578810 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:07:11.593602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:11.599636 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:07:11.601175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:07:11.605579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.123s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:11.607331 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:07:11.607331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:11.654028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:07:11.669398 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:07:11.669398 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:07:11.669655 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:07:11.674358 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:07:11.678774 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:11.682842 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:07:11.683601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:07:11.683601 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:07:11.685074 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:07:11.691482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:11.691482 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:07:11.692587 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:11.699375 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:07:11.700193 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:07:11.735687 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=19,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-h0qre21m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=1be2d4c5-613b-40a0-97f5-e9776d36a813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:07:11.745995 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:11.745995 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:11.745995 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'pci_devices' on Instance uuid 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:11.756602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:11.757184 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Cannot resize image /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:07:11.757487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:07:11.757952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Ensure instance console log exists: /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:07:11.759081 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:07:11.759193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:07:11.768025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:11.768601 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:11.768601 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:11.770613 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:07:11.793959 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:07:11.794484 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:07:11.817172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:11.869080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260]
Jun 27 04:07:11.869080 np0000003830 nova-compute[98984]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:11.869080 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:11.900428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:11.915468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:11.962990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260]
Jun 27 04:07:11.962990 np0000003830 nova-compute[98984]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-0f4c8d2a-5f3d-4903-85de-3f93adcda6a3, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:11.962990 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:11.987670 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:11.998386 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:11.998544 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:12.003379 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.003379 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.533s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:12.003873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== disconnect_volume: return (534ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:12.004116 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:07:12.092375 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-522076333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-522076333',id=16,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:03Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-ahja7564',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:07:09Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6a29bf7b-b8b2-41df-b546-800f5174319a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:12.092704 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "513ca15c-8969-4cfb-a8fc-b778700527e3", "address": "fa:16:3e:d9:5e:65", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap513ca15c-89", "ovs_interfaceid": "513ca15c-8969-4cfb-a8fc-b778700527e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:12.093777 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:12.094181 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:12.095582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.095809 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap513ca15c-89, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.097176 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.098526 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:12.099620 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.100710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.100867 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52538d55-1e6f-4edc-b784-7a63622b0f2c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.102314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.103648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.109194 np0000003830 nova-compute[98984]: INFO os_vif [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:5e:65,bridge_name='br-int',has_traffic_filtering=True,id=513ca15c-8969-4cfb-a8fc-b778700527e3,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap513ca15c-89')
Jun 27 04:07:12.111782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:07:12.112135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:12.112379 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:12.112824 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:12.113241 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:07:12.113436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3 (non-flash)
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '32')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:07:12.153432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '31')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:12.156372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3', '32')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:12.158774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538295c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:07:12.158774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:07:12.158774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flush multipath device 330000000dc0460c8 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:07:12.231934 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <uuid>1be2d4c5-613b-40a0-97f5-e9776d36a813</uuid>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <name>instance-00000013</name>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:name>multiattach-server-1</nova:name>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:07:11</nova:creationTime>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         <nova:port uuid="2c75c4dc-87e1-4fc7-9a88-307115ff819c">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <entry name="serial">1be2d4c5-613b-40a0-97f5-e9776d36a813</entry>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <entry name="uuid">1be2d4c5-613b-40a0-97f5-e9776d36a813</entry>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.config"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:37:2f:2e"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <target dev="tap2c75c4dc-87"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/console.log" append="off"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Preparing to wait for external event network-vif-plugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=19,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-h0qre21m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=1be2d4c5-613b-40a0-97f5-e9776d36a813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:07:12.254650 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:12.261286 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:12.261286 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:07:12.261286 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.261286 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.261286 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:07:12.262705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.262705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd33bb021-3f6a-5bdf-a793-23654c9f160c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.262879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.263620 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:12.265481 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.270610 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.270610 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c75c4dc-87, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.270610 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c75c4dc-87, col_values=(('qos', UUID('40cb9534-ca9f-4c30-8d2d-29909d75449b')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.270610 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c75c4dc-87, col_values=(('external_ids', {'iface-id': '2c75c4dc-87e1-4fc7-9a88-307115ff819c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:2f:2e', 'vm-uuid': '1be2d4c5-613b-40a0-97f5-e9776d36a813'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:12.273199 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.277814 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:12.285141 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:12.285907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:12.286379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:12.286635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:12.287002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:12.287210 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:12.287355 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:12.287696 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:12.288446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: INFO os_vif [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87')
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state deleting.
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:12.295775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:12.298036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:12.298036 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:12.298036 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state deleting.
Jun 27 04:07:12.298036 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:12.298036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:12.298341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:12.298341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:12.298549 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:12.298686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:12.298828 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:12.298936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:12.299133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:12.299319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:12.299438 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:12.299578 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:12.299709 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-958b6165-4773-468f-aa38-184de391964c req-9d4c262d-7a98-4e87-b16b-c08a1ea8237a service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:12.356589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:07:12.356869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:07:12.358109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:07:12.372104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:07:12.372363 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:07:12.395302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.432287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.40.100,3260]
Jun 27 04:07:12.432287 np0000003830 nova-compute[98984]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:12.432287 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.452206 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.473671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.493740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bb5baa12-3f8a-46cc-a26e-66c75ee01b96 req-8f497215-128f-479b-9b56-7dcf28fece36 service nova] Releasing lock "refresh_cache-3a600689-63f3-47f6-8769-bd67329eb0a4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:12.494485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquired lock "refresh_cache-3a600689-63f3-47f6-8769-bd67329eb0a4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:12.494840 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:12.512185 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:12.527443 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.50.100,3260]
Jun 27 04:07:12.527443 np0000003830 nova-compute[98984]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-b3cb033a-10ae-4b8e-a03d-d217017f9ec3, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:12.527443 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.557526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:12.557526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:12.557526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== disconnect_volume: return (443ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:12.557526 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:07:12.557526 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Deleting instance files /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a_del
Jun 27 04:07:12.557526 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Deletion of /opt/stack/data/nova/instances/6a29bf7b-b8b2-41df-b546-800f5174319a_del complete
Jun 27 04:07:12.609176 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'flavor' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:13.029291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.344s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:13.030287 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:13.067263 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Took 1.88 seconds to destroy the instance on the hypervisor.
Jun 27 04:07:13.070074 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:07:13.070998 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:07:13.070998 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:07:13.070998 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:13.135491 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:13.183849 np0000003830 nova-compute[98984]: INFO nova.network.neutron [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 with attributes {'binding:host_id': 'np0000003830', 'device_owner': 'compute:nova'}
Jun 27 04:07:13.238441 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:13.617735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-67896648-a1be-4896-a3a2-161fbfd907ce tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.044s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:13.686123 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:13.753434 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ce19479-02d9-4c39-99f6-b5b57327fe02 req-177d5d06-0447-4154-b9b5-2478035a3153 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-deleted-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:13.753434 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-0ce19479-02d9-4c39-99f6-b5b57327fe02 req-177d5d06-0447-4154-b9b5-2478035a3153 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Neutron deleted interface 513ca15c-8969-4cfb-a8fc-b778700527e3; detaching it from the instance and deleting it from the info cache
Jun 27 04:07:13.761005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ce19479-02d9-4c39-99f6-b5b57327fe02 req-177d5d06-0447-4154-b9b5-2478035a3153 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Detach interface failed, port_id=513ca15c-8969-4cfb-a8fc-b778700527e3, reason: Instance 6a29bf7b-b8b2-41df-b546-800f5174319a could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:07:13.819559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:13.819559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:13.819559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:37:2f:2e, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:13.819559 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Using config drive
Jun 27 04:07:13.900271 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Updating instance_info_cache with network_info: [{"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:14.077994 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.155854 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:14.163148 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:14.163326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:14.164121 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:14.222865 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.223932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.223932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.223932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.223932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:14.227382 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Terminating instance
Jun 27 04:07:14.246739 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:14.246841 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing instance network info cache due to event network-changed-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:14.247089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] Acquiring lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:14.326333 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:14.368157 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:14.368157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.368157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.368682 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:14.368682 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:14.372771 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state deleting.
Jun 27 04:07:14.373052 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:14.373292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.373525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.373703 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:14.373894 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:14.374431 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received unexpected event network-vif-plugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with vm_state active and task_state deleting.
Jun 27 04:07:14.374612 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:14.374794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.375007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.375147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:14.375303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] No waiting events found dispatching network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:14.375442 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received unexpected event network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 for instance with vm_state building and task_state spawning.
Jun 27 04:07:14.375596 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:14.375745 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Acquiring lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.375913 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.376026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:14.376127 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] No waiting events found dispatching network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:14.376260 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-990be1fd-7f7c-4b61-b505-580e5e63df0d req-e87ee286-7d1e-4373-8155-ecabe86149b1 service nova] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Received event network-vif-unplugged-513ca15c-8969-4cfb-a8fc-b778700527e3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:14.407240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Releasing lock "refresh_cache-3a600689-63f3-47f6-8769-bd67329eb0a4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:14.407240 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Instance network_info: |[{"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:07:14.407240 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Start _get_guest_xml network_info=[{"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:07:14.414143 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:14.416839 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-826033651', uuid='3a600689-63f3-47f6-8769-bd67329eb0a4'), owner=OwnerMeta(userid='f5b3e3af38a04d3ca28522d8a8f096cf', username='tempest-VolumesAdminNegativeTest-1078121591-project-member', projectid='3236f5b95c214c7b9d427a0edbbd0be3', projectname='tempest-VolumesAdminNegativeTest-1078121591'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533234.416332) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:07:14.420187 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:07:14.420726 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:07:14.422519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:07:14.423199 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:07:14.425661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:07:14.425661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:07:14.425661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:07:14.425661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:07:14.425661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:07:14.425661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:07:14.426215 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:07:14.426564 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:07:14.426908 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:07:14.427178 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:07:14.427412 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:07:14.427693 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:07:14.448833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-826033651',display_name='tempest-VolumesAdminNegativeTest-server-826033651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesadminnegativetest-server-826033651',id=20,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3236f5b95c214c7b9d427a0edbbd0be3',ramdisk_id='',reservation_id='r-c33cy5pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1078121591',owner_user_name='tempest-VolumesAdminNegativeTest-1078121591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:10Z,user_data=None,user_id='f5b3e3af38a04d3ca28522d8a8f096cf',uuid=3a600689-63f3-47f6-8769-bd67329eb0a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:07:14.448833 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Converting VIF {"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:14.450488 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:14.451447 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a600689-63f3-47f6-8769-bd67329eb0a4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:14.527853 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Creating config drive at /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.config
Jun 27 04:07:14.536178 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpspwxe2l3 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:14.598763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpspwxe2l3" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:14.658690 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Took 1.59 seconds to deallocate network for instance.
Jun 27 04:07:14.671000 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:14.732598 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:07:14.785546 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.810772 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <uuid>3a600689-63f3-47f6-8769-bd67329eb0a4</uuid>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <name>instance-00000014</name>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesAdminNegativeTest-server-826033651</nova:name>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:07:14</nova:creationTime>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:user uuid="f5b3e3af38a04d3ca28522d8a8f096cf">tempest-VolumesAdminNegativeTest-1078121591-project-member</nova:user>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:project uuid="3236f5b95c214c7b9d427a0edbbd0be3">tempest-VolumesAdminNegativeTest-1078121591</nova:project>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         <nova:port uuid="201269ed-ada5-4a0f-8314-e35fd2e65d29">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <entry name="serial">3a600689-63f3-47f6-8769-bd67329eb0a4</entry>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <entry name="uuid">3a600689-63f3-47f6-8769-bd67329eb0a4</entry>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.config"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d9:22:3e"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <target dev="tap201269ed-ad"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/console.log" append="off"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:07:14.957681 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Preparing to wait for external event network-vif-plugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-826033651',display_name='tempest-VolumesAdminNegativeTest-server-826033651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesadminnegativetest-server-826033651',id=20,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3236f5b95c214c7b9d427a0edbbd0be3',ramdisk_id='',reservation_id='r-c33cy5pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1078121591',owner_user_name='tempest-VolumesAdminNegativeTest-1078121591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:10Z,user_data=None,user_id='f5b3e3af38a04d3ca28522d8a8f096cf',uuid=3a600689-63f3-47f6-8769-bd67329eb0a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Converting VIF {"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:14.962290 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:07:14.963832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.964184 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:14.964522 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:07:14.965969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.966370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '621d167d-468f-586f-a4a0-3afa2ea780eb', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:14.971658 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:14.983999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.992178 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.992416 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap201269ed-ad, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:14.995542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap201269ed-ad, col_values=(('qos', UUID('25c7e5fd-a2d2-44ff-b445-f0f5c772e249')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:14.995542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap201269ed-ad, col_values=(('external_ids', {'iface-id': '201269ed-ada5-4a0f-8314-e35fd2e65d29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:22:3e', 'vm-uuid': '3a600689-63f3-47f6-8769-bd67329eb0a4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:14.996012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:14.997443 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:15.010734 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.017378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.017545 np0000003830 nova-compute[98984]: INFO os_vif [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad')
Jun 27 04:07:15.037062 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.197973 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:15.258090 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Took 0.60 seconds to detach 1 volumes for instance.
Jun 27 04:07:15.260793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Deleting volume: b3cb033a-10ae-4b8e-a03d-d217017f9ec3 {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:07:15.348376 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999442197999997 future=<Future at 0x7ec538172360 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:15.365663 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Instance destroyed successfully.
Jun 27 04:07:15.366712 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'resources' on Instance uuid 9f560b0d-dc54-4d68-a06b-71401abd49eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:15.370669 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.423982 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.430385 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.458942 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:15.527108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.586424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.599840 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.831239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:15.832053 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:15.877942 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1323519502',display_name='tempest-ServerActionsTestOtherA-server-1695091996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-tempest-common-compute-instance-1323519502',id=11,image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI9xfxfD6g5hHXvRwB1cGd+3Ord0BopOOvhperZGd/ghdEcMyEp1xbdxEVjA/3QZyaRwnT7dLUUdrrnyVKJXYDGNJzWn8jrrRHLF1SlO5BgRPvlwjOpfHMYPHjDmELizw==',key_name='tempest-keypair-625566794',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:28Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-830mrx90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=9f560b0d-dc54-4d68-a06b-71401abd49eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:15.878460 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "address": "fa:16:3e:63:9e:91", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcae96b34-24", "ovs_interfaceid": "cae96b34-24ed-4e2c-bbb8-8659432395f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:15.878959 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:15.879261 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:15.880790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.881047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcae96b34-24, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:15.887607 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.888946 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:15.895756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.896757 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.896913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc6c4d7f-62f3-4f8f-8066-21aa7cfba94b) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:15.897687 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.897997 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:15.908410 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:15.910730 np0000003830 nova-compute[98984]: INFO os_vif [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:9e:91,bridge_name='br-int',has_traffic_filtering=True,id=cae96b34-24ed-4e2c-bbb8-8659432395f6,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcae96b34-24')
Jun 27 04:07:15.910730 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Deleting instance files /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb_del
Jun 27 04:07:15.911738 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Deletion of /opt/stack/data/nova/instances/9f560b0d-dc54-4d68-a06b-71401abd49eb_del complete
Jun 27 04:07:15.962028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:15.963960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:07:15.964421 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Creating image(s)
Jun 27 04:07:15.965305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] Acquired lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:15.966054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:15.966306 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Refreshing network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:15.967346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:15.973284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:15.973653 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:16.421706 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Took 1.69 seconds to destroy the instance on the hypervisor.
Jun 27 04:07:16.422868 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:07:16.423363 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:07:16.423600 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:07:16.424000 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:16.464887 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:16.464887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:16.464887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:16.464887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:16.464887 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:16.464887 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:16.465275 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:16.465275 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] Acquiring lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:16.465386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:16.465872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:16.466548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] No waiting events found dispatching network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:16.466696 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8330748c-a55b-4576-a300-f0f7c20b71cc req-18bf722f-c631-41aa-94c1-877548bfb505 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-unplugged-cae96b34-24ed-4e2c-bbb8-8659432395f6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:16.472900 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:16.477051 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:16.477895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "4882765990136caebaac568f161e306f6e0825b5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:16.479000 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4882765990136caebaac568f161e306f6e0825b5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:16.494884 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533236.4944887, 1be2d4c5-613b-40a0-97f5-e9776d36a813 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:16.495074 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] VM Started (Lifecycle Event)
Jun 27 04:07:16.560215 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:16.560215 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:16.560215 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] No VIF found with MAC fa:16:3e:d9:22:3e, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:16.560215 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Using config drive
Jun 27 04:07:16.586672 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:16.779527 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:16.779887 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:16.960109 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:16.999229 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:17.005657 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533237.005325, 1be2d4c5-613b-40a0-97f5-e9776d36a813 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:17.006997 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] VM Paused (Lifecycle Event)
Jun 27 04:07:17.068139 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:17.283077 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:17.292222 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updated VIF entry in instance network info cache for port bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:17.292605 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:17.372469 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Creating config drive at /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.config
Jun 27 04:07:17.391709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppao0obyy {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:17.455327 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppao0obyy" returned: 0 in 0.063s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:17.470218 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-97ab71d0-ac9d-4286-a015-efe81fea542c req-32431efb-f906-4886-ac66-9cb34ca9d854 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-plugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:17.470917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-97ab71d0-ac9d-4286-a015-efe81fea542c req-32431efb-f906-4886-ac66-9cb34ca9d854 service nova] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:17.470998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-97ab71d0-ac9d-4286-a015-efe81fea542c req-32431efb-f906-4886-ac66-9cb34ca9d854 service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:17.471296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-97ab71d0-ac9d-4286-a015-efe81fea542c req-32431efb-f906-4886-ac66-9cb34ca9d854 service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:17.471484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-97ab71d0-ac9d-4286-a015-efe81fea542c req-32431efb-f906-4886-ac66-9cb34ca9d854 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Processing event network-vif-plugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:07:17.473011 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:07:17.481028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:07:17.486794 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Instance spawned successfully.
Jun 27 04:07:17.488673 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:07:17.513400 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:17.520386 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533237.5195768, 1be2d4c5-613b-40a0-97f5-e9776d36a813 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:17.520386 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] VM Resumed (Lifecycle Event)
Jun 27 04:07:17.800338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2cc0f56b-a80d-4e0a-8b04-b6c31fc4aaa6 req-bb0d0a53-45c6-4b4f-b994-d31453597ad2 service nova] Releasing lock "refresh_cache-f2a4a001-7934-403f-9b26-6b4ed727e22f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:17.803680 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.971s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:17.814289 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:17.819641 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:17.819641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:17.845288 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:17.930806 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Deleted allocations for instance 6a29bf7b-b8b2-41df-b546-800f5174319a
Jun 27 04:07:17.934225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:17.934743 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] 2f671a53-6d1c-4e01-a652-2f172f4ef3bb was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:07:17.940217 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:07:17.940217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.part /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:18.008877 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:18.009048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:18.009845 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:18.010288 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:18.010778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:18.011330 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:18.026144 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:18.032366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:18.069127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:18.071525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:18.098179 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:18.240955 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:18.286029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.part /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.converted" returned: 0 in 0.347s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:18.312967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:18.358616 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Took 1.93 seconds to deallocate network for instance.
Jun 27 04:07:18.372851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:18.375671 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:18.427848 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5.converted --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:18.427848 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4882765990136caebaac568f161e306f6e0825b5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.948s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:18.427848 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:18.431810 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:18.433469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:18.521102 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Took 10.51 seconds to spawn the instance on the hypervisor.
Jun 27 04:07:18.521654 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:18.530251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5 --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:18.532907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "4882765990136caebaac568f161e306f6e0825b5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:18.533356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4882765990136caebaac568f161e306f6e0825b5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:18.533849 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:18.537960 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:18.539084 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:18.562076 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:07:18.568525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:18.582021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f71917c0-168f-4dcc-902b-68e78853dcab req-3d5802e3-777a-47d9-b623-786546826670 service nova] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Received event network-vif-deleted-cae96b34-24ed-4e2c-bbb8-8659432395f6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:18.582234 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f71917c0-168f-4dcc-902b-68e78853dcab req-3d5802e3-777a-47d9-b623-786546826670 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-plugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:18.584440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f71917c0-168f-4dcc-902b-68e78853dcab req-3d5802e3-777a-47d9-b623-786546826670 service nova] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:18.584992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f71917c0-168f-4dcc-902b-68e78853dcab req-3d5802e3-777a-47d9-b623-786546826670 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:18.585759 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f71917c0-168f-4dcc-902b-68e78853dcab req-3d5802e3-777a-47d9-b623-786546826670 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:18.585910 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f71917c0-168f-4dcc-902b-68e78853dcab req-3d5802e3-777a-47d9-b623-786546826670 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Processing event network-vif-plugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:07:18.656440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5 --force-share --output=json" returned: 0 in 0.118s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:18.657013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5,backing_fmt=raw /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:18.714407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5,backing_fmt=raw /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk 1073741824" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:18.715146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4882765990136caebaac568f161e306f6e0825b5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:18.716269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:18.814998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4882765990136caebaac568f161e306f6e0825b5 --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:18.815730 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'migration_context' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:18.881998 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:07:18.888881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:18.889302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:18.966020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9b6e8192-9a31-49db-83ff-68408d36bacb tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6a29bf7b-b8b2-41df-b546-800f5174319a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.320s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:19.020979 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:19.041148 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Took 16.93 seconds to build instance.
Jun 27 04:07:19.083011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:19.242439 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:07:19.247231 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533239.2455611, 3a600689-63f3-47f6-8769-bd67329eb0a4 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:19.247479 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:07:19.248122 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] VM Started (Lifecycle Event)
Jun 27 04:07:19.262862 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Instance spawned successfully.
Jun 27 04:07:19.264808 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:07:19.319181 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:19.319776 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Rebasing disk image.
Jun 27 04:07:19.320211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:19.426827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:19.427370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 -F raw /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:19.478356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:19.546571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.465s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:19.573194 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cd782755-1c89-4c51-adf0-4b1263a72be5 req-8c59fa7d-0783-403e-b637-61711fd14f7e service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-plugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:19.573194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cd782755-1c89-4c51-adf0-4b1263a72be5 req-8c59fa7d-0783-403e-b637-61711fd14f7e service nova] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:19.573194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cd782755-1c89-4c51-adf0-4b1263a72be5 req-8c59fa7d-0783-403e-b637-61711fd14f7e service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:19.573194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cd782755-1c89-4c51-adf0-4b1263a72be5 req-8c59fa7d-0783-403e-b637-61711fd14f7e service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:19.573194 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cd782755-1c89-4c51-adf0-4b1263a72be5 req-8c59fa7d-0783-403e-b637-61711fd14f7e service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] No waiting events found dispatching network-vif-plugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:19.573194 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-cd782755-1c89-4c51-adf0-4b1263a72be5 req-8c59fa7d-0783-403e-b637-61711fd14f7e service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received unexpected event network-vif-plugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c for instance with vm_state active and task_state None.
Jun 27 04:07:19.757316 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:19.760911 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:19.784466 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:19.785020 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:19.785214 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:19.786739 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:19.786983 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:19.787275 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:19.846802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:19.847121 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:20.235062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:20.235062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:20.235062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:20.235062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:20.235062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:20.240061 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Terminating instance
Jun 27 04:07:20.264272 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:07:20.264979 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533240.2646596, 3a600689-63f3-47f6-8769-bd67329eb0a4 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:20.265137 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] VM Paused (Lifecycle Event)
Jun 27 04:07:20.296563 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Took 9.16 seconds to spawn the instance on the hypervisor.
Jun 27 04:07:20.298812 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:20.352118 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:20.652770 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4350b7b1-71c5-4283-90cc-ca4c4b255b00 req-a8a78a19-b0af-4dba-86e8-ef19b0bda400 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-plugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:20.653167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4350b7b1-71c5-4283-90cc-ca4c4b255b00 req-a8a78a19-b0af-4dba-86e8-ef19b0bda400 service nova] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:20.653167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4350b7b1-71c5-4283-90cc-ca4c4b255b00 req-a8a78a19-b0af-4dba-86e8-ef19b0bda400 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:20.653477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4350b7b1-71c5-4283-90cc-ca4c4b255b00 req-a8a78a19-b0af-4dba-86e8-ef19b0bda400 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:20.653477 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4350b7b1-71c5-4283-90cc-ca4c4b255b00 req-a8a78a19-b0af-4dba-86e8-ef19b0bda400 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] No waiting events found dispatching network-vif-plugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:20.653676 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4350b7b1-71c5-4283-90cc-ca4c4b255b00 req-a8a78a19-b0af-4dba-86e8-ef19b0bda400 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received unexpected event network-vif-plugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 for instance with vm_state active and task_state None.
Jun 27 04:07:20.702561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 -F raw /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk" returned: 0 in 1.275s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:20.711532 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:07:20.711532 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:07:20.711532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:20.711532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:20.711532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:20.718633 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Start _get_guest_xml network_info=[{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='ade9f0e152c8f8b1388805602c613b19',container_format='bare',created_at=2026-06-27T04:06:46Z,direct_url=<?>,disk_format='qcow2',id=2f671a53-6d1c-4e01-a652-2f172f4ef3bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-730649319-shelved',owner='469d72ff5a3640dbb2193b8a91deeac0',properties=ImageMetaProps,protected=<?>,size=54067200,status='active',tags=<?>,updated_at=2026-06-27T04:06:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '42ba033b-9dbf-4936-a4b8-c3f104788f45', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'f2a4a001-7934-403f-9b26-6b4ed727e22f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'serial': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:07:20.721025 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:20.722329 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-730649319', uuid='f2a4a001-7934-403f-9b26-6b4ed727e22f'), owner=OwnerMeta(userid='a996571fb63c4c6e993f1fa02549a086', username='tempest-AttachVolumeShelveTestJSON-1443827218-project-member', projectid='469d72ff5a3640dbb2193b8a91deeac0', projectname='tempest-AttachVolumeShelveTestJSON-1443827218'), image=ImageMeta(id='2f671a53-6d1c-4e01-a652-2f172f4ef3bb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533240.7219634) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:07:20.724173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:07:20.724173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:07:20.724527 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:07:20.724762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:07:20.726017 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:07:20.726017 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ade9f0e152c8f8b1388805602c613b19',container_format='bare',created_at=2026-06-27T04:06:46Z,direct_url=<?>,disk_format='qcow2',id=2f671a53-6d1c-4e01-a652-2f172f4ef3bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-730649319-shelved',owner='469d72ff5a3640dbb2193b8a91deeac0',properties=ImageMetaProps,protected=<?>,size=54067200,status='active',tags=<?>,updated_at=2026-06-27T04:06:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:07:20.727286 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:07:20.727591 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:07:20.727591 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:07:20.727667 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:07:20.727920 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:20.752071 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:07:20.769171 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:20.779753 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533240.7791107, 3a600689-63f3-47f6-8769-bd67329eb0a4 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:20.779753 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] VM Resumed (Lifecycle Event)
Jun 27 04:07:20.789639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:20.794159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:20.813845 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Took 16.93 seconds to build instance.
Jun 27 04:07:20.822837 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:20.865658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.976s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:20.867763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.390s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:20.871881 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:20.872043 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Claim successful on node np0000003830
Jun 27 04:07:20.897222 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:20.943261 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Deleted allocations for instance 9f560b0d-dc54-4d68-a06b-71401abd49eb
Jun 27 04:07:20.993345 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.001792 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.064645 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.075626 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.099480 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Instance destroyed successfully.
Jun 27 04:07:21.100105 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'resources' on Instance uuid 2b2205db-f373-46fc-88c2-414fc5a376e2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:21.232521 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:21.248800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:07:21.249236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:21.249437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:21.249999 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:21.250471 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:07:21.271268 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:21.272275 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:21.273256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:21.273801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:21.274070 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:21.274486 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:21.287101 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:21.288514 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:21.293898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:21.293898 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:21.296014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:21.296014 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7] added
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:21.314485 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:21.315997 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:21.316402 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:21.318933 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:21.323123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aba3b50c-796e-4363-82ea-a9573538be8c tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.454s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7] added
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0511(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:21.326659 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:21.427865 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6829e8ab-e5a5-457e-a52d-06768333b005 req-11add30d-f0f6-499b-aa19-761b0e61f168 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-unplugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:21.428676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6829e8ab-e5a5-457e-a52d-06768333b005 req-11add30d-f0f6-499b-aa19-761b0e61f168 service nova] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:21.431074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6829e8ab-e5a5-457e-a52d-06768333b005 req-11add30d-f0f6-499b-aa19-761b0e61f168 service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:21.431271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6829e8ab-e5a5-457e-a52d-06768333b005 req-11add30d-f0f6-499b-aa19-761b0e61f168 service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:21.431983 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6829e8ab-e5a5-457e-a52d-06768333b005 req-11add30d-f0f6-499b-aa19-761b0e61f168 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] No waiting events found dispatching network-vif-unplugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:21.432163 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6829e8ab-e5a5-457e-a52d-06768333b005 req-11add30d-f0f6-499b-aa19-761b0e61f168 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-unplugged-253bf142-4243-4f79-9c0d-0884ae4da836 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:21.604242 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-825458655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-825458655',id=13,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:07Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-rek1gxiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:06:18Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=2b2205db-f373-46fc-88c2-414fc5a376e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:21.604242 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "253bf142-4243-4f79-9c0d-0884ae4da836", "address": "fa:16:3e:b4:7b:38", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap253bf142-42", "ovs_interfaceid": "253bf142-4243-4f79-9c0d-0884ae4da836", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:21.606596 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:21.606596 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:21.608387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.608537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap253bf142-42, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:21.609942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.611466 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:21.612568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.613806 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.614199 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f5053d6-7966-42c8-8f5c-96a766303ba7) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:21.614747 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:21.616162 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:21.620520 np0000003830 nova-compute[98984]: INFO os_vif [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7b:38,bridge_name='br-int',has_traffic_filtering=True,id=253bf142-4243-4f79-9c0d-0884ae4da836,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253bf142-42')
Jun 27 04:07:21.621046 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Deleting instance files /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2_del
Jun 27 04:07:21.622049 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Deletion of /opt/stack/data/nova/instances/2b2205db-f373-46fc-88c2-414fc5a376e2_del complete
Jun 27 04:07:21.642946 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-changed-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:21.644681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Refreshing instance network info cache due to event network-changed-92555b08-0c16-4c81-b96f-0e1888a7a365. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:21.646900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] Acquiring lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:21.646900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] Acquired lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:21.646900 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Refreshing network info cache for port 92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:21.795833 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999691051000127 future=<Future at 0x7ec538171fd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:21.956917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a317851-1aea-46a4-84cc-97e2a145bcd6 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "9f560b0d-dc54-4d68-a06b-71401abd49eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.734s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:22.030922 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0018776579997847875 future=<Future at 0x7ec538182630 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:22.031067 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:22.031242 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.525798736999832 future=<Future at 0x7ec5183633b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:22.031369 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.525654193999799 future=<Future at 0x7ec5183633b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:22.129305 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 27 04:07:22.130046 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:07:22.130299 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:07:22.130417 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:07:22.130743 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:22.152265 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:22.205870 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:22.206806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:22.279781 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:22.319324 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:22.326530 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:22.335619 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:22.345531 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.351159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.359978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.368971 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.368971 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.368971 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.368971 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.368971 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:22.369270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.369270 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.369270 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.369270 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.369270 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:22.381411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.381411 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.381411 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.381411 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.381411 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:22.381651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.381651 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.381651 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.381651 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.381651 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:22.411273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.50.100,3260]
Jun 27 04:07:22.411273 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:22.411273 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.435162 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.449213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.40.100,3260]
Jun 27 04:07:22.449213 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:22.449213 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.458952 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.459283 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:22.459454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:22.460201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:22.462128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] HCTL ('7', '-', '-', 0) found on session 33 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:22.462377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:22.473271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:22.497148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:22.497982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:22.506871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching for a device in session 33 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:22.506871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:22.506871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] HCTL ('8', '-', '-', 0) found on session 34 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:22.507099 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:22.537867 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:22.714780 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:22.741631 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:22.797405 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:22.798221 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:22.814566 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4f42594f-2f11-4a36-8a42-319571a2ba0e req-8dc0ee98-b868-4e96-aadc-ac3deb3bedc9 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-deleted-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:22.814719 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-4f42594f-2f11-4a36-8a42-319571a2ba0e req-8dc0ee98-b868-4e96-aadc-ac3deb3bedc9 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Neutron deleted interface 253bf142-4243-4f79-9c0d-0884ae4da836; detaching it from the instance and deleting it from the info cache
Jun 27 04:07:22.819543 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4f42594f-2f11-4a36-8a42-319571a2ba0e req-8dc0ee98-b868-4e96-aadc-ac3deb3bedc9 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Detach interface failed, port_id=253bf142-4243-4f79-9c0d-0884ae4da836, reason: Instance 2b2205db-f373-46fc-88c2-414fc5a376e2 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:07:22.833263 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:22.834226 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:07:22.957220 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updated VIF entry in instance network info cache for port 92555b08-0c16-4c81-b96f-0e1888a7a365. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:22.957914 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updating instance_info_cache with network_info: [{"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:23.233915 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:23.301222 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:23.461520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] Releasing lock "refresh_cache-c702a025-f366-4383-9aa7-4fe61cfb64b8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:23.461736 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-changed-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:23.461898 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Refreshing instance network info cache due to event network-changed-2c75c4dc-87e1-4fc7-9a88-307115ff819c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:23.462102 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] Acquiring lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:23.462337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] Acquired lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:23.463919 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Refreshing network info cache for port 2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:23.539032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:23.539032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:23.543293 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adb7d1c1-a457-49e5-ba03-ed26e0c8a105 req-d4332f50-d457-4020-8815-c5c010ebb047 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-unplugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:23.543596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adb7d1c1-a457-49e5-ba03-ed26e0c8a105 req-d4332f50-d457-4020-8815-c5c010ebb047 service nova] Acquiring lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:23.544054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adb7d1c1-a457-49e5-ba03-ed26e0c8a105 req-d4332f50-d457-4020-8815-c5c010ebb047 service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:23.544054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-adb7d1c1-a457-49e5-ba03-ed26e0c8a105 req-d4332f50-d457-4020-8815-c5c010ebb047 service nova] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:23.544054 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adb7d1c1-a457-49e5-ba03-ed26e0c8a105 req-d4332f50-d457-4020-8815-c5c010ebb047 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] No waiting events found dispatching network-vif-unplugged-253bf142-4243-4f79-9c0d-0884ae4da836 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:23.544278 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-adb7d1c1-a457-49e5-ba03-ed26e0c8a105 req-d4332f50-d457-4020-8815-c5c010ebb047 service nova] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Received event network-vif-unplugged-253bf142-4243-4f79-9c0d-0884ae4da836 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:23.722856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:23.738629 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Took 1.61 seconds to deallocate network for instance.
Jun 27 04:07:23.812114 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.944s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:23.812856 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:07:23.830849 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:23.830849 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:23.969891 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:23.982633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:24.084189 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:24.254851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:24.255130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:24.299757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Found WWN 330000000ef02e8af for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:07:24.300157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:24.300157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '330000000ef02e8af', 'path': '/dev/dm-0', 'multipath_id': '330000000ef02e8af'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:24.300157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ef02e8af', 'path': '/dev/dm-0', 'multipath_id': '330000000ef02e8af'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:07:24.322843 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:07:24.322843 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:07:24.322843 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:24.326249 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:24.335378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:24.439293 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eab22bac1a364b3988558ae38ed50d34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85de4b575a314a0fa4c6352eaf5b1753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:07:24.506737 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:24.756318 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updated VIF entry in instance network info cache for port 2c75c4dc-87e1-4fc7-9a88-307115ff819c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:24.756885 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updating instance_info_cache with network_info: [{"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:24.813908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-730649319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-730649319',id=12,image_ref='2f671a53-6d1c-4e01-a652-2f172f4ef3bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1297937537',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:58Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-m4l5pg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member',shelved_at='2026-06-27T04:06:54.911568',shelved_host='np0000003830',shelved_image_id='2f671a53-6d1c-4e01-a652-2f172f4ef3bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=f2a4a001-7934-403f-9b26-6b4ed727e22f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:07:24.814548 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:24.815954 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:24.816753 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'pci_devices' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:24.830282 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:07:24.889422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:24.889422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:24.890059 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Attaching volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f to /dev/vdb
Jun 27 04:07:24.914294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:24.915375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:24.915619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:24.915821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:24.915979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:24.923282 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Terminating instance
Jun 27 04:07:24.954563 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:24.969871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:07:24.997006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:25.046007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:07:25.046640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:07:25.058381 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:07:25.060199 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fed9:223e', 'fe80::3cd8:bcff:fe2d:2978'] 
Jun 27 04:07:25.060440 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:07:25.060646 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:07:25.060992 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:25.061897 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updating existing volume attachment record: 7cdd9dbc-6c90-49d2-a494-c656bdcc047f {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:07:25.125795 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:25.126570 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:25.224205 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Successfully created port: a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:07:25.262617 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-091b6632-57c0-401e-aa70-def3aa84b138 req-32f98fe2-3e40-4968-9100-97858a388d36 service nova] Releasing lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:25.320234 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <uuid>f2a4a001-7934-403f-9b26-6b4ed727e22f</uuid>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <name>instance-0000000c</name>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-730649319</nova:name>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:07:20</nova:creationTime>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:user uuid="a996571fb63c4c6e993f1fa02549a086">tempest-AttachVolumeShelveTestJSON-1443827218-project-member</nova:user>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:project uuid="469d72ff5a3640dbb2193b8a91deeac0">tempest-AttachVolumeShelveTestJSON-1443827218</nova:project>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         <nova:port uuid="bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <entry name="serial">f2a4a001-7934-403f-9b26-6b4ed727e22f</entry>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <entry name="uuid">f2a4a001-7934-403f-9b26-6b4ed727e22f</entry>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <alias name="ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <target dev="vdc" bus="virtio"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <serial>a85a04e9-dffd-44ca-b15b-231ca95dbcd7</serial>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:ad:db:6c"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <target dev="tapbcdcb8d4-1f"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/console.log" append="off"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:07:25.321685 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:07:25.324402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Preparing to wait for external event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:07:25.324402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:25.324402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:25.324402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:25.324402 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-730649319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-730649319',id=12,image_ref='2f671a53-6d1c-4e01-a652-2f172f4ef3bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1297937537',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:58Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-m4l5pg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member',shelved_at='2026-06-27T04:06:54.911568',shelved_host='np0000003830',shelved_image_id='2f671a53-6d1c-4e01-a652-2f172f4ef3bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=f2a4a001-7934-403f-9b26-6b4ed727e22f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:07:25.324402 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:25.324879 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:25.325079 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:07:25.326228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.326228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:25.326228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:07:25.328006 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.328006 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45a60e06-3398-5553-9064-7d6118c508c4', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:25.328600 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.329406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:25.331283 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.334748 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.336639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcdcb8d4-1f, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:25.336639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcdcb8d4-1f, col_values=(('qos', UUID('ec8a1c71-0886-4b8a-97ba-06a4e301d61a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:25.336639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcdcb8d4-1f, col_values=(('external_ids', {'iface-id': 'bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:db:6c', 'vm-uuid': 'f2a4a001-7934-403f-9b26-6b4ed727e22f'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:25.337324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.339156 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:25.340307 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:07:25.344059 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.345751 np0000003830 nova-compute[98984]: INFO os_vif [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f')
Jun 27 04:07:25.429861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:07:25.463922 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.467181 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.493390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.500170 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.534097 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.536681 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:25.640654 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:25.680117 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:07:25.680712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:25.680712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:25.681723 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:25.682785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:07:25.697192 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:25.698039 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:25.698285 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:25.698800 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:25.699449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:25.700130 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:25.717491 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:25.717491 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:25.728210 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:25.728210 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f] added
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:25.736828 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:25.737140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:25.737193 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:25.737389 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f] added
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:25.743172 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:25.743886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:25.744204 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0445(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:25.744435 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:25.786020 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6e76912c-9e1b-4ab9-8673-cadb673b8a39 req-7c0b5019-2a4c-471f-9ec3-d28c3e513723 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:25.788456 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6e76912c-9e1b-4ab9-8673-cadb673b8a39 req-7c0b5019-2a4c-471f-9ec3-d28c3e513723 service nova] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:25.789463 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6e76912c-9e1b-4ab9-8673-cadb673b8a39 req-7c0b5019-2a4c-471f-9ec3-d28c3e513723 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:25.790693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6e76912c-9e1b-4ab9-8673-cadb673b8a39 req-7c0b5019-2a4c-471f-9ec3-d28c3e513723 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:25.790693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6e76912c-9e1b-4ab9-8673-cadb673b8a39 req-7c0b5019-2a4c-471f-9ec3-d28c3e513723 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] No waiting events found dispatching network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:25.790693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6e76912c-9e1b-4ab9-8673-cadb673b8a39 req-7c0b5019-2a4c-471f-9ec3-d28c3e513723 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:25.799854 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Instance destroyed successfully.
Jun 27 04:07:25.800289 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lazy-loading 'resources' on Instance uuid 3a600689-63f3-47f6-8769-bd67329eb0a4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:25.801637 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999610174000054 future=<Future at 0x7ec53afd8fe0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:25.847450 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Booting with volume 55d1eb6f-568d-4401-aa61-08e54f222bc2 at /dev/vda
Jun 27 04:07:25.923220 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:25.943199 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:07:25.973044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:26.020747 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:07:26.023468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:07:26.033348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:07:26.036388 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe2c:5b14', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e'] 
Jun 27 04:07:26.037189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:07:26.037413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:07:26.038367 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:26.038367 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updating existing volume attachment record: 197d67e2-6c8f-41d3-a8c5-68b57a5254dc {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:07:26.052739 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Successfully updated port: a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:07:26.130296 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-changed-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:26.130396 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Refreshing instance network info cache due to event network-changed-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:26.130621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] Acquiring lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:26.130861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] Acquired lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:26.131407 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Refreshing network info cache for port a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:26.152805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.898s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:26.155050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.820s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:26.155440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:26.155614 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:07:26.237736 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Deleted allocations for instance 2b2205db-f373-46fc-88c2-414fc5a376e2
Jun 27 04:07:26.303818 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-826033651',display_name='tempest-VolumesAdminNegativeTest-server-826033651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesadminnegativetest-server-826033651',id=20,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:20Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3236f5b95c214c7b9d427a0edbbd0be3',ramdisk_id='',reservation_id='r-c33cy5pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1078121591',owner_user_name='tempest-VolumesAdminNegativeTest-1078121591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:07:20Z,user_data=None,user_id='f5b3e3af38a04d3ca28522d8a8f096cf',uuid=3a600689-63f3-47f6-8769-bd67329eb0a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:26.303994 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Converting VIF {"id": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "address": "fa:16:3e:d9:22:3e", "network": {"id": "dfcf617b-9925-40e4-8d21-a64fc4aca713", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-125836734-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3236f5b95c214c7b9d427a0edbbd0be3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap201269ed-ad", "ovs_interfaceid": "201269ed-ada5-4a0f-8314-e35fd2e65d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:26.305011 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:26.305378 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:26.307035 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:26.307405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap201269ed-ad, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:26.308578 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:26.309561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:26.315460 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:26.316569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:26.316762 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25c7e5fd-a2d2-44ff-b445-f0f5c772e249) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:26.318042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:26.318042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:26.324192 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:26.327716 np0000003830 nova-compute[98984]: INFO os_vif [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:22:3e,bridge_name='br-int',has_traffic_filtering=True,id=201269ed-ada5-4a0f-8314-e35fd2e65d29,network=Network(dfcf617b-9925-40e4-8d21-a64fc4aca713),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap201269ed-ad')
Jun 27 04:07:26.328008 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Deleting instance files /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4_del
Jun 27 04:07:26.328768 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Deletion of /opt/stack/data/nova/instances/3a600689-63f3-47f6-8769-bd67329eb0a4_del complete
Jun 27 04:07:26.557137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:26.558073 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0010121110001364286 future=<Future at 0x7ec5183633b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:26.558181 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:26.558354 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.7894296470001336 future=<Future at 0x7ec538172360 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:26.558720 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Emitting event <LifecycleEvent: 1782533231.5569415, 6a29bf7b-b8b2-41df-b546-800f5174319a => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:26.558783 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.7889652950000254 future=<Future at 0x7ec538172360 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:26.558914 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] VM Stopped (Lifecycle Event)
Jun 27 04:07:26.635263 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:26.725677 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:26.738067 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:26.745207 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:26.755028 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:26.760391 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.773631 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.782562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.791957 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.792328 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.801203 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:26.838036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.40.100,3260]
Jun 27 04:07:26.838036 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:26.838036 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.843435 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 27 04:07:26.844739 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:07:26.845384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:07:26.845603 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:07:26.845924 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:26.848075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.50.100,3260]
Jun 27 04:07:26.848075 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:26.848075 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.856172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.866051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.878528 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:26.879050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No VIF found with MAC fa:16:3e:ad:db:6c, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Using config drive
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('9', '-', '-', 0) found on session 35 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:26.886141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:26.893671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:26.894946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('10', '-', '-', 0) found on session 36 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:26.894946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:26.901875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 35 and hctl ['9', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:26.914815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 36 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:26.914815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:26.943163 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:26.952572 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:27.061987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6a29bf7b-b8b2-41df-b546-800f5174319a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:27.204340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:27.204560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:27.227474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.261747 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3681913-9428-4ed7-a0af-147650c5eff6 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "2b2205db-f373-46fc-88c2-414fc5a376e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.026s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:27.344844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.345548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.388222 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'ec2_ids' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:27.451325 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.454769 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:07:27.456206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.470769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-603e70be-6cb0-4abe-9b84-7e7b8df9b0ce req-74325f9a-24bd-4ac5-9d94-c43b2d3319cb service nova] Releasing lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:27.473359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquired lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:27.473828 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:27.548855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.549441 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.647610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.650950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:07:27.652572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.710055 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:07:27.738306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.738753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.845182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.850914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:27.875337 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8ea96e87-345e-499f-9f38-0c28b9cac948 req-08b4ca4a-34ce-41b3-b2c3-57fa847fc886 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:27.876164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8ea96e87-345e-499f-9f38-0c28b9cac948 req-08b4ca4a-34ce-41b3-b2c3-57fa847fc886 service nova] Acquiring lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:27.876471 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8ea96e87-345e-499f-9f38-0c28b9cac948 req-08b4ca4a-34ce-41b3-b2c3-57fa847fc886 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:27.876630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8ea96e87-345e-499f-9f38-0c28b9cac948 req-08b4ca4a-34ce-41b3-b2c3-57fa847fc886 service nova] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:27.876769 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8ea96e87-345e-499f-9f38-0c28b9cac948 req-08b4ca4a-34ce-41b3-b2c3-57fa847fc886 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] No waiting events found dispatching network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:27.876888 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8ea96e87-345e-499f-9f38-0c28b9cac948 req-08b4ca4a-34ce-41b3-b2c3-57fa847fc886 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-unplugged-201269ed-ada5-4a0f-8314-e35fd2e65d29 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:27.892939 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:27.897606 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:27.897780 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'keypairs' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:27.904186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 35 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:27.904696 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:27.938468 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:27.938965 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.023889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.026096 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid '3a600689-63f3-47f6-8769-bd67329eb0a4' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid '3a600689-63f3-47f6-8769-bd67329eb0a4' (instance-00000014)
Jun 27 04:07:28.031710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.092714 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:28.134042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.135519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.229104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.233927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.272343 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8d87cbcc-16a8-44a1-b9b8-0fd0530342f3 req-cba3b681-b3fd-4844-9c39-b02cff6cc305 service nova] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Received event network-vif-deleted-201269ed-ada5-4a0f-8314-e35fd2e65d29 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:28.282092 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Creating image(s)
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Ensure instance console log exists: /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:28.293006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:28.327938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:28.328394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:28.333530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:28.334127 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Claim successful on node np0000003830
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Terminating instance
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.362934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.398745 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Took 1.55 seconds to deallocate network for instance.
Jun 27 04:07:28.402756 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<f2a4a001-7934-403f-9b26-6b4ed727e22f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:07:28.406249 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:28.467930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.468784 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:07:28.468845 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Periodic task is updating the host stat, it is trying to get disk instance-0000000c, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config'
Jun 27 04:07:28.478347 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:28.479599 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.533766 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.534372 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50579MB free_disk=73.94264221191406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:07:28.534637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:28.629425 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Creating config drive at /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config
Jun 27 04:07:28.640314 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy2teoopv {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:28.652067 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updating instance_info_cache with network_info: [{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:28.685444 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy2teoopv" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:28.721618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000591f48fd for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:07:28.722411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:28.722411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000591f48fd', 'path': '/dev/dm-1', 'multipath_id': '330000000591f48fd'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:28.723535 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000591f48fd', 'path': '/dev/dm-1', 'multipath_id': '330000000591f48fd'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:07:28.750890 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:28.820474 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:28.879321 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:07:28.915458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:28.919999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:28.919999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:28.945920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.084945 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.138941 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.153527 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.156624 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Releasing lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:29.156949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance network_info: |[{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:07:29.157847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Start _get_guest_xml network_info=[{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '197d67e2-6c8f-41d3-a8c5-68b57a5254dc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '556b87cb-fbf9-4b7c-84c4-40f49005eb25', 'attached_at': '', 'detached_at': '', 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'serial': '55d1eb6f-568d-4401-aa61-08e54f222bc2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:07:29.162862 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:29.165809 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-844248708', uuid='556b87cb-fbf9-4b7c-84c4-40f49005eb25'), owner=OwnerMeta(userid='eab22bac1a364b3988558ae38ed50d34', username='tempest-ServerActionsV293TestJSON-165019121-project-member', projectid='85de4b575a314a0fa4c6352eaf5b1753', projectname='tempest-ServerActionsV293TestJSON-165019121'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533249.1639838) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:07:29.172484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:07:29.172994 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:07:29.179683 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:07:29.180104 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:07:29.181234 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:07:29.183530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:07:29.196090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:07:29.197075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:29.197075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:29.197313 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:29.197617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:07:29.210755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:29.211763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:29.212025 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:29.212351 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:29.213214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:29.213214 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:29.226437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:29.226437 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:29.231609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:29.231609 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2] added
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:29.241568 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:29.242248 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:29.243322 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:29.243322 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:29.245926 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.260722 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Attempting to attach volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2] added
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:29.261576 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:29.261829 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:29.262074 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0491(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:29.262307 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:   <alias name="ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f"/>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:   <serial>dc6bb842-c7eb-49a1-8c42-dfaf5743130f</serial>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:29.262947 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:07:29.303966 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.310853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.337808 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.422528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.471376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.474589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.507611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.515798 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.736681 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.739348 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999609591999842 future=<Future at 0x7ec5183f1430 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:29.748906 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:29.749642 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Instance destroyed successfully.
Jun 27 04:07:29.750373 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'resources' on Instance uuid 58490b25-bc9d-4a48-aff3-3eb967088bc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:29.765756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.229011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:30.229011 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:30.244788 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:30.255759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:04:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1870437479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1870437479',id=10,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:05:43Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-l6wcgi2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:05:50Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=58490b25-bc9d-4a48-aff3-3eb967088bc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "address": "fa:16:3e:2c:5b:14", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a8af07-d0", "ovs_interfaceid": "b4a8af07-d05c-4f98-98c1-0f087b0fcd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4a8af07-d0, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:30.264887 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:30.268404 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.269700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:30.270395 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.278470 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.278470 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.283633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67f8667e-d2ed-48fe-998c-1c344701412a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:30.286906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.287928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:30.294560 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.310233 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.311618 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.313095 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:30.317702 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.319759 np0000003830 nova-compute[98984]: INFO os_vif [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:14,bridge_name='br-int',has_traffic_filtering=True,id=b4a8af07-d05c-4f98-98c1-0f087b0fcd54,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a8af07-d0')
Jun 27 04:07:30.327023 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:07:30.327383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:30.327609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:30.348747 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004347469998720044 future=<Future at 0x7ec538172360 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:30.348747 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:30.350130 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] Emitting event <LifecycleEvent: 1782533235.347663, 9f560b0d-dc54-4d68-a06b-71401abd49eb => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:30.351575 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=6.444010329000093 future=<Future at 0x7ec538171fd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:30.351720 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=6.443764181999995 future=<Future at 0x7ec538171fd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:30.352335 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] VM Stopped (Lifecycle Event)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.353814 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.354072 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:30.359628 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:30.359628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:30.359828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:30.359908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:30.360047 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:30.360221 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:30.360350 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:30.362590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:30.362590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:30.362590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:30.364371 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:30.364438 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2391e3e2-14db-44a8-b3c3-dd0da8119c4c req-e3a4704e-68fc-4e47-befe-db4ed843ea3a service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:30.367804 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260]
Jun 27 04:07:30.367804 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:30.367804 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.386340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260]
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] HCTL ('11', '-', '-', 0) found on session 37 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:30.428725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:30.445952 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:30.462870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 37 and hctl ['11', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.467369 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.255s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:30.468209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:30.470354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] HCTL ('12', '-', '-', 0) found on session 38 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:30.470354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:30.515299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 38 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:30.515299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:30.733625 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:30.858704 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-453f7d5b-2087-4e60-9374-f7728f8e0217 None None] [instance: 9f560b0d-dc54-4d68-a06b-71401abd49eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:31.247198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.918s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:31.247992 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:07:31.252753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.718s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:31.316275 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:31.316610 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:31.316793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:31.317076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:91:f1:28, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:31.455384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 37 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:31.456127 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:31.575437 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:31.727040 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533251.7266402, f2a4a001-7934-403f-9b26-6b4ed727e22f => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:31.727239 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Started (Lifecycle Event)
Jun 27 04:07:31.759124 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:07:31.759606 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:07:31.759996 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:31.761164 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:31.844219 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2cdccd7a-f9dd-46f9-82f3-8dfba79b311a req-736295f3-72f9-437c-acfb-ea32f77755a8 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:31.846135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2cdccd7a-f9dd-46f9-82f3-8dfba79b311a req-736295f3-72f9-437c-acfb-ea32f77755a8 service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:31.846135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2cdccd7a-f9dd-46f9-82f3-8dfba79b311a req-736295f3-72f9-437c-acfb-ea32f77755a8 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:31.850061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2cdccd7a-f9dd-46f9-82f3-8dfba79b311a req-736295f3-72f9-437c-acfb-ea32f77755a8 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:31.850687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2cdccd7a-f9dd-46f9-82f3-8dfba79b311a req-736295f3-72f9-437c-acfb-ea32f77755a8 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Processing event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:07:31.854125 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:07:31.859421 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:07:31.863372 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance spawned successfully.
Jun 27 04:07:31.881290 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb2d09351b2447bbfce95b09ad97b23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b76ce35cec84d189228639d70c6be45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:07:32.231650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Found WWN 3300000007b684c46 for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:07:32.231942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:32.232137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000007b684c46', 'path': '/dev/dm-2', 'multipath_id': '3300000007b684c46'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:32.232388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007b684c46', 'path': '/dev/dm-2', 'multipath_id': '3300000007b684c46'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:07:32.235419 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:32.235419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.907s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:32.235419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '42cf866d-9c6d-4cb7-a814-58d9c1f02365', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:07:32.235419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:07:32.262542 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:32.271737 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:32.272357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '38')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:07:32.272806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '11')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:32.273866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365', '12')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:32.275160 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51876f100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'): ({'sdk'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:07:32.275467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Removing multipathed devices sdk, sdj {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:07:32.275745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Flush multipath device 3300000001327a596 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:07:32.291452 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:32.315336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:32.360634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6ce1c75a-8520-40b5-a060-9580f2f789ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 99670311-67bb-4d60-b854-655dc01f2722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 58490b25-bc9d-4a48-aff3-3eb967088bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: WARNING nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 3a600689-63f3-47f6-8769-bd67329eb0a4 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f2a4a001-7934-403f-9b26-6b4ed727e22f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 556b87cb-fbf9-4b7c-84c4-40f49005eb25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 14cba585-a366-4fd8-81c6-71235e708858 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:07:32.398707 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2432MB phys_disk=95GB used_disk=6GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:07:28 up 30 min,  2 users,  load average: 13.52, 7.45, 3.46\n', 'num_instances': '10', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_771234de69074fed81ffef19dcee2804': '2', 'io_workload': '2', 'num_proj_4b76ce35cec84d189228639d70c6be45': '2', 'num_task_deleting': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_469d72ff5a3640dbb2193b8a91deeac0': '1', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '3', 'num_proj_68fa5127b52042afb5b60ff945958fe1': '1', 'num_vm_building': '2', 'num_proj_85de4b575a314a0fa4c6352eaf5b1753': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:07:32.408682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:07:32.408682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:07:32.408682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:07:32.425309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:07:32.425578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:07:32.447760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:32.462267 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:32.463133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state deleting.
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:32.466050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:32.466217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:32.466347 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:32.466470 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received unexpected event network-vif-plugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with vm_state active and task_state deleting.
Jun 27 04:07:32.466628 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:32.466791 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:32.466950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:32.467372 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:32.467372 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:32.467419 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:32.470926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:32.471526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Acquiring lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:32.473589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:32.473721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:32.473926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] No waiting events found dispatching network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:32.474134 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11271518-dc30-492b-8b85-06b8f51bcb90 req-3f7395d5-79bc-479d-94c0-2973cc6fdbdd service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-unplugged-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:32.506687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.40.100,3260]
Jun 27 04:07:32.506687 np0000003830 nova-compute[98984]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:32.506687 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:32.533116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:32.558782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:32.618432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.50.100,3260]
Jun 27 04:07:32.618432 np0000003830 nova-compute[98984]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-42cf866d-9c6d-4cb7-a814-58d9c1f02365, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:32.618432 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:32.643276 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:32.643468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:32.644565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] <== disconnect_volume: return (2315ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:32.644565 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:07:32.644565 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Deleting instance files /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8_del
Jun 27 04:07:32.650079 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Deletion of /opt/stack/data/nova/instances/58490b25-bc9d-4a48-aff3-3eb967088bc8_del complete
Jun 27 04:07:32.668426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:32.767217 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:07:32.800854 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-844248708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionsv293testjson-server-844248708',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuyiudFpREd/ABd9CQTPRBpKOMLvejaZPuRMCxP5zbNlnC7ydBW46wKbUDuAckdqgdn6b/On7/IwzxCCgukLifogPI5AHYn/D4u7jX134iPu48395wkEHLPrVpode/uhA==',key_name='tempest-keypair-1481687516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85de4b575a314a0fa4c6352eaf5b1753',ramdisk_id='',reservation_id='r-cesx1l83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-165019121',owner_user_name='tempest-ServerActionsV293TestJSON-165019121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eab22bac1a364b3988558ae38ed50d34',uuid=556b87cb-fbf9-4b7c-84c4-40f49005eb25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:07:32.802147 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:07:32.802425 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533252.8020866, f2a4a001-7934-403f-9b26-6b4ed727e22f => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:32.802760 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Paused (Lifecycle Event)
Jun 27 04:07:32.810453 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converting VIF {"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:32.810453 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:32.810453 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lazy-loading 'pci_devices' on Instance uuid 556b87cb-fbf9-4b7c-84c4-40f49005eb25 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:32.956431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c93f313b-aef7-426f-870d-fc1092ac17f2 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.067s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:33.161380 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Took 4.28 seconds to destroy the instance on the hypervisor.
Jun 27 04:07:33.162291 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:07:33.162432 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:07:33.162555 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:07:33.162786 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:33.188546 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d2c0afd2-4f60-4475-9390-8ffa38ed2f2b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.080s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:33.265104 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Successfully created port: 7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:07:33.270021 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:33.274795 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Booting with volume fb269625-f2be-4d1d-97de-7481e591d06e at /dev/vda
Jun 27 04:07:33.290842 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:33.291644 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:33.314405 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <uuid>556b87cb-fbf9-4b7c-84c4-40f49005eb25</uuid>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <name>instance-00000015</name>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsV293TestJSON-server-844248708</nova:name>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:07:29</nova:creationTime>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:user uuid="eab22bac1a364b3988558ae38ed50d34">tempest-ServerActionsV293TestJSON-165019121-project-member</nova:user>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:project uuid="85de4b575a314a0fa4c6352eaf5b1753">tempest-ServerActionsV293TestJSON-165019121</nova:project>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         <nova:port uuid="a7ab7cfb-650d-42d5-8cd4-a1aa1b943950">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <entry name="serial">556b87cb-fbf9-4b7c-84c4-40f49005eb25</entry>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <entry name="uuid">556b87cb-fbf9-4b7c-84c4-40f49005eb25</entry>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <alias name="ua-55d1eb6f-568d-4401-aa61-08e54f222bc2"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <serial>55d1eb6f-568d-4401-aa61-08e54f222bc2</serial>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fc:04:d5"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <target dev="tapa7ab7cfb-65"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/console.log" append="off"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:07:33.315524 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:07:33.319606 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Preparing to wait for external event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:07:33.319606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:33.319606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:33.319606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:33.319606 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-844248708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionsv293testjson-server-844248708',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuyiudFpREd/ABd9CQTPRBpKOMLvejaZPuRMCxP5zbNlnC7ydBW46wKbUDuAckdqgdn6b/On7/IwzxCCgukLifogPI5AHYn/D4u7jX134iPu48395wkEHLPrVpode/uhA==',key_name='tempest-keypair-1481687516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85de4b575a314a0fa4c6352eaf5b1753',ramdisk_id='',reservation_id='r-cesx1l83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-165019121',owner_user_name='tempest-ServerActionsV293TestJSON-165019121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eab22bac1a364b3988558ae38ed50d34',uuid=556b87cb-fbf9-4b7c-84c4-40f49005eb25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:07:33.320281 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converting VIF {"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:33.320480 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:33.320856 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:07:33.321640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:33.322396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:33.322608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:07:33.324524 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533253.3236523, f2a4a001-7934-403f-9b26-6b4ed727e22f => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:33.325057 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Resumed (Lifecycle Event)
Jun 27 04:07:33.328566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:33.328566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5065fb6-18e8-567b-b5c2-30f7911a80a9', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:33.331571 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:33.334332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:33.340140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:33.340140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7ab7cfb-65, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:33.340140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7ab7cfb-65, col_values=(('qos', UUID('77f88819-088f-4b1e-b849-d40b585085d7')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:33.340140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7ab7cfb-65, col_values=(('external_ids', {'iface-id': 'a7ab7cfb-650d-42d5-8cd4-a1aa1b943950', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:04:d5', 'vm-uuid': '556b87cb-fbf9-4b7c-84c4-40f49005eb25'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:33.343587 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:33.343587 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:33.351879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:33.353752 np0000003830 nova-compute[98984]: INFO os_vif [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65')
Jun 27 04:07:33.371687 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:33.383415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:07:33.414060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:33.466612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:07:33.467157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:07:33.480919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:07:33.482746 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa'] 
Jun 27 04:07:33.483223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:07:33.483368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:07:33.483729 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:33.484122 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating existing volume attachment record: bc3ab68c-f230-42ea-9c03-0b64bdeebdd3 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:07:33.551476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:33.552763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:33.798184 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:33.836736 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:33.844874 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:34.009885 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4d7aaa60-87b7-4176-a209-fbb52163b67e req-c21cfe1a-b2ea-4d04-ae32-4c4d8ba72b5e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:34.010667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4d7aaa60-87b7-4176-a209-fbb52163b67e req-c21cfe1a-b2ea-4d04-ae32-4c4d8ba72b5e service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:34.010868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4d7aaa60-87b7-4176-a209-fbb52163b67e req-c21cfe1a-b2ea-4d04-ae32-4c4d8ba72b5e service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:34.011044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4d7aaa60-87b7-4176-a209-fbb52163b67e req-c21cfe1a-b2ea-4d04-ae32-4c4d8ba72b5e service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:34.011694 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4d7aaa60-87b7-4176-a209-fbb52163b67e req-c21cfe1a-b2ea-4d04-ae32-4c4d8ba72b5e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] No waiting events found dispatching network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:34.011694 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4d7aaa60-87b7-4176-a209-fbb52163b67e req-c21cfe1a-b2ea-4d04-ae32-4c4d8ba72b5e service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received unexpected event network-vif-plugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 for instance with vm_state active and task_state None.
Jun 27 04:07:34.059577 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:34.087566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:34.186001 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Successfully updated port: 7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:07:34.214288 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:34.310128 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:07:34.311602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.058s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:34.311602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.392s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:34.311602 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:07:34.313022 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:34.413816 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Deleted allocations for instance 3a600689-63f3-47f6-8769-bd67329eb0a4
Jun 27 04:07:34.582132 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9e88b26-b2fb-43a7-bc54-31f849ba3160 req-911362ed-00ac-4b99-9c31-6b26c70be9f3 service nova] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Received event network-vif-deleted-b4a8af07-d05c-4f98-98c1-0f087b0fcd54 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:34.689203 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:34.689366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:34.689627 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:34.717831 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Took 1.56 seconds to deallocate network for instance.
Jun 27 04:07:34.888969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:34.888969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:34.888969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No VIF found with MAC fa:16:3e:fc:04:d5, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:34.889334 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Using config drive
Jun 27 04:07:35.068664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:35.268656 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:35.304308 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Took 0.59 seconds to detach 1 volumes for instance.
Jun 27 04:07:35.306885 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Deleting volume: 42cf866d-9c6d-4cb7-a814-58d9c1f02365 {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:07:35.311078 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:35.311951 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:35.312968 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:35.313916 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:35.315569 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:35.316400 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:07:35.319942 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:07:35.320384 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.52 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:07:35.399736 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:35.428296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d3b903fb-3c21-4e94-a093-38ae0558a71d tempest-VolumesAdminNegativeTest-1078121591 tempest-VolumesAdminNegativeTest-1078121591-project-member] Lock "3a600689-63f3-47f6-8769-bd67329eb0a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.513s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:35.566769 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:35.622215 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Creating config drive at /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config
Jun 27 04:07:35.633393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwm3d0tvm {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:35.689812 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:07:35.695661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:07:35.695844 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Creating image(s)
Jun 27 04:07:35.697590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:07:35.697590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Ensure instance console log exists: /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:07:35.698803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:35.698803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:35.700205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:35.706178 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwm3d0tvm" returned: 0 in 0.074s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:35.785018 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:35.915655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:35.915655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:36.097276 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-changed-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:36.097276 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Refreshing instance network info cache due to event network-changed-7f426ebf-0ad5-42b1-81d5-853a4740a1ab. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:36.097276 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] Acquiring lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:36.232687 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:36.233792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:36.233792 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Attaching volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f to /dev/vdb
Jun 27 04:07:36.258655 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.295122 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.306867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:36.306867 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance network_info: |[{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:07:36.307947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] Acquired lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:36.307947 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Refreshing network info cache for port 7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:36.310599 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Start _get_guest_xml network_info=[{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'bc3ab68c-f230-42ea-9c03-0b64bdeebdd3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '14cba585-a366-4fd8-81c6-71235e708858', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'serial': 'fb269625-f2be-4d1d-97de-7481e591d06e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:07:36.319295 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:36.321172 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-959397301', uuid='14cba585-a366-4fd8-81c6-71235e708858'), owner=OwnerMeta(userid='ebb2d09351b2447bbfce95b09ad97b23', username='tempest-ServerActionsTestOtherA-1390022329-project-member', projectid='4b76ce35cec84d189228639d70c6be45', projectname='tempest-ServerActionsTestOtherA-1390022329'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533256.3207335) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:07:36.325048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:07:36.325048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:07:36.332139 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:07:36.332729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:07:36.333639 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:07:36.334076 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:07:36.336472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:07:36.337154 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:07:36.338082 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:07:36.368134 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:07:36.368603 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:36.368895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:36.369443 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:36.370003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:07:36.375919 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:36.380585 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:36.389759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:36.390705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:36.394538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:36.396151 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:36.397460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:36.397782 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:36.417836 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:07:36.423144 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:36.423144 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:36.435974 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.440839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:36.440839 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e] added
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:36.467479 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:36.468229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:36.468229 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0731(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:36.468229 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e] added
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:36.469526 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:36.470981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:36.475607 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0727(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:36.475963 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:36.479971 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:36.541260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:07:36.541827 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:07:36.554961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:07:36.560524 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::fc16:3eff:fe82:85ac', 'fe80::3051:f5ff:fe55:b674', 'fe80::5cc7:47ff:fe36:5f6a', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fefc:4d5'] 
Jun 27 04:07:36.560524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:07:36.560524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:07:36.560524 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:36.560524 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updating existing volume attachment record: 254331d0-cbf2-4810-99fc-00e269863eeb {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:07:36.649681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-33c4f5f6-1367-41a2-9547-633348f28d0d req-f98c72c6-c126-493b-a3d6-9e19bad0f837 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:36.649681 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-33c4f5f6-1367-41a2-9547-633348f28d0d req-f98c72c6-c126-493b-a3d6-9e19bad0f837 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:36.649962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-33c4f5f6-1367-41a2-9547-633348f28d0d req-f98c72c6-c126-493b-a3d6-9e19bad0f837 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:36.650135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-33c4f5f6-1367-41a2-9547-633348f28d0d req-f98c72c6-c126-493b-a3d6-9e19bad0f837 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:36.650278 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-33c4f5f6-1367-41a2-9547-633348f28d0d req-f98c72c6-c126-493b-a3d6-9e19bad0f837 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Processing event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:07:36.796815 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0006287219998739602 future=<Future at 0x7ec538171fd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:36.796815 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:36.797102 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.004337934000205 future=<Future at 0x7ec53afd8fe0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:36.797178 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.0040101609999965 future=<Future at 0x7ec53afd8fe0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:36.799640 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533241.7954051, 2b2205db-f373-46fc-88c2-414fc5a376e2 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:36.799640 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] VM Stopped (Lifecycle Event)
Jun 27 04:07:36.813867 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:36.830598 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.834227 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.837448 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.843519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:36.843842 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:36.871133 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:36.923653 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] instance snapshotting
Jun 27 04:07:37.090915 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Beginning live snapshot process
Jun 27 04:07:37.166192 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:07:37.166628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:37.166854 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:37.305930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 2b2205db-f373-46fc-88c2-414fc5a376e2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:37.331971 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:37.331971 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:37.352268 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:37.405589 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:37.469549 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:37.477466 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:37.494726 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:37.508313 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.519956 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.528599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.544281 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.544723 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.555302 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.557116 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:37.629789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260]
Jun 27 04:07:37.629789 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:37.629789 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.639954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260]
Jun 27 04:07:37.639954 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:37.639954 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.652158 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.664889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:37.668521 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updated VIF entry in instance network info cache for port 7f426ebf-0ad5-42b1-81d5-853a4740a1ab. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:37.673760 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.688072 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:37.688801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.294s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:37.688801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:37.690743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('13', '-', '-', 0) found on session 39 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:37.691075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.702113 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:37.702537 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:37.703701 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.306s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:37.703836 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:37.706947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('14', '-', '-', 0) found on session 40 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:37.707104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:37.729311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 39 and hctl ['13', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:37.754666 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 40 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:37.754887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:37.836834 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:07:37.863590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.948s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:37.891294 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:07:37.894055 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533257.8920455, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:37.894055 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Started (Lifecycle Event)
Jun 27 04:07:37.897528 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:07:37.904544 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance spawned successfully.
Jun 27 04:07:37.904993 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:07:37.982059 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Deleted allocations for instance 58490b25-bc9d-4a48-aff3-3eb967088bc8
Jun 27 04:07:38.177180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a57037cb-491b-4ec7-a991-40fee4088993 req-5767cbb1-52c4-4d40-bf79-dd9618e817cf service nova] Releasing lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:38.344423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:38.397878 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:38.401580 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:38.406477 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:38.416750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:38.417341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:38.420367 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:38.422958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:38.422958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:38.422958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:38.430302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:38.430302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:38.441510 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:38.441510 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Claim successful on node np0000003830
Jun 27 04:07:38.522429 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:38.615933 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:38.731696 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 39 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:38.732335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:38.734855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json -f qcow2" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:38.736384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:38.772937 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3608f0af-e860-481c-9296-70b1d1839dae req-ed658b48-a1dc-473a-90dd-b55b59cc110c service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:38.773387 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3608f0af-e860-481c-9296-70b1d1839dae req-ed658b48-a1dc-473a-90dd-b55b59cc110c service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:38.774023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3608f0af-e860-481c-9296-70b1d1839dae req-ed658b48-a1dc-473a-90dd-b55b59cc110c service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:38.776594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3608f0af-e860-481c-9296-70b1d1839dae req-ed658b48-a1dc-473a-90dd-b55b59cc110c service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:38.777852 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3608f0af-e860-481c-9296-70b1d1839dae req-ed658b48-a1dc-473a-90dd-b55b59cc110c service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:38.778094 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3608f0af-e860-481c-9296-70b1d1839dae req-ed658b48-a1dc-473a-90dd-b55b59cc110c service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state building and task_state spawning.
Jun 27 04:07:38.855299 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json -f qcow2" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:38.856308 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:38.862347 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:38.863769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:38.903633 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:07:38.907363 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533258.9047182, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:38.907363 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Paused (Lifecycle Event)
Jun 27 04:07:38.933522 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Took 10.65 seconds to spawn the instance on the hypervisor.
Jun 27 04:07:38.933522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:38.974652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:38.975598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8io0pvqk/17a571ab8b084cbc8427e5a756664990.delta 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:39.025422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7143ac0c-d7e1-4a87-ad36-b08dbc0e2b8e tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "58490b25-bc9d-4a48-aff3-3eb967088bc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.684s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:39.053290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8io0pvqk/17a571ab8b084cbc8427e5a756664990.delta 1073741824" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:39.054898 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 27 04:07:39.091923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:39.412442 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:39.414015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] COPY block job progress, current cursor: 0 final cursor: 77004800 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:07:39.417994 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533259.417475, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:39.418334 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Resumed (Lifecycle Event)
Jun 27 04:07:39.426960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found WWN 3300000006d458d78 for multipath device dm-5 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:07:39.426960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.057s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:39.427384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== connect_volume: return (3058ms) {'type': 'block', 'scsi_wwn': '3300000006d458d78', 'path': '/dev/dm-5', 'multipath_id': '3300000006d458d78'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:39.427548 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d458d78', 'path': '/dev/dm-5', 'multipath_id': '3300000006d458d78'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:07:39.428352 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.261s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:39.431703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:07:39.450135 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Took 20.06 seconds to build instance.
Jun 27 04:07:39.452637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:39.454855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:39.458249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:39.458710 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:39.459642 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:39.460931 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:39.478901 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:39.492717 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:39.500607 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:39.514085 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.526149 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.526589 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:39.526813 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:39.526869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:39.531923 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('9', '0', '0', 0) found on session 35 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:39.531923 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.083s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:39.543134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:39.545169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('10', '0', '0', 0) found on session 36 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:39.545169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:39.545284 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 35 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:39.546150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:39.558380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 36 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:39.558380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:39.744114 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:39.744319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:39.744553 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:39.744787 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:39.744969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:39.747242 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Terminating instance
Jun 27 04:07:39.919324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] COPY block job progress, current cursor: 77004800 final cursor: 77004800 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:07:39.921314 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 27 04:07:39.922761 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:39.927593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:39.940216 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-959397301',display_name='tempest-ServerActionsTestOtherA-server-959397301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-959397301',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-oy0l1vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=14cba585-a366-4fd8-81c6-71235e708858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:07:39.940448 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:39.941047 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:39.942169 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'pci_devices' on Instance uuid 14cba585-a366-4fd8-81c6-71235e708858 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:39.969293 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.596s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:39.972399 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:07:39.973303 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8io0pvqk/17a571ab8b084cbc8427e5a756664990.delta /opt/stack/data/nova/instances/snapshots/tmp8io0pvqk/17a571ab8b084cbc8427e5a756664990 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:40.137094 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:40.137403 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:40.251048 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:07:40.286338 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.312708 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.315022 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.342116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <uuid>14cba585-a366-4fd8-81c6-71235e708858</uuid>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <name>instance-00000016</name>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherA-server-959397301</nova:name>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:07:36</nova:creationTime>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:user uuid="ebb2d09351b2447bbfce95b09ad97b23">tempest-ServerActionsTestOtherA-1390022329-project-member</nova:user>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:project uuid="4b76ce35cec84d189228639d70c6be45">tempest-ServerActionsTestOtherA-1390022329</nova:project>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         <nova:port uuid="7f426ebf-0ad5-42b1-81d5-853a4740a1ab">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <entry name="serial">14cba585-a366-4fd8-81c6-71235e708858</entry>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <entry name="uuid">14cba585-a366-4fd8-81c6-71235e708858</entry>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <alias name="ua-fb269625-f2be-4d1d-97de-7481e591d06e"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-5"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <serial>fb269625-f2be-4d1d-97de-7481e591d06e</serial>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:42:dc:7f"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <target dev="tap7f426ebf-0a"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/console.log" append="off"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:07:40.445654 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Preparing to wait for external event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-959397301',display_name='tempest-ServerActionsTestOtherA-server-959397301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-959397301',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-oy0l1vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=14cba585-a366-4fd8-81c6-71235e708858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea597a19-0838-5545-9948-c8f6e04dd075', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:40.462384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:07:40.463777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.464922 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:40.471360 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.476203 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.476362 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f426ebf-0a, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:40.476775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f426ebf-0a, col_values=(('qos', UUID('837c67b1-2460-4d44-86ff-88db533b0c8e')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:40.476925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f426ebf-0a, col_values=(('external_ids', {'iface-id': '7f426ebf-0ad5-42b1-81d5-853a4740a1ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:dc:7f', 'vm-uuid': '14cba585-a366-4fd8-81c6-71235e708858'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:40.478131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.479692 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:40.490562 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:40.492115 np0000003830 nova-compute[98984]: INFO os_vif [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a')
Jun 27 04:07:40.521073 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14447e74-1c4d-4686-9bb2-a6dfa67a7c4a req-fa5ded12-aee7-4cc5-b06d-b7e58582e49b service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:40.521245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14447e74-1c4d-4686-9bb2-a6dfa67a7c4a req-fa5ded12-aee7-4cc5-b06d-b7e58582e49b service nova] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:40.521428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14447e74-1c4d-4686-9bb2-a6dfa67a7c4a req-fa5ded12-aee7-4cc5-b06d-b7e58582e49b service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:40.521428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14447e74-1c4d-4686-9bb2-a6dfa67a7c4a req-fa5ded12-aee7-4cc5-b06d-b7e58582e49b service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:40.521549 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14447e74-1c4d-4686-9bb2-a6dfa67a7c4a req-fa5ded12-aee7-4cc5-b06d-b7e58582e49b service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] No waiting events found dispatching network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:40.521681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14447e74-1c4d-4686-9bb2-a6dfa67a7c4a req-fa5ded12-aee7-4cc5-b06d-b7e58582e49b service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:40.629140 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999635189000173 future=<Future at 0x7ec5183eae40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:40.631166 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Instance destroyed successfully.
Jun 27 04:07:40.631901 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lazy-loading 'resources' on Instance uuid 6ce1c75a-8520-40b5-a060-9580f2f789ed {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:40.642209 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:40.801736 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005014589999063901 future=<Future at 0x7ec53afd8fe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:40.801941 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:40.801941 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.9369416199999705 future=<Future at 0x7ec5183f1430 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:40.801941 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.936856094999939 future=<Future at 0x7ec5183f1430 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:40.804044 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1782533245.801067, 3a600689-63f3-47f6-8769-bd67329eb0a4 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:40.804044 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] VM Stopped (Lifecycle Event)
Jun 27 04:07:40.943489 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8io0pvqk/17a571ab8b084cbc8427e5a756664990.delta /opt/stack/data/nova/instances/snapshots/tmp8io0pvqk/17a571ab8b084cbc8427e5a756664990" returned: 0 in 0.970s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:40.948792 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Snapshot extracted, beginning image upload
Jun 27 04:07:41.105818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-changed-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:41.105985 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Refreshing instance network info cache due to event network-changed-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:41.106255 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] Acquiring lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:41.106352 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] Acquired lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:41.106585 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Refreshing network info cache for port a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:41.135763 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1026515125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverbootfromvolumestablerescuetest-server-1026515125',id=1,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:39Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='771234de69074fed81ffef19dcee2804',ramdisk_id='',reservation_id='r-mur9hnh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:50Z,user_data=None,user_id='6c2bd621defb420db9fd8345c5b36248',uuid=6ce1c75a-8520-40b5-a060-9580f2f789ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:41.136074 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converting VIF {"id": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "address": "fa:16:3e:82:85:ac", "network": {"id": "30b009de-b168-4209-b061-56e5e64fdc77", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463763406-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "771234de69074fed81ffef19dcee2804", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13143fe3-8c", "ovs_interfaceid": "13143fe3-8cca-410a-af2e-7235fa68ee4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:41.136972 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:41.137194 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:41.138390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:41.138697 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13143fe3-8c, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:41.140994 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:41.147720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:41.148859 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:41.149095 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34b64aea-5ba0-4563-9bc4-79d309432c40) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:41.150031 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:41.150801 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:41.154528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.725s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:41.154528 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:07:41.159825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:41.162224 np0000003830 nova-compute[98984]: INFO os_vif [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:85:ac,bridge_name='br-int',has_traffic_filtering=True,id=13143fe3-8cca-410a-af2e-7235fa68ee4e,network=Network(30b009de-b168-4209-b061-56e5e64fdc77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13143fe3-8c')
Jun 27 04:07:41.162643 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Deleting instance files /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed_del
Jun 27 04:07:41.163879 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Deletion of /opt/stack/data/nova/instances/6ce1c75a-8520-40b5-a060-9580f2f789ed_del complete
Jun 27 04:07:41.306548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] [instance: 3a600689-63f3-47f6-8769-bd67329eb0a4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:41.436245 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:41.481695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000591f48fd for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:07:41.482931 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.055s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:41.483224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (4316ms) {'type': 'block', 'scsi_wwn': '330000000591f48fd', 'path': '/dev/dm-1', 'multipath_id': '330000000591f48fd'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:41.483471 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000591f48fd', 'path': '/dev/dm-1', 'multipath_id': '330000000591f48fd'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:07:41.491886 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:41.613139 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:41.665527 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:07:41.665527 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:07:41.665527 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:41.665527 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:41.673359 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Took 1.42 seconds to destroy the instance on the hypervisor.
Jun 27 04:07:41.674236 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:07:41.674675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:07:41.674870 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:07:41.675137 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:41.816623 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b294bb1532b540cc970b2fe7aea50e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e9d0be58e546fc9c6986b88628c189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:07:41.852350 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:41.995282 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Attempting to attach volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:   <alias name="ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f"/>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:   <serial>dc6bb842-c7eb-49a1-8c42-dfaf5743130f</serial>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:42.002892 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:07:42.027950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:42.028140 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:42.028300 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No VIF found with MAC fa:16:3e:42:dc:7f, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:42.028831 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Using config drive
Jun 27 04:07:42.168930 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:07:42.184839 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:42.507920 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updated VIF entry in instance network info cache for port a7ab7cfb-650d-42d5-8cd4-a1aa1b943950. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:42.508321 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updating instance_info_cache with network_info: [{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:42.542540 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:42.608552 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:42.609477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] Acquiring lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] No waiting events found dispatching network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-unplugged-13143fe3-8cca-410a-af2e-7235fa68ee4e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Received event network-vif-deleted-13143fe3-8cca-410a-af2e-7235fa68ee4e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Neutron deleted interface 13143fe3-8cca-410a-af2e-7235fa68ee4e; detaching it from the instance and deleting it from the info cache
Jun 27 04:07:42.627165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e746c56a-014e-42bc-973d-27d28ce20315 req-97181b40-61ed-4d5e-8dc4-fb72e526c78f service nova] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Detach interface failed, port_id=13143fe3-8cca-410a-af2e-7235fa68ee4e, reason: Instance 6ce1c75a-8520-40b5-a060-9580f2f789ed could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:07:42.694415 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:07:42.749356 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:42.807598 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Creating config drive at /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config
Jun 27 04:07:42.819020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvdvseeyd {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:42.859451 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Successfully created port: 09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:07:42.876752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvdvseeyd" returned: 0 in 0.058s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:43.011519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c45322e1-842c-4e7d-aada-630cd2d931b7 req-17227d28-56c8-477e-bdf4-5136c5b93840 service nova] Releasing lock "refresh_cache-556b87cb-fbf9-4b7c-84c4-40f49005eb25" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:43.255240 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Took 1.58 seconds to deallocate network for instance.
Jun 27 04:07:43.419604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:43.452696 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:43.457409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:43.552259 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:43.652881 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:43.654399 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:43.687014 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:07:43.695257 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:07:43.696341 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Creating image(s)
Jun 27 04:07:43.696625 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:43.696887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "/opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:43.697509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "/opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:43.704565 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:43.732039 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Successfully updated port: 09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:07:43.750891 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:43.752753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:43.782846 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:43.783111 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:43.784157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:43.784157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:37:2f:2e, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:43.803314 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:43.806198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.013s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:43.821641 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-changed-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:43.828360 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Refreshing instance network info cache due to event network-changed-09b69400-d14a-4b80-a0d5-4e58c2e471af. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:43.828794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] Acquiring lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:43.828978 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] Acquired lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:43.829196 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Refreshing network info cache for port 09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:43.860742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:43.862685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:43.868151 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:43.868151 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:43.876651 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:07:43.880993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:43.998752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:43.999381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:44.097875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:44.116667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk 1073741824" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:44.116667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:44.117865 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:44.215879 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:44.216888 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:07:44.217008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:44.243516 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:44.311438 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:44.311922 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Cannot resize image /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:07:44.312466 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:07:44.312778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Ensure instance console log exists: /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:07:44.312966 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:44.313165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:44.313352 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:44.344818 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:44.463024 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:44.588696 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:44.638945 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Snapshot image upload complete
Jun 27 04:07:44.638945 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-85aefc8b-45e7-4822-8090-b6a5163de1fd tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Took 7.71 seconds to snapshot the instance on the hypervisor.
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Processing event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:44.716068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:44.717356 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:44.717807 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-34dca2b9-f5d0-4445-a90b-b1118bda04d0 req-20d8aaef-f61a-4581-99d5-aa4148e83fb3 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received unexpected event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with vm_state building and task_state spawning.
Jun 27 04:07:44.719660 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:44.722840 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:44.731622 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:44.744827 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000561050999976942 future=<Future at 0x7ec5183f1430 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:44.744827 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:44.744827 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=10.888078674000099 future=<Future at 0x7ec5183eae40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:44.744827 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=10.887963163999984 future=<Future at 0x7ec5183eae40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:44.744827 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] Emitting event <LifecycleEvent: 1782533249.738829, 58490b25-bc9d-4a48-aff3-3eb967088bc8 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:44.744827 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] VM Stopped (Lifecycle Event)
Jun 27 04:07:44.892067 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533264.8916767, 14cba585-a366-4fd8-81c6-71235e708858 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:44.892666 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:07:44.892781 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Started (Lifecycle Event)
Jun 27 04:07:44.895688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:07:44.897992 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance spawned successfully.
Jun 27 04:07:44.898508 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:07:45.223250 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:45.234400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-52d0cf68-414f-41b7-8779-4923e56a7ba4 req-878fd1c4-ce14-4721-a89a-145e3daaa1dc service nova] Releasing lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:45.235169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquired lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:45.235642 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:45.247818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01384898-966b-4dbc-814d-a4f8f6bc189d tempest-ImageDependencyTests-15655490 tempest-ImageDependencyTests-15655490-project-member] [instance: 58490b25-bc9d-4a48-aff3-3eb967088bc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:45.396218 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:45.398284 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:45.407776 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:45.408347 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:45.410055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:45.410055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:45.410055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:45.410055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:45.420306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3bf99a34-eac5-4c36-9abe-78a8d34ceb21 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.187s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:45.736557 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.931s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:45.847597 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Deleted allocations for instance 6ce1c75a-8520-40b5-a060-9580f2f789ed
Jun 27 04:07:45.861672 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:07:45.901580 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:07:45.902434 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533265.9020774, 14cba585-a366-4fd8-81c6-71235e708858 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:45.902571 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Paused (Lifecycle Event)
Jun 27 04:07:45.916132 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Took 10.23 seconds to spawn the instance on the hypervisor.
Jun 27 04:07:45.916310 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:46.106131 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:46.153187 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:46.309142 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Updating instance_info_cache with network_info: [{"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:46.405798 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:46.409058 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533266.4087615, 14cba585-a366-4fd8-81c6-71235e708858 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:46.409222 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Resumed (Lifecycle Event)
Jun 27 04:07:46.435798 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Took 18.22 seconds to build instance.
Jun 27 04:07:46.602213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:46.602526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:46.812827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Releasing lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:46.812827 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Instance network_info: |[{"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:07:46.814918 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Start _get_guest_xml network_info=[{"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:07:46.819952 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:07:46.821351 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-289477347', uuid='3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709'), owner=OwnerMeta(userid='b294bb1532b540cc970b2fe7aea50e6c', username='tempest-VolumesExtendAttachedTest-1697340961-project-member', projectid='f5e9d0be58e546fc9c6986b88628c189', projectname='tempest-VolumesExtendAttachedTest-1697340961'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533266.8208942) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:07:46.822401 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:07:46.825465 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:07:46.826224 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:07:46.826445 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:07:46.827376 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:07:46.828507 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:07:46.828507 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:07:46.828507 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:07:46.828507 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:07:46.828507 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:07:46.828507 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:07:46.829056 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:07:46.829265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:46.829452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:46.831893 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:07:46.832080 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:07:46.832266 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:07:46.832343 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:07:46.845075 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-289477347',display_name='tempest-VolumesExtendAttachedTest-instance-289477347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesextendattachedtest-instance-289477347',id=23,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOuAOpPRnqw9imUa7xOgjjK3LVxoSqe5fIAJIv2QF48B1Z4bjDrBHm1XZt8bJzJPSzKqBkufPbzAtej4AOiN8cNu5eO6W/gOh+JCqcUTTGoYYLv0nnRNsd5JC058udffQ==',key_name='tempest-keypair-9453299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5e9d0be58e546fc9c6986b88628c189',ramdisk_id='',reservation_id='r-1qbk48dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1697340961',owner_user_name='tempest-VolumesExtendAttachedTest-1697340961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b294bb1532b540cc970b2fe7aea50e6c',uuid=3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:07:46.845303 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Converting VIF {"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:46.845862 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:46.846574 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:46.858927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-adabac99-1c28-4e84-ab43-101a9493c204 tempest-ServerBootFromVolumeStableRescueTest-2029132639 tempest-ServerBootFromVolumeStableRescueTest-2029132639-project-member] Lock "6ce1c75a-8520-40b5-a060-9580f2f789ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.114s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:46.912053 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:46.913832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:46.937877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.733s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:46.990756 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:07:47.110535 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'flavor' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:47.345058 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Detaching volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <uuid>3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709</uuid>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <name>instance-00000017</name>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-289477347</nova:name>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:07:46</nova:creationTime>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:user uuid="b294bb1532b540cc970b2fe7aea50e6c">tempest-VolumesExtendAttachedTest-1697340961-project-member</nova:user>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:project uuid="f5e9d0be58e546fc9c6986b88628c189">tempest-VolumesExtendAttachedTest-1697340961</nova:project>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         <nova:port uuid="09b69400-d14a-4b80-a0d5-4e58c2e471af">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <entry name="serial">3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709</entry>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <entry name="uuid">3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709</entry>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.config"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:bf:b9:4c"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <target dev="tap09b69400-d1"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/console.log" append="off"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:07:47.349794 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Preparing to wait for external event network-vif-plugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-289477347',display_name='tempest-VolumesExtendAttachedTest-instance-289477347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesextendattachedtest-instance-289477347',id=23,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOuAOpPRnqw9imUa7xOgjjK3LVxoSqe5fIAJIv2QF48B1Z4bjDrBHm1XZt8bJzJPSzKqBkufPbzAtej4AOiN8cNu5eO6W/gOh+JCqcUTTGoYYLv0nnRNsd5JC058udffQ==',key_name='tempest-keypair-9453299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5e9d0be58e546fc9c6986b88628c189',ramdisk_id='',reservation_id='r-1qbk48dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1697340961',owner_user_name='tempest-VolumesExtendAttachedTest-1697340961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b294bb1532b540cc970b2fe7aea50e6c',uuid=3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Converting VIF {"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:47.356377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:07:47.359303 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:47.359303 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a53fa56e-6da3-5bfc-b5df-664ddfea408c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:47.359303 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:47.359983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:47.364042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:47.364342 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09b69400-d1, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:47.364855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09b69400-d1, col_values=(('qos', UUID('94417e6d-f35b-4e69-a28c-5dd4caf3559d')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:47.365223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09b69400-d1, col_values=(('external_ids', {'iface-id': '09b69400-d14a-4b80-a0d5-4e58c2e471af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:b9:4c', 'vm-uuid': '3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:47.367009 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:47.368863 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:47.373550 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:47.374956 np0000003830 nova-compute[98984]: INFO os_vif [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1')
Jun 27 04:07:47.442294 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Attempting to driver detach volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f from mountpoint /dev/vdb
Jun 27 04:07:47.453053 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Attempting to detach device vdb from instance c702a025-f366-4383-9aa7-4fe61cfb64b8 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <alias name="ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f"/>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <serial>dc6bb842-c7eb-49a1-8c42-dfaf5743130f</serial>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:47.456487 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:07:47.476828 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance c702a025-f366-4383-9aa7-4fe61cfb64b8 from the persistent domain config.
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] (1/8): Attempting to detach device vdb with device alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f from instance c702a025-f366-4383-9aa7-4fe61cfb64b8 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <alias name="ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f"/>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <serial>dc6bb842-c7eb-49a1-8c42-dfaf5743130f</serial>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:47.477280 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:07:48.115472 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:48.153088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533268.1524625, c702a025-f366-4383-9aa7-4fe61cfb64b8 => ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:07:48.163950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f for instance c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:07:48.171248 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance c702a025-f366-4383-9aa7-4fe61cfb64b8 from the live domain config.
Jun 27 04:07:48.577669 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-changed-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:48.577857 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Refreshing instance network info cache due to event network-changed-e8e16ef8-1d1a-4e8b-8975-d89037659b92. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:48.578058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] Acquiring lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:48.578218 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] Acquired lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:48.578367 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Refreshing network info cache for port e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:48.737679 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Detected multiple connections on this host for volume: dc6bb842-c7eb-49a1-8c42-dfaf5743130f, skipping target disconnect.
Jun 27 04:07:48.906035 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:48.906035 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:48.906035 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No VIF found with MAC fa:16:3e:bf:b9:4c, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:48.906884 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Using config drive
Jun 27 04:07:49.087679 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:49.101679 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:49.255072 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:49.256155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:49.256412 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attaching volume 189bc189-e575-4bef-8b1a-102726373c49 to /dev/vdb
Jun 27 04:07:49.335477 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:49.360616 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:49.379961 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:49.387189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:07:49.418785 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:49.430564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:49.476480 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:07:49.477996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:07:49.489397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:07:49.490914 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fefc:4d5', 'fe80::d890:2ff:fe54:ccb4', 'fe80::fc16:3eff:fe42:dc7f'] 
Jun 27 04:07:49.491041 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:07:49.491187 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:07:49.491746 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:49.492058 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating existing volume attachment record: 61e77256-da5a-4b54-9e94-bc1cee35dc96 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:07:49.651745 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:49.657945 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Creating config drive at /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.config
Jun 27 04:07:49.663341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9p2mfa7w {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:49.725228 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9p2mfa7w" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:49.950305 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updated VIF entry in instance network info cache for port e8e16ef8-1d1a-4e8b-8975-d89037659b92. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:49.950798 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updating instance_info_cache with network_info: [{"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:50.078407 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:07:50.079051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:50.079051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:50.079572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:50.079696 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:07:50.096180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:50.097513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:50.097513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:50.097719 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:50.097936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:50.098111 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:50.110895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:50.110895 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:50.120017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:07:50.120017 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49] added
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:50.132003 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:50.132320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:50.133085 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:50.133085 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49] added
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:07:50.136229 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:50.136591 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:07:50.136957 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:07:50.136957 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:07:50.280598 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.314596 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.318793 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.390147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:50.390213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:50.401666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b8afba06-5152-4428-b016-44973f49e003 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.572s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:50.446082 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.454325 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-13f64660-8878-4ed1-8d3a-c9a5dee880c4 req-90a8c319-7d95-48a6-aa2a-5b9f96377bf8 service nova] Releasing lock "refresh_cache-99670311-67bb-4d60-b854-655dc01f2722" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:50.578655 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2ed195be-e1db-4d0d-b350-2e270efb7d2a req-6324e67f-f1a7-4f23-b8b1-24de29dc32f8 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-plugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:50.578655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2ed195be-e1db-4d0d-b350-2e270efb7d2a req-6324e67f-f1a7-4f23-b8b1-24de29dc32f8 service nova] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:50.578655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2ed195be-e1db-4d0d-b350-2e270efb7d2a req-6324e67f-f1a7-4f23-b8b1-24de29dc32f8 service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:50.578655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2ed195be-e1db-4d0d-b350-2e270efb7d2a req-6324e67f-f1a7-4f23-b8b1-24de29dc32f8 service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:50.579068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2ed195be-e1db-4d0d-b350-2e270efb7d2a req-6324e67f-f1a7-4f23-b8b1-24de29dc32f8 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Processing event network-vif-plugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:07:50.677976 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-changed-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:50.678035 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Refreshing instance network info cache due to event network-changed-7f426ebf-0ad5-42b1-81d5-853a4740a1ab. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:50.678442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] Acquiring lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:50.678755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] Acquired lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:50.678947 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Refreshing network info cache for port 7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:50.768052 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.776517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.804695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:50.894475 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Detaching volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f
Jun 27 04:07:50.958340 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Attempting to driver detach volume dc6bb842-c7eb-49a1-8c42-dfaf5743130f from mountpoint /dev/vdb
Jun 27 04:07:50.966212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:07:50.968758 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:07:50.969089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Attempting to detach device vdb from instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <alias name="ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f"/>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <serial>dc6bb842-c7eb-49a1-8c42-dfaf5743130f</serial>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:50.969454 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:07:50.980341 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 from the persistent domain config.
Jun 27 04:07:50.980760 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] (1/8): Attempting to detach device vdb with device alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f from instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <alias name="ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f"/>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <serial>dc6bb842-c7eb-49a1-8c42-dfaf5743130f</serial>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:50.981173 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:07:51.135392 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:07:51.138835 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:51.154630 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:07:51.158358 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:51.173588 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:51.179951 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:51.181738 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.203104 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.203823 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.204463 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:51.277079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.40.100,3260]
Jun 27 04:07:51.277079 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:51.277079 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:51.299219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:51.327594 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:51.328374 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:51.328374 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:51.333074 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] HCTL ('15', '-', '-', 0) found on session 41 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:51.333712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:51.385760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching for a device in session 41 and hctl ['15', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:51.586432 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Stashing vm_state: active {{(pid=98984) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 27 04:07:51.589584 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:07:51.591179 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533271.5907295, 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:51.591772 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] VM Started (Lifecycle Event)
Jun 27 04:07:51.600456 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:07:51.605584 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Instance spawned successfully.
Jun 27 04:07:51.605914 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:07:51.700344 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:51.907879 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updated VIF entry in instance network info cache for port 7f426ebf-0ad5-42b1-81d5-853a4740a1ab. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:51.908299 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:52.100544 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:52.108882 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:52.116550 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:52.120105 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:52.120823 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:52.121423 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:52.122396 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:52.122396 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:07:52.156486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:52.156486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:52.291576 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.50.100,3260]
Jun 27 04:07:52.291576 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:52.291576 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:52.320093 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.248s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:52.346156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:07:52.348054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] HCTL ('16', '-', '-', 0) found on session 42 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:07:52.348054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:07:52.367269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching for a device in session 41 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:52.367593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:52.369854 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:52.377695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching for a device in session 42 and hctl ['16', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:52.396197 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:52.411133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95d5da6a-5d85-4927-be18-c0c93451b8d8 req-954d4e5a-29f8-4f68-9060-6c553c5c5518 service nova] Releasing lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:52.613069 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:07:52.613366 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533272.6131413, 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:52.613691 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] VM Paused (Lifecycle Event)
Jun 27 04:07:52.634189 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Took 8.95 seconds to spawn the instance on the hypervisor.
Jun 27 04:07:52.634189 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:52.669022 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:07:52.669322 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Claim successful on node np0000003830
Jun 27 04:07:52.688074 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-afd41906-98b4-49e5-92b9-6610e4ff693e req-e1992c85-a873-4dc4-a5c9-91e8e892b499 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-plugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:52.688199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-afd41906-98b4-49e5-92b9-6610e4ff693e req-e1992c85-a873-4dc4-a5c9-91e8e892b499 service nova] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:52.688962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-afd41906-98b4-49e5-92b9-6610e4ff693e req-e1992c85-a873-4dc4-a5c9-91e8e892b499 service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:52.690009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-afd41906-98b4-49e5-92b9-6610e4ff693e req-e1992c85-a873-4dc4-a5c9-91e8e892b499 service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:52.690009 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-afd41906-98b4-49e5-92b9-6610e4ff693e req-e1992c85-a873-4dc4-a5c9-91e8e892b499 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] No waiting events found dispatching network-vif-plugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:52.690009 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-afd41906-98b4-49e5-92b9-6610e4ff693e req-e1992c85-a873-4dc4-a5c9-91e8e892b499 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received unexpected event network-vif-plugged-09b69400-d14a-4b80-a0d5-4e58c2e471af for instance with vm_state building and task_state spawning.
Jun 27 04:07:53.118615 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:53.122896 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533273.1223447, 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:53.123177 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] VM Resumed (Lifecycle Event)
Jun 27 04:07:53.150759 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Took 14.80 seconds to build instance.
Jun 27 04:07:53.175578 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating resource usage from migration 62c24002-0209-46f1-91f7-56ef10c2ad6a
Jun 27 04:07:53.378596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching for a device in session 42 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:07:53.379181 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:07:53.627317 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:53.637146 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:07:53.655748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.323s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:53.783674 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:07:53.792255 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:07:54.105415 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:54.114607 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Found WWN 3300000008ef6a92f for multipath device dm-11 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:07:54.115275 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:54.115275 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] <== connect_volume: return (4036ms) {'type': 'block', 'scsi_wwn': '3300000008ef6a92f', 'path': '/dev/dm-11', 'multipath_id': '3300000008ef6a92f'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:54.115275 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008ef6a92f', 'path': '/dev/dm-11', 'multipath_id': '3300000008ef6a92f'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:07:54.126256 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'flavor' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:54.289746 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:07:54.351874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533274.3515153, 1be2d4c5-613b-40a0-97f5-e9776d36a813 => ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:07:54.354860 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dc6bb842-c7eb-49a1-8c42-dfaf5743130f for instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:07:54.358771 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 from the live domain config.
Jun 27 04:07:54.412383 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:07:54.412961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:54.413079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:54.413892 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:54.414562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:07:54.414562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:54.450863 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:54.451377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:07:54.451875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', '35')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:54.452839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f', '36')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:54.454160 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518776de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:07:54.454513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:07:54.454786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flush multipath device 330000000591f48fd {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:07:54.487599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:54.546315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:54.591235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:07:54.591389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:07:54.592705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:07:54.605257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:07:54.605568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:07:54.619990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:54.629804 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attempting to attach volume 189bc189-e575-4bef-8b1a-102726373c49 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]:   <alias name="ua-189bc189-e575-4bef-8b1a-102726373c49"/>
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-11"/>
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]:   <serial>189bc189-e575-4bef-8b1a-102726373c49</serial>
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:07:54.633580 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:07:54.677738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.40.100,3260]
Jun 27 04:07:54.677738 np0000003830 nova-compute[98984]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:54.677738 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:54.696700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:54.711407 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:54.717483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:54.753861 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.50.100,3260]
Jun 27 04:07:54.753861 np0000003830 nova-compute[98984]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-dc6bb842-c7eb-49a1-8c42-dfaf5743130f, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:54.753861 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:54.785308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:54.785782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:54.785782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== disconnect_volume: return (373ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:54.786065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:07:54.798445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.640s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:54.798445 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Migrating
Jun 27 04:07:54.798445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:54.798445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:55.300339 np0000003830 nova-compute[98984]: INFO nova.compute.rpcapi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
Jun 27 04:07:55.301110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:55.302687 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:07:55.495341 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:07:55.629988 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0011275759998170543 future=<Future at 0x7ec5183eae40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:55.632398 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Emitting event <LifecycleEvent: 1782533260.6286492, 6ce1c75a-8520-40b5-a060-9580f2f789ed => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:07:55.632398 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:55.632398 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] VM Stopped (Lifecycle Event)
Jun 27 04:07:55.638676 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-changed-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:55.639193 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Refreshing instance network info cache due to event network-changed-09b69400-d14a-4b80-a0d5-4e58c2e471af. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:07:55.639433 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] Acquiring lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:55.639433 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] Acquired lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:55.639572 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Refreshing network info cache for port 09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:07:55.825234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:55.825378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:55.825582 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:56.149288 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 6ce1c75a-8520-40b5-a060-9580f2f789ed] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:07:56.149288 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:56.330745 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:56.360902 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:56.361106 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:56.361362 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:07:56.361584 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No VIF found with MAC fa:16:3e:cc:24:49, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:07:56.508913 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-696c00e0-b637-409b-be78-f66cd7c2d985 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.118s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:56.764930 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:56.859102 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:57.007908 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Updated VIF entry in instance network info cache for port 09b69400-d14a-4b80-a0d5-4e58c2e471af. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:07:57.008270 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Updating instance_info_cache with network_info: [{"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:57.102813 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:07:57.376044 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:57.514888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bba4c24d-c43b-4953-aab5-54237fc03e7e req-d4919cec-2acf-4272-b5f6-59c3c04037c9 service nova] Releasing lock "refresh_cache-3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:57.605411 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:07:58.033246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d04abbdd-98ed-49ee-9fa3-806cb8f3af77 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.777s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:59.058034 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Rescuing
Jun 27 04:07:59.058535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:07:59.058535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:07:59.058602 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:07:59.107604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.122571 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Starting migrate_disk_and_power_off {{(pid=98984) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12623}}
Jun 27 04:07:59.154804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.158849 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.180813 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.288253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:59.290004 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:59.330200 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.337701 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.455818 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.468690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.483610 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999596688999873 future=<Future at 0x7ec53af664b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:59.484271 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998946612000054 future=<Future at 0x7ec53af664b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:59.487053 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.996483752999893 future=<Future at 0x7ec53af664b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:07:59.488671 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance destroyed successfully.
Jun 27 04:07:59.489929 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-959397301',display_name='tempest-ServerActionsTestOtherA-server-959397301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-959397301',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-oy0l1vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=14cba585-a366-4fd8-81c6-71235e708858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:07:59.490160 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:07:59.490905 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:07:59.491239 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:07:59.492664 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.492872 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f426ebf-0a, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:59.494012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.496824 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:59.497607 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.497833 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=837c67b1-2460-4d44-86ff-88db533b0c8e) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:07:59.498839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.499539 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:07:59.500235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:07:59.503689 np0000003830 nova-compute[98984]: INFO os_vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a')
Jun 27 04:07:59.508392 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:07:59.509295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:07:59.513876 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:07:59.514923 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b28d15da-e3e1-48ff-ba2c-935c87477c42 req-74e1a74c-ac78-4936-84ad-7e5f29200413 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:07:59.515803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b28d15da-e3e1-48ff-ba2c-935c87477c42 req-74e1a74c-ac78-4936-84ad-7e5f29200413 service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:07:59.516724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b28d15da-e3e1-48ff-ba2c-935c87477c42 req-74e1a74c-ac78-4936-84ad-7e5f29200413 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:07:59.517001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b28d15da-e3e1-48ff-ba2c-935c87477c42 req-74e1a74c-ac78-4936-84ad-7e5f29200413 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:07:59.517179 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b28d15da-e3e1-48ff-ba2c-935c87477c42 req-74e1a74c-ac78-4936-84ad-7e5f29200413 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:07:59.517294 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-b28d15da-e3e1-48ff-ba2c-935c87477c42 req-74e1a74c-ac78-4936-84ad-7e5f29200413 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received unexpected event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with vm_state active and task_state resize_migrating.
Jun 27 04:07:59.519541 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:07:59.520071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:07:59.520197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:07:59.560850 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:59.565800 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:07:59.566881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '40')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:59.567873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '39')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:07:59.569215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53813bc40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:07:59.569402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:07:59.569750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flush multipath device 3300000006d458d78 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:07:59.638848 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:59.699657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:07:59.766298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:07:59.766298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:07:59.766298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:07:59.779650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:07:59.779650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:07:59.791519 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:07:59.797589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:59.837312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260]
Jun 27 04:07:59.837312 np0000003830 nova-compute[98984]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:07:59.837312 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:59.860962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:59.879553 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:59.919468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260]
Jun 27 04:07:59.919468 np0000003830 nova-compute[98984]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:07:59.919468 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:59.940191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:07:59.940191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:07:59.940191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== disconnect_volume: return (426ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:07:59.940191 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:07:59.942589 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:07:59.943259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858_resize/disk.config /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:07:59.981821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "cp -r /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858_resize/disk.config /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config" returned: 0 in 0.038s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:07:59.994405 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:00.154982 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:00.362947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:00.362947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:00.370956 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:08:00.370956 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Claim successful on node np0000003830
Jun 27 04:08:00.602521 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:00.659305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:01.171173 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:01.171173 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:01.312087 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Port 7f426ebf-0ad5-42b1-81d5-853a4740a1ab binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:08:01.694943 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4ee5949f-f777-4015-8a68-505239fe4f3c req-6abc6787-183b-406b-85ed-96cf16a9093f service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:01.695800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4ee5949f-f777-4015-8a68-505239fe4f3c req-6abc6787-183b-406b-85ed-96cf16a9093f service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:01.696189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4ee5949f-f777-4015-8a68-505239fe4f3c req-6abc6787-183b-406b-85ed-96cf16a9093f service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:01.696628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4ee5949f-f777-4015-8a68-505239fe4f3c req-6abc6787-183b-406b-85ed-96cf16a9093f service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:01.697661 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4ee5949f-f777-4015-8a68-505239fe4f3c req-6abc6787-183b-406b-85ed-96cf16a9093f service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:01.697920 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4ee5949f-f777-4015-8a68-505239fe4f3c req-6abc6787-183b-406b-85ed-96cf16a9093f service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received unexpected event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with vm_state active and task_state resize_migrating.
Jun 27 04:08:02.239898 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:02.240445 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:02.319874 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:02.325309 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:08:02.347385 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:02.363074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:02.363226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:02.363433 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:02.390382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:02.533366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-781a1f01-ce40-4b63-a983-1933b3b00a6f req-5eb215a6-8b2f-41cf-b94e-8ff0c232c574 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:02.533975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-781a1f01-ce40-4b63-a983-1933b3b00a6f req-5eb215a6-8b2f-41cf-b94e-8ff0c232c574 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:02.534838 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-781a1f01-ce40-4b63-a983-1933b3b00a6f req-5eb215a6-8b2f-41cf-b94e-8ff0c232c574 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:02.534838 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-781a1f01-ce40-4b63-a983-1933b3b00a6f req-5eb215a6-8b2f-41cf-b94e-8ff0c232c574 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:02.534838 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-781a1f01-ce40-4b63-a983-1933b3b00a6f req-5eb215a6-8b2f-41cf-b94e-8ff0c232c574 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:02.534838 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-781a1f01-ce40-4b63-a983-1933b3b00a6f req-5eb215a6-8b2f-41cf-b94e-8ff0c232c574 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state active and task_state rescuing.
Jun 27 04:08:02.605375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:02.654259 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999680742999999 future=<Future at 0x7ec518373f20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:02.656951 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance destroyed successfully.
Jun 27 04:08:02.657782 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'numa_topology' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:02.744352 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:03.082016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:03.165976 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attempting a stable device rescue
Jun 27 04:08:03.253385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.892s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:03.254033 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:08:03.294558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98984) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 27 04:08:03.300325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:08:03.300553 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Creating image(s)
Jun 27 04:08:03.301367 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:03.301746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:03.302145 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:03.302392 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:03.370188 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:03.458966 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:03.459231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:03.459533 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:03.760590 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:08:03.760922 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:08:03.761199 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:03.761561 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:03.805195 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:03.807183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "32174ddccef5667c36879cedb8ec0bf6ce3d2a66" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:03.807183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "32174ddccef5667c36879cedb8ec0bf6ce3d2a66" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:03.889693 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7132d5dcadb043838976141746b8a26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a05730e4d204004b6dbe4c1389b8397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:08:03.962954 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:04.109766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:04.267791 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:08:04.499275 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:04.552623 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Successfully created port: 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:04.558226 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:04.620478 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1556ba9d-608e-439b-ac58-04e43ba62cc5 req-05fb4c0f-5daf-4f17-8336-62052c7e5e3f service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:04.623429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1556ba9d-608e-439b-ac58-04e43ba62cc5 req-05fb4c0f-5daf-4f17-8336-62052c7e5e3f service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:04.623666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1556ba9d-608e-439b-ac58-04e43ba62cc5 req-05fb4c0f-5daf-4f17-8336-62052c7e5e3f service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:04.623799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1556ba9d-608e-439b-ac58-04e43ba62cc5 req-05fb4c0f-5daf-4f17-8336-62052c7e5e3f service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:04.623955 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1556ba9d-608e-439b-ac58-04e43ba62cc5 req-05fb4c0f-5daf-4f17-8336-62052c7e5e3f service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:04.624151 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-1556ba9d-608e-439b-ac58-04e43ba62cc5 req-05fb4c0f-5daf-4f17-8336-62052c7e5e3f service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state active and task_state rescuing.
Jun 27 04:08:04.723082 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:04.771746 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:08:04.876973 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:04.880336 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:04.880814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:04.993338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.part --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:04.994202 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] e1d7f99d-95d8-4034-8167-7bb12dabe8fc was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:08:04.995124 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:08:04.995516 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.part /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.227582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:05.257009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.part /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.converted" returned: 0 in 0.261s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:05.271273 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.301148 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Successfully updated port: 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:05.361615 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-changed-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:05.361805 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing instance network info cache due to event network-changed-5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:05.362105 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:05.362247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:05.362414 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:05.369714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66.converted --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:05.370319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "32174ddccef5667c36879cedb8ec0bf6ce3d2a66" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.564s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:05.370947 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.375766 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.377657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "32174ddccef5667c36879cedb8ec0bf6ce3d2a66" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:05.378164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "32174ddccef5667c36879cedb8ec0bf6ce3d2a66" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:05.379614 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.383104 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.383474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.479384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66 --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:05.480064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66,backing_fmt=raw /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.rescue {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.532577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32174ddccef5667c36879cedb8ec0bf6ce3d2a66,backing_fmt=raw /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.rescue" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:05.533171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "32174ddccef5667c36879cedb8ec0bf6ce3d2a66" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:05.533659 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'migration_context' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:05.740350 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:05.750557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:05.770016 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.796382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:08:05.798358 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:08:05.798925 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Creating image(s)
Jun 27 04:08:05.799738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:05.800026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:05.801461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:05.802132 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.806375 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.807347 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:05.808174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.808567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:05.808875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:05.833075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:05.835396 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fead:db6c', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fefc:4d5', 'fe80::d890:2ff:fe54:ccb4', 'fe80::fc16:3eff:febf:b94c', 'fe80::ec39:ecff:fe58:15d3'] 
Jun 27 04:08:05.835629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:05.835806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:05.836227 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:05.866250 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:05.905580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:05.906264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:05.906854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:05.907396 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.911006 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:05.911370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:05.948709 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:06.009733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:06.010153 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:06.038049 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:06.038864 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:08:06.044460 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Start _get_guest_xml network_info=[{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "vif_mac": "fa:16:3e:cc:24:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e1d7f99d-95d8-4034-8167-7bb12dabe8fc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '61e77256-da5a-4b54-9e94-bc1cee35dc96', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, 'status': 'reserved', 'instance': '1dcb49d8-f1f8-435f-a9b9-13d640d8857a', 'attached_at': '', 'detached_at': '', 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'serial': '189bc189-e575-4bef-8b1a-102726373c49'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:06.044756 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'resources' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:06.063754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk 1073741824" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:06.064210 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:06.064488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:06.139136 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:06.141774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.077s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:06.142191 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:08:06.142477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:06.221028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:06.221428 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Cannot resize image /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:08:06.221828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:08:06.222015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:08:06.222341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:06.222593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:06.222757 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:06.549585 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:06.552715 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:06.554780 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2117052605', uuid='1dcb49d8-f1f8-435f-a9b9-13d640d8857a'), owner=OwnerMeta(userid='b2d46125fda94029b2d5b7c8fdaf56fa', username='tempest-ServerStableDeviceRescueTest-266477854-project-member', projectid='68fa5127b52042afb5b60ff945958fe1', projectname='tempest-ServerStableDeviceRescueTest-266477854'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "vif_mac": "fa:16:3e:cc:24:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533286.554218) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:06.559530 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:06.559971 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:06.561296 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:06.561569 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:06.563390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:06.563432 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:06.563642 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:06.563780 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:06.563953 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:06.564075 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:06.564196 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:06.564416 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:06.564696 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:06.564865 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:06.565029 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:06.565171 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:06.565359 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:06.644294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-93c3838f-f294-44ee-bc48-94e90fc6b0b2 req-7716bd56-a902-403e-bfb5-530384ff14b5 service nova] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:06.645085 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:06.645239 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:06.995145 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Starting finish_migration {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12810}}
Jun 27 04:08:06.996307 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:08:06.996820 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Creating image(s)
Jun 27 04:08:06.997229 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:08:06.997422 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Ensure instance console log exists: /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:08:06.997774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:06.997949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:06.998143 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:06.999083 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Start _get_guest_xml network_info=[{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '317678a8-c626-4203-ab70-81d5773bef74', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '14cba585-a366-4fd8-81c6-71235e708858', 'attached_at': '2026-06-27T04:08:06.000000', 'detached_at': '', 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'serial': 'fb269625-f2be-4d1d-97de-7481e591d06e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:07.001044 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:07.002047 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-959397301', uuid='14cba585-a366-4fd8-81c6-71235e708858'), owner=OwnerMeta(userid='ebb2d09351b2447bbfce95b09ad97b23', username='tempest-ServerActionsTestOtherA-1390022329-project-member', projectid='4b76ce35cec84d189228639d70c6be45', projectname='tempest-ServerActionsTestOtherA-1390022329'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533287.0017872) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:07.003421 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:07.003817 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:07.005014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:07.005226 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:07.006209 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:07.006532 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:07.006991 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:07.007055 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:07.007348 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:07.007613 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:07.007820 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:07.008054 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:07.008195 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:07.008357 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:07.008531 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:07.008702 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:07.019788 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:07.068516 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:07.082006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:07.114979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:07.116192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:07.116471 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:07.117415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:07.118253 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:07.119178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:07.119533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:07.120840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:07.120840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:07.135236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:07.135702 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:07.136004 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:07.136823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:07.137413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:07.137653 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:07.151526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:07.151526 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:07.156434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:07.156434 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e] added
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:07.165389 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:07.165865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:07.166102 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:07.166277 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e] added
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:07.170515 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:07.170783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:07.170879 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:07.171056 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:07.191332 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:07.194012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:07.194012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:07.194012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:07.194012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:07.194012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:07.194012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:07.217963 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:07.449679 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:07.638411 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:08.141797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:08.142138 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance network_info: |[{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:08:08.144607 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Start _get_guest_xml network_info=[{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:08.148041 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:08.149836 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='e52a57a3-19dd-482d-bd3a-20e3a5230c4e'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533288.149344) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:08.151509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:08.151966 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:08.152828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:08.153039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:08.154187 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:08.154701 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:08.154883 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:08.155023 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:08.155228 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:08.155418 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:08.155599 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:08.155875 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:08.156185 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:08.156378 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:08.156548 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:08.156718 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:08.168690 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:08.172260 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:08.175664 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=24,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-geh2au0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=e52a57a3-19dd-482d-bd3a-20e3a5230c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:08:08.175664 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:08.175664 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:08.176634 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'pci_devices' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:08.182845 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:08.188012 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.195135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.205928 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.218088 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.218834 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.223960 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.224840 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:08.261358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260]
Jun 27 04:08:08.261358 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:08.261358 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.273421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.279299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260]
Jun 27 04:08:08.279299 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:08.279299 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.293826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('9', '-', '-', 0) found on session 43 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:08.300338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.316588 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:08.316920 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:08.317236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:08.318141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:08.319704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] HCTL ('10', '-', '-', 0) found on session 44 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:08.319915 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:08.327406 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 43 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:08.327768 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:08.339627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Searching for a device in session 44 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:08.339627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <uuid>e52a57a3-19dd-482d-bd3a-20e3a5230c4e</uuid>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <name>instance-00000018</name>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:name>multiattach-server-0</nova:name>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:08</nova:creationTime>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         <nova:port uuid="5621924f-9e14-46a7-bd15-6952d449805b">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <entry name="serial">e52a57a3-19dd-482d-bd3a-20e3a5230c4e</entry>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <entry name="uuid">e52a57a3-19dd-482d-bd3a-20e3a5230c4e</entry>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:56:24:62"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <target dev="tap5621924f-9e"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/console.log" append="off"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:08:08.680286 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Preparing to wait for external event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=24,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-geh2au0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=e52a57a3-19dd-482d-bd3a-20e3a5230c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b088bb0f-6b8e-587e-bb52-dc52b6628158', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:08.696379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.706042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.706042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5621924f-9e, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:08.706042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5621924f-9e, col_values=(('qos', UUID('c82b7e75-fa36-4283-8d42-250e3edbaac0')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:08.706042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5621924f-9e, col_values=(('external_ids', {'iface-id': '5621924f-9e14-46a7-bd15-6952d449805b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:24:62', 'vm-uuid': 'e52a57a3-19dd-482d-bd3a-20e3a5230c4e'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:08.706042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.706042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:08.711820 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:08.712707 np0000003830 nova-compute[98984]: INFO os_vif [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e')
Jun 27 04:08:09.111464 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:09.138360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:08:10.156360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Found WWN 3300000006d458d78 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:10.156856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:10.157007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000006d458d78', 'path': '/dev/dm-1', 'multipath_id': '3300000006d458d78'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:10.157171 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d458d78', 'path': '/dev/dm-1', 'multipath_id': '3300000006d458d78'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:10.157646 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.964s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:10.158076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:10.171893 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:10.172455 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:10.172962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:10.173229 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:10.173589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:10.173760 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:10.189235 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:10.195932 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:10.204115 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:10.211271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.224303 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:10.224803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:10.225234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:10.225782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] HCTL ('15', '0', '0', 0) found on session 41 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:10.225872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.231233 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:10.231725 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:10.232028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:10.232028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:10.236413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] HCTL ('16', '0', '0', 0) found on session 42 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:10.236413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:10.236413 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:10.236413 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:10.236413 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:56:24:62, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:10.237793 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Using config drive
Jun 27 04:08:10.240748 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching for a device in session 41 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:10.240946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:10.244897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Searching for a device in session 42 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:10.245029 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:10.662670 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-959397301',display_name='tempest-ServerActionsTestOtherA-server-959397301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-959397301',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-oy0l1vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=14cba585-a366-4fd8-81c6-71235e708858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:08:10.662895 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:10.663513 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <uuid>14cba585-a366-4fd8-81c6-71235e708858</uuid>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <name>instance-00000016</name>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <memory>262144</memory>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherA-server-959397301</nova:name>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:07</nova:creationTime>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.micro" id="84">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:memory>256</nova:memory>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:user uuid="ebb2d09351b2447bbfce95b09ad97b23">tempest-ServerActionsTestOtherA-1390022329-project-member</nova:user>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:project uuid="4b76ce35cec84d189228639d70c6be45">tempest-ServerActionsTestOtherA-1390022329</nova:project>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         <nova:port uuid="7f426ebf-0ad5-42b1-81d5-853a4740a1ab">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <entry name="serial">14cba585-a366-4fd8-81c6-71235e708858</entry>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <entry name="uuid">14cba585-a366-4fd8-81c6-71235e708858</entry>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/disk.config"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <alias name="ua-fb269625-f2be-4d1d-97de-7481e591d06e"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <serial>fb269625-f2be-4d1d-97de-7481e591d06e</serial>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:42:dc:7f"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <target dev="tap7f426ebf-0a"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858/console.log" append="off"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:08:10.665051 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:08:10.667930 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-959397301',display_name='tempest-ServerActionsTestOtherA-server-959397301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-959397301',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-oy0l1vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=14cba585-a366-4fd8-81c6-71235e708858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:08:10.668197 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-240758118-network", "vif_mac": "fa:16:3e:42:dc:7f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:10.668839 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:10.669050 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:08:10.670009 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:10.670863 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:10.671195 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:08:10.673929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:10.674272 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea597a19-0838-5545-9948-c8f6e04dd075', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:10.678231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:10.692187 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:10.694965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:10.694965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f426ebf-0a, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:10.695210 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f426ebf-0a, col_values=(('qos', UUID('3110a541-3d71-4490-a8f4-875bd59c1a2c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:10.695902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f426ebf-0a, col_values=(('external_ids', {'iface-id': '7f426ebf-0ad5-42b1-81d5-853a4740a1ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:dc:7f', 'vm-uuid': '14cba585-a366-4fd8-81c6-71235e708858'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:10.699779 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:10.715215 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:10.715997 np0000003830 nova-compute[98984]: INFO os_vif [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a')
Jun 27 04:08:10.744408 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:10.881195 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Creating config drive at /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config
Jun 27 04:08:10.889649 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbo7e6udf {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:10.941578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbo7e6udf" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:11.122640 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:11.122920 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:11.176531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:08:11.402564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:11.445694 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:11.453587 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:11.563819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:11.610939 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:11.626585 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Detaching volume a85a04e9-dffd-44ca-b15b-231ca95dbcd7
Jun 27 04:08:11.629238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:11.707716 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Attempting to driver detach volume a85a04e9-dffd-44ca-b15b-231ca95dbcd7 from mountpoint /dev/vdc
Jun 27 04:08:11.718472 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fb3c1d83-3ac4-4479-af69-ad9f52af2d01 req-1656d87b-a812-4417-be18-b416dcd244b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:11.719232 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fb3c1d83-3ac4-4479-af69-ad9f52af2d01 req-1656d87b-a812-4417-be18-b416dcd244b2 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:11.719232 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fb3c1d83-3ac4-4479-af69-ad9f52af2d01 req-1656d87b-a812-4417-be18-b416dcd244b2 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:11.719232 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fb3c1d83-3ac4-4479-af69-ad9f52af2d01 req-1656d87b-a812-4417-be18-b416dcd244b2 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:11.719970 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fb3c1d83-3ac4-4479-af69-ad9f52af2d01 req-1656d87b-a812-4417-be18-b416dcd244b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Processing event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:08:11.723219 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Found disk vdc by alias ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:08:11.724826 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Found disk vdc by alias ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:08:11.724920 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Attempting to detach device vdc from instance f2a4a001-7934-403f-9b26-6b4ed727e22f from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:   <alias name="ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7"/>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:   <serial>a85a04e9-dffd-44ca-b15b-231ca95dbcd7</serial>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:11.725248 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:08:11.763272 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully detached device vdc from instance f2a4a001-7934-403f-9b26-6b4ed727e22f from the persistent domain config.
Jun 27 04:08:11.763605 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] (1/8): Attempting to detach device vdc with device alias ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 from instance f2a4a001-7934-403f-9b26-6b4ed727e22f from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:   <alias name="ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7"/>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:   <serial>a85a04e9-dffd-44ca-b15b-231ca95dbcd7</serial>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:11.771380 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:08:12.197222 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Found WWN 3300000008ef6a92f for multipath device dm-11 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:12.197811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:12.198060 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] <== connect_volume: return (5004ms) {'type': 'block', 'scsi_wwn': '3300000008ef6a92f', 'path': '/dev/dm-11', 'multipath_id': '3300000008ef6a92f'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:12.198060 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008ef6a92f', 'path': '/dev/dm-11', 'multipath_id': '3300000008ef6a92f'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:12.257810 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:12.257981 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:12.258163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] No VIF found with MAC fa:16:3e:42:dc:7f, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:12.258736 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Using config drive
Jun 27 04:08:12.497186 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533292.496602, f2a4a001-7934-403f-9b26-6b4ed727e22f => ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:08:12.498150 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 for instance f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:08:12.500917 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully detached device vdc from instance f2a4a001-7934-403f-9b26-6b4ed727e22f from the live domain config.
Jun 27 04:08:12.502441 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:08:12.504097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:12.504097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:12.504097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:12.504097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:08:12.504097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:12.540420 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:12.540825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '44')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:08:12.541174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '34')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:12.542026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7', '33')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:12.542935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51876c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:08:12.543134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:08:12.543399 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flush multipath device 330000000ef02e8af {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:08:12.585714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:12.655169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:12.713408 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2117052605',display_name='tempest-ServerStableDeviceRescueTest-server-2117052605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverstabledevicerescuetest-server-2117052605',id=17,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSFYd/JkH+Vz3YsGvTwO9jit43qVKUlHw0XT+6lNosIG0v40wc3s9VfFpr/hClJBHRnYZTS/XpX5bvytocfQkLZlpKa5rDe2MI/579Dc1a5pubKxHCtUVE13jqffmeUiQ==',key_name='tempest-keypair-857089329',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:50Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68fa5127b52042afb5b60ff945958fe1',ramdisk_id='',reservation_id='r-6geb1f7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-266477854',owner_user_name='tempest-ServerStableDeviceRescueTest-266477854-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2d46125fda94029b2d5b7c8fdaf56fa',uuid=1dcb49d8-f1f8-435f-a9b9-13d640d8857a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "vif_mac": "fa:16:3e:cc:24:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:08:12.713929 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converting VIF {"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "vif_mac": "fa:16:3e:cc:24:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:12.714723 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:12.715778 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:12.720358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:08:12.720358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:08:12.721919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:08:12.733830 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:08:12.734153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:08:12.749330 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:12.789046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.40.100,3260]
Jun 27 04:08:12.789046 np0000003830 nova-compute[98984]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:12.789046 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:12.822411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:12.840219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:12.881941 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.50.100,3260]
Jun 27 04:08:12.881941 np0000003830 nova-compute[98984]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-a85a04e9-dffd-44ca-b15b-231ca95dbcd7, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:12.881941 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:12.904526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:12.904876 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:12.905093 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] <== disconnect_volume: return (402ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:12.905318 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:08:12.981583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:13.038556 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:13.171231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:13.221011 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <uuid>1dcb49d8-f1f8-435f-a9b9-13d640d8857a</uuid>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <name>instance-00000011</name>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2117052605</nova:name>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:06</nova:creationTime>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:user uuid="b2d46125fda94029b2d5b7c8fdaf56fa">tempest-ServerStableDeviceRescueTest-266477854-project-member</nova:user>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:project uuid="68fa5127b52042afb5b60ff945958fe1">tempest-ServerStableDeviceRescueTest-266477854</nova:project>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         <nova:port uuid="5c588384-6b02-40d8-ac17-e99ed811d602">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <entry name="serial">1dcb49d8-f1f8-435f-a9b9-13d640d8857a</entry>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <entry name="uuid">1dcb49d8-f1f8-435f-a9b9-13d640d8857a</entry>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <alias name="ua-189bc189-e575-4bef-8b1a-102726373c49"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-11"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <serial>189bc189-e575-4bef-8b1a-102726373c49</serial>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.rescue"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <target dev="vdc" bus="virtio"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <boot order="1"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:cc:24:49"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <target dev="tap5c588384-6b"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/console.log" append="off"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:08:13.228404 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:08:13.241533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:13.251768 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:13.266541 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance destroyed successfully.
Jun 27 04:08:13.328615 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533293.3278046, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:13.328615 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Started (Lifecycle Event)
Jun 27 04:08:13.330630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:08:13.352427 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:08:13.363146 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance spawned successfully.
Jun 27 04:08:13.364175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:08:13.551460 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'flavor' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:13.832115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:13.832115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:13.832115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:13.832115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:13.832115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:13.832115 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received unexpected event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with vm_state building and task_state spawning.
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received unexpected event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with vm_state active and task_state resize_finish.
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-931aac70-5cb7-4a66-a733-0a2fbddcb167 req-41ada27f-b367-4bf6-bc38-21dc6c24d2dd service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received unexpected event network-vif-plugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with vm_state active and task_state resize_finish.
Jun 27 04:08:13.837191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:13.840208 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:13.872747 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:13.873024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:13.873528 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:13.873881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:13.874254 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:13.874914 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:14.114754 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:14.342368 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:08:14.342858 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533294.3424482, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:14.342858 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Paused (Lifecycle Event)
Jun 27 04:08:14.382009 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Took 8.59 seconds to spawn the instance on the hypervisor.
Jun 27 04:08:14.382279 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:14.395459 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:08:14.400091 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance running successfully.
Jun 27 04:08:14.404107 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Failed to set time: agent not configured {{(pid=98984) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 27 04:08:14.404442 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b6bd4cd4-4953-404e-a647-755cf051ff23 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] finish_migration finished successfully. {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12905}}
Jun 27 04:08:14.483869 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004960750000009284 future=<Future at 0x7ec53af664b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:14.484401 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Emitting event <LifecycleEvent: 1782533279.4830856, 14cba585-a366-4fd8-81c6-71235e708858 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:14.484603 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:14.484775 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.1684343449999233 future=<Future at 0x7ec518373f20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:14.485431 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.1682978779999758 future=<Future at 0x7ec518373f20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:14.485561 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Stopped (Lifecycle Event)
Jun 27 04:08:14.544952 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-20d99f27-8a69-435c-8691-2594e79fb557 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.422s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:14.794891 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:14.795048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:14.795241 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:14.795333 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:14.795466 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] No VIF found with MAC fa:16:3e:cc:24:49, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:14.796191 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Using config drive
Jun 27 04:08:14.849059 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:14.851046 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533294.8506782, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:14.851207 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Resumed (Lifecycle Event)
Jun 27 04:08:14.896957 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Took 14.60 seconds to build instance.
Jun 27 04:08:14.988239 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:15.304528 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'ec2_ids' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:15.353931 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:15.356098 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:15.398792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4e41a7d0-4076-4130-b834-d23ce351bc98 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.110s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:15.697602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:15.704279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:15.715576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:15.715576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:15.715576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:15.715576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:15.715576 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Terminating instance
Jun 27 04:08:15.809551 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:15.809551 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'keypairs' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:15.860581 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533295.8599875, 14cba585-a366-4fd8-81c6-71235e708858 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:15.860581 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Resumed (Lifecycle Event)
Jun 27 04:08:16.211898 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:08:16.253208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:16.257741 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:16.279790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:16.286136 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:16.315297 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:16.318944 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:16.328101 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:16.329583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:16.369601 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:16.378135 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:16.499339 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Creating config drive at /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config.rescue
Jun 27 04:08:16.505549 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22d99b63-d8ba-4faa-abd7-5e529fef2e25 req-4fc4e5dd-33e6-449b-a0c0-985289e4c805 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:16.506592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22d99b63-d8ba-4faa-abd7-5e529fef2e25 req-4fc4e5dd-33e6-449b-a0c0-985289e4c805 service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:16.506909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22d99b63-d8ba-4faa-abd7-5e529fef2e25 req-4fc4e5dd-33e6-449b-a0c0-985289e4c805 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:16.507230 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22d99b63-d8ba-4faa-abd7-5e529fef2e25 req-4fc4e5dd-33e6-449b-a0c0-985289e4c805 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:16.507230 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22d99b63-d8ba-4faa-abd7-5e529fef2e25 req-4fc4e5dd-33e6-449b-a0c0-985289e4c805 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] No waiting events found dispatching network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:16.507728 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22d99b63-d8ba-4faa-abd7-5e529fef2e25 req-4fc4e5dd-33e6-449b-a0c0-985289e4c805 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:08:16.514175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmm8l88lm {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:16.564299 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Instance destroyed successfully.
Jun 27 04:08:16.565406 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'resources' on Instance uuid f2a4a001-7934-403f-9b26-6b4ed727e22f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:16.587379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmm8l88lm" returned: 0 in 0.073s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:16.706070 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:16.706260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:16.706445 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Going to confirm migration 1 {{(pid=98984) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
Jun 27 04:08:16.881350 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533296.8809416, 14cba585-a366-4fd8-81c6-71235e708858 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:16.881521 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Started (Lifecycle Event)
Jun 27 04:08:17.077153 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-730649319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-730649319',id=12,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGxs0vSaOLHtuQdOTSUvhM94RLL2OkChlIMhMQu9jKceEWYn7zdvETRnv7ji+7V/bmD9GnYnOws4r7cvDGn9+GQuzyBayOrSwdw/YJJ6IKT1u+wBoJDzp8TSXpvjOruGw==',key_name='tempest-keypair-1297937537',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:32Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-m4l5pg7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=f2a4a001-7934-403f-9b26-6b4ed727e22f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:08:17.079937 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "address": "fa:16:3e:ad:db:6c", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcdcb8d4-1f", "ovs_interfaceid": "bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:17.079937 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:17.079937 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:08:17.081936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.082270 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcdcb8d4-1f, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:17.083596 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.084615 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:17.094957 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.096472 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.096738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec8a1c71-0886-4b8a-97ba-06a4e301d61a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:17.101836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.101836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:17.110172 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.122792 np0000003830 nova-compute[98984]: INFO os_vif [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:db:6c,bridge_name='br-int',has_traffic_filtering=True,id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcdcb8d4-1f')
Jun 27 04:08:17.122792 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Deleting instance files /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f_del
Jun 27 04:08:17.141353 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Deletion of /opt/stack/data/nova/instances/f2a4a001-7934-403f-9b26-6b4ed727e22f_del complete
Jun 27 04:08:17.175078 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.212847 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.215565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.225066 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:17.363809 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.388156 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:17.410915 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:17.410915 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:17.410915 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquired lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:17.410915 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:17.410915 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'info_cache' on Instance uuid 14cba585-a366-4fd8-81c6-71235e708858 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:17.413893 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:17.654866 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0014359249998960877 future=<Future at 0x7ec518373f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:17.654866 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:17.658883 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Emitting event <LifecycleEvent: 1782533282.6531186, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:17.659060 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Stopped (Lifecycle Event)
Jun 27 04:08:17.662629 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Took 1.45 seconds to destroy the instance on the hypervisor.
Jun 27 04:08:17.662629 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:08:17.663070 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:08:17.663934 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:08:17.663934 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:17.692821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.703036 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.722159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.722543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.757990 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:17.801324 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:17.920214 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999689057000069 future=<Future at 0x7ec5181b8e90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:17.920214 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999058936999973 future=<Future at 0x7ec5181b8e90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:17.920214 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998929191999878 future=<Future at 0x7ec5181b8e90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:18.162157 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-13357a69-c94c-4cfb-a9b9-98a7646a1a10 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:18.425798 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:18.498949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-663cfa6e-bb4f-4eee-bcb7-de6beb976941 req-1e096124-f019-4884-85f9-80edacac10f1 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-deleted-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:18.499176 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-663cfa6e-bb4f-4eee-bcb7-de6beb976941 req-1e096124-f019-4884-85f9-80edacac10f1 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Neutron deleted interface bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6; detaching it from the instance and deleting it from the info cache
Jun 27 04:08:18.502709 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-663cfa6e-bb4f-4eee-bcb7-de6beb976941 req-1e096124-f019-4884-85f9-80edacac10f1 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Detach interface failed, port_id=bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6, reason: Instance f2a4a001-7934-403f-9b26-6b4ed727e22f could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:08:18.645399 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:18.645560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquiring lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:18.648641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:18.649311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:18.649473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] No waiting events found dispatching network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:18.649727 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Received event network-vif-unplugged-bcdcb8d4-1fcd-44a4-9e02-5958f3aaaff6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:08:18.649938 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:18.650264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:18.650510 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:18.650748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:18.650983 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:18.651416 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state active and task_state rescuing.
Jun 27 04:08:18.651641 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-changed-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:18.651836 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Refreshing instance network info cache due to event network-changed-2c75c4dc-87e1-4fc7-9a88-307115ff819c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:18.652056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquiring lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:18.652239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquired lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:18.652423 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Refreshing network info cache for port 2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:18.689859 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533298.6893811, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:18.689859 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Resumed (Lifecycle Event)
Jun 27 04:08:18.697990 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0e62eb83-8f1f-4045-9e2b-74437feb3983 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:18.901304 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:18.926205 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:19.077608 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [{"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:19.122899 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:19.157593 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:19.196464 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:19.199540 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:19.437340 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Took 1.77 seconds to deallocate network for instance.
Jun 27 04:08:19.580792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Releasing lock "refresh_cache-14cba585-a366-4fd8-81c6-71235e708858" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:19.581235 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'migration_context' on Instance uuid 14cba585-a366-4fd8-81c6-71235e708858 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:19.641412 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:19.704716 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533299.7038076, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:19.704893 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Started (Lifecycle Event)
Jun 27 04:08:19.743593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:19.745966 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:19.832087 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updated VIF entry in instance network info cache for port 2c75c4dc-87e1-4fc7-9a88-307115ff819c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:19.832378 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updating instance_info_cache with network_info: [{"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:19.834666 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Rebuilding instance
Jun 27 04:08:19.948679 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:19.948844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:20.015707 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:20.084656 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Object Instance<14cba585-a366-4fd8-81c6-71235e708858> lazy-loaded attributes: info_cache,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:20.085859 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:20.210949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:20.217193 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:20.223024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:20.223024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:20.248119 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:08:20.339015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Releasing lock "refresh_cache-1be2d4c5-613b-40a0-97f5-e9776d36a813" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:20.339015 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-changed-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:20.339015 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing instance network info cache due to event network-changed-5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:20.339015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:20.339247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:20.339247 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:20.724007 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:08:20.789448 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Unrescuing
Jun 27 04:08:20.789448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:20.789448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:20.789448 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:20.844344 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:20.849606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:20.971229 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:20.971520 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:21.059390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.066011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.089207 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.099910 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.134100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.137510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.292579 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:21.322800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:21.332454 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:21.355076 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-efd8b4e3-2776-4180-bbe0-400cf041504e req-84c37e3f-83ff-4976-9e62-fea1c84f8c4e service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:21.355738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-efd8b4e3-2776-4180-bbe0-400cf041504e req-84c37e3f-83ff-4976-9e62-fea1c84f8c4e service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:21.355738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-efd8b4e3-2776-4180-bbe0-400cf041504e req-84c37e3f-83ff-4976-9e62-fea1c84f8c4e service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:21.355738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-efd8b4e3-2776-4180-bbe0-400cf041504e req-84c37e3f-83ff-4976-9e62-fea1c84f8c4e service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:21.360734 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-efd8b4e3-2776-4180-bbe0-400cf041504e req-84c37e3f-83ff-4976-9e62-fea1c84f8c4e service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:21.360734 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-efd8b4e3-2776-4180-bbe0-400cf041504e req-84c37e3f-83ff-4976-9e62-fea1c84f8c4e service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuilding.
Jun 27 04:08:21.397153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.434446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.446226 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999704174000044 future=<Future at 0x7ec5183d1b80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:21.446226 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance destroyed successfully.
Jun 27 04:08:21.452909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.468113 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.475434 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:21.492052 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance destroyed successfully.
Jun 27 04:08:21.495003 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-980582709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionsv293testjson-server-844248708',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuyiudFpREd/ABd9CQTPRBpKOMLvejaZPuRMCxP5zbNlnC7ydBW46wKbUDuAckdqgdn6b/On7/IwzxCCgukLifogPI5AHYn/D4u7jX134iPu48395wkEHLPrVpode/uhA==',key_name='tempest-keypair-1481687516',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:38Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85de4b575a314a0fa4c6352eaf5b1753',ramdisk_id='',reservation_id='r-cesx1l83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-165019121',owner_user_name='tempest-ServerActionsV293TestJSON-165019121-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eab22bac1a364b3988558ae38ed50d34',uuid=556b87cb-fbf9-4b7c-84c4-40f49005eb25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:08:21.495419 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converting VIF {"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:21.496780 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:21.498046 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:08:21.500851 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.500851 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7ab7cfb-65, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:21.504412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.504787 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:21.508010 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.508010 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77f88819-088f-4b1e-b849-d40b585085d7) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:21.515620 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.515620 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:21.516194 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.519180 np0000003830 nova-compute[98984]: INFO os_vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65')
Jun 27 04:08:21.526369 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:08:21.526369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:21.526369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:21.526369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:21.526369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:08:21.526369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:21.569211 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '44')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:08:21.572737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '38')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:21.575428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '37')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:21.575428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53841b920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'): ({'sdf'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:08:21.575428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:08:21.575428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Flush multipath device 3300000007b684c46 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:08:21.647693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:21.697780 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:21.746744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:08:21.747209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:08:21.749083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:08:21.767704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:08:21.767704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:08:21.798589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:21.798589 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updated VIF entry in instance network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:21.798589 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:21.826515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260]
Jun 27 04:08:21.826515 np0000003830 nova-compute[98984]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:21.826515 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:21.845575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:21.866122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:21.893559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.895943 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.899322 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.902758 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.905646 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:21.907868 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260]
Jun 27 04:08:21.907868 np0000003830 nova-compute[98984]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:21.907868 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:21.926143 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:21.927943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:21.928279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:21.929652 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== disconnect_volume: return (406ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:21.929836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:08:21.930101 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Deleting instance files /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25_del
Jun 27 04:08:21.930562 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Deletion of /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25_del complete
Jun 27 04:08:21.968412 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:21.969469 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing instance network info cache due to event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:21.969736 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:22.002062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.053s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:22.004582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.919s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:22.038589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:22.065011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:22.068457 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:22.097840 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Deleted allocations for instance f2a4a001-7934-403f-9b26-6b4ed727e22f
Jun 27 04:08:22.130905 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:22.304434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:22.304905 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:22.304905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:22.305140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:22.305260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:22.305589 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:22.305668 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4188e3f0-b0fe-4999-8297-dc366da48537 req-635f6cb6-4265-4803-8bb8-09fbb460d662 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state active and task_state rescuing.
Jun 27 04:08:22.563283 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 556b87cb-fbf9-4b7c-84c4-40f49005eb25 could not be found.
Jun 27 04:08:22.564916 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:08:22.565368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:22.565711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:22.566007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:22.566333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:08:22.566519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:22.594815 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:22.595127 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:22.595383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '44')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:08:22.595596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:22.595688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:08:22.595851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:22.598026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:08:22.598026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51876dc60>, {}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:08:22.598026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Disconnecting from: [] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:08:22.598026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:22.598026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== disconnect_volume: return (31ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:22.598026 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:08:22.634070 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:22.634564 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'flavor' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:22.635913 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:22.636596 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:23.116233 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-48aca4f8-4490-4900-b32e-c04d95d7ae90 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "f2a4a001-7934-403f-9b26-6b4ed727e22f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.407s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.145553 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:23.176236 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:23.181094 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:23.211380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:23.216131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:23.251118 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:23.255336 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:23.384458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:23.384639 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:23.408260 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e6e9118f-e089-43f6-813d-b836693cd902 req-4803ce34-65f8-4258-8f44-6ef426a48819 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:23.409171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6e9118f-e089-43f6-813d-b836693cd902 req-4803ce34-65f8-4258-8f44-6ef426a48819 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.409171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6e9118f-e089-43f6-813d-b836693cd902 req-4803ce34-65f8-4258-8f44-6ef426a48819 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.409171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6e9118f-e089-43f6-813d-b836693cd902 req-4803ce34-65f8-4258-8f44-6ef426a48819 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.409343 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e6e9118f-e089-43f6-813d-b836693cd902 req-4803ce34-65f8-4258-8f44-6ef426a48819 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:23.409478 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e6e9118f-e089-43f6-813d-b836693cd902 req-4803ce34-65f8-4258-8f44-6ef426a48819 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:08:23.434515 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:23.435663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuilding.
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.438799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.440804 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.441020 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:23.441231 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuilding.
Jun 27 04:08:23.441416 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:23.441724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.441918 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.442061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.442167 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:23.442655 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuilding.
Jun 27 04:08:23.442655 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:23.442655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.442839 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.442839 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.443137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:23.443137 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuilding.
Jun 27 04:08:23.443137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:23.444264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.444264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.444264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.444909 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:23.445037 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9c383081-e283-478e-bf46-1567573799b2 req-3ba7f923-a1d2-420f-9449-043b15d80053 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuilding.
Jun 27 04:08:23.556228 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999611747000017 future=<Future at 0x7ec51838a330 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:23.558326 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance destroyed successfully.
Jun 27 04:08:23.563248 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'numa_topology' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:23.615004 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:23.820523 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Preparing to wait for external event volume-reimaged-55d1eb6f-568d-4401-aa61-08e54f222bc2 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:08:23.820523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:23.820523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:23.820523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:23.838489 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updated VIF entry in instance network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:23.838489 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:23.838489 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:23.838489 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:23.838489 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:08:23.890885 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:24.048884 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:24.048935 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing instance network info cache due to event network-changed-5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:24.049100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] Acquiring lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:24.061889 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Object Instance<1dcb49d8-f1f8-435f-a9b9-13d640d8857a> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:24.126853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:24.341664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-75d1234f-9fbf-4223-a045-eb5bcf976885 req-dc152fc8-b8f5-4ee0-8109-0da1f8137742 service nova] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:24.341664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] Acquired lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:24.341664 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Refreshing network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:24.621833 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:24.653577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:24.753142 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:24.831014 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:24.831014 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:24.846326 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:24.906340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.902s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:24.910970 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.060s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:24.919726 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:08:24.923416 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Claim successful on node np0000003830
Jun 27 04:08:25.068045 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:25.073798 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:25.103031 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:25.295117 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:25.338701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:25.511172 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updated VIF entry in instance network info cache for port 5c588384-6b02-40d8-ac17-e99ed811d602. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:25.511172 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [{"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:25.526637 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:25.530938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:25.531159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:25.531265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:25.531420 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:25.531557 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:08:25.531678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:25.531824 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:25.532252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:25.532252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:25.532375 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:25.532438 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:08:25.532623 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:25.532764 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:25.532821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:25.533023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:25.533162 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:25.533256 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-aa2643da-3451-4222-a642-cfe4fbd9ef55 req-c653e03d-cbf1-4799-af5b-b60f3c84b9c9 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received unexpected event network-vif-plugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:08:25.627701 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Deleted allocation for migration 62c24002-0209-46f1-91f7-56ef10c2ad6a
Jun 27 04:08:25.808281 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 1dcb49d8-f1f8-435f-a9b9-13d640d8857a due to new event <LifecycleEvent: 1782533305.8079133, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:08:25.808473 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533305.8079133, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:25.809600 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Resumed (Lifecycle Event)
Jun 27 04:08:25.811231 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5e621e4a-9a70-4958-a30f-b0526ea2c173 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:26.013825 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1df99266-b377-4b47-94d3-b9ceda5d2ff2 req-53d2a449-9963-431c-8f6f-533c8f9f597c service nova] Releasing lock "refresh_cache-1dcb49d8-f1f8-435f-a9b9-13d640d8857a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:26.134266 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df1ec116-2a5c-4ec6-9dc5-03b7ffca9cbd tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 9.428s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:26.302407 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e6417fd0-38dd-44d8-b6fd-4c85fbc569ff tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Get console output
Jun 27 04:08:26.315297 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:26.317156 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:26.382676 np0000003830 nova-compute[98984]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jun 27 04:08:26.511276 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:26.729738 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:26.730000 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:26.825917 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533306.8255568, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:26.826064 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Started (Lifecycle Event)
Jun 27 04:08:27.007952 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:27.008548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:27.233254 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:27.328612 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:27.333520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:27.514640 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:08:27.740847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.834s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:27.741808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.419s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:27.742242 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:08:27.750048 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:08:27.752017 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Claim successful on node np0000003830
Jun 27 04:08:28.081174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:28.249143 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:08:28.249776 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:08:28.250316 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:28.250723 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:28.520705 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aa12f7997774c398f0484c98050ca5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5550c68573fa4ae7b3b9553209bb7625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:08:28.751737 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:08:29.130773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:29.147469 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully created port: cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:29.638537 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:29.638537 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:29.766616 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully created port: 40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:30.142208 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:30.261909 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:08:30.423720 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully created port: 1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:30.651137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.910s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:30.651787 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:08:30.655783 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 5.317s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:30.656749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:30.657009 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:08:30.658334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.578s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:30.666518 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:08:30.670437 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Claim successful on node np0000003830
Jun 27 04:08:30.772512 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Booting with volume 8e678f6e-3918-45c1-b14d-d57981f35cbb at /dev/vda
Jun 27 04:08:30.852727 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:30.872983 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:30.909098 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:30.973297 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:30.973297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:30.989426 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:30.992564 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:febf:b94c', 'fe80::ec39:ecff:fe58:15d3', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fe42:dc7f', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1'] 
Jun 27 04:08:30.993931 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:30.993931 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:30.993931 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:30.993931 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating existing volume attachment record: 871b96a1-6bfc-47b3-885d-49cf882d36bd {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:08:31.089288 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully created port: 5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:31.168437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:08:31.168437 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:08:31.169393 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:31.170106 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:31.324849 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7132d5dcadb043838976141746b8a26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a05730e4d204004b6dbe4c1389b8397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:08:31.514674 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:31.680758 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:08:31.733037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:31.873067 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:31.874269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:31.921935 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully created port: 3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:31.933786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:31.933786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:32.001590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.007126 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:08:32.017732 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:08:32.025869 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.156217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.157457 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.190802 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:08:32.250870 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Successfully created port: dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:32.272686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.283027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.409975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.411158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.457162 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lazy-loading 'flavor' on Instance uuid 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:32.533110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.534997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:08:32.539772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.584398 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07056591-b0ac-4037-8696-b53a7fdcfe67 req-a6372404-43f8-498a-a172-740b5fb90fe8 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event volume-reimaged-55d1eb6f-568d-4401-aa61-08e54f222bc2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:32.584841 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07056591-b0ac-4037-8696-b53a7fdcfe67 req-a6372404-43f8-498a-a172-740b5fb90fe8 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:32.586166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07056591-b0ac-4037-8696-b53a7fdcfe67 req-a6372404-43f8-498a-a172-740b5fb90fe8 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:32.586574 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07056591-b0ac-4037-8696-b53a7fdcfe67 req-a6372404-43f8-498a-a172-740b5fb90fe8 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:32.586937 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07056591-b0ac-4037-8696-b53a7fdcfe67 req-a6372404-43f8-498a-a172-740b5fb90fe8 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Processing event volume-reimaged-55d1eb6f-568d-4401-aa61-08e54f222bc2 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:08:32.591473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance event wait completed in 8 seconds for volume-reimaged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:08:32.664462 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.665015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.717035 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Booting with volume c6e6b53c-3278-4d18-a8a0-731ce1afe424 at /dev/vdb
Jun 27 04:08:32.787903 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.800435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.834620 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:32.855602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:32.888282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.924018 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.004933725999990202 future=<Future at 0x7ec5181b8e90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:32.924256 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:32.928291 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:32.931436 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] Emitting event <LifecycleEvent: 1782533297.9187872, f2a4a001-7934-403f-9b26-6b4ed727e22f => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:32.939385 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.500738201000104 future=<Future at 0x7ec5183d1b80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:32.942997 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] VM Stopped (Lifecycle Event)
Jun 27 04:08:32.944786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:32.949348 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.489916063999999 future=<Future at 0x7ec5183d1b80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:32.949964 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:32.950381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:32.977410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:32.986379 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Ignoring supplied device name: /dev/vdb
Jun 27 04:08:33.007573 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:33.007858 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:33.008008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:33.009698 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:33.011517 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:33.017718 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:33.019719 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:febf:b94c', 'fe80::ec39:ecff:fe58:15d3', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fe42:dc7f', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1'] 
Jun 27 04:08:33.019937 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:33.020427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:33.021788 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:33.024586 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating existing volume attachment record: d3fa67ec-22ed-4435-a341-84b18e2b98d5 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:08:33.072920 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.073957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.108961 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Booting with volume 55d1eb6f-568d-4401-aa61-08e54f222bc2 at /dev/vda
Jun 27 04:08:33.122287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:33.123144 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:33.169690 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Successfully updated port: dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:33.187285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.187285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.218966 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:08:33.223889 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:33.224872 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:08:33.225714 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Creating image(s)
Jun 27 04:08:33.228871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:33.229540 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:33.232593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:33.232593 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:33.241419 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:33.251544 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:33.252322 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing instance network info cache due to event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:33.253667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:33.254994 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.256245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:33.257375 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:33.259340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:33.302834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.325301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.338000 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:33.342385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.364391 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:33.366207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:33.381555 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:33.384108 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:febf:b94c', 'fe80::ec39:ecff:fe58:15d3', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fe42:dc7f', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1'] 
Jun 27 04:08:33.385328 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.131s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.385328 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:33.385328 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:33.385750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:33.386363 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:33.389790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:33.389790 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:33.389790 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updating existing volume attachment record: d17d1a06-712c-497d-86f7-1c14f00ba0ba {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:08:33.395518 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:33.399657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.399814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.400510 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=49790MB free_disk=73.69989395141602GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:08:33.400683 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:33.497675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: f2a4a001-7934-403f-9b26-6b4ed727e22f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:33.500389 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.567s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:33.525786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.126s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.526684 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.550526 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:33.597209 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk 1073741824" returned: 0 in 0.070s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.598910 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:33.598910 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.634242 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:33.672997 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:33.688641 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:33.710784 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.711462 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:08:33.712023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:33.782853 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:33.818356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:33.819344 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Cannot resize image /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:08:33.820079 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:08:33.820180 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Ensure instance console log exists: /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:08:33.823525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:33.823525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:33.823525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:33.882671 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:34.133538 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:34.147657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.490s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:34.150421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.748s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:34.152528 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:08:34.163068 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:34.304866 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: 52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:34.372182 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:34.372966 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-52e90d26-f0a7-4397-8a28-8ba0e675e834. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:34.373198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:34.567524 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:34.577147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:34.577416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:34.577915 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Attaching volume c01f90fd-b743-41cd-9ae4-83f24a30f643 to /dev/vdb
Jun 27 04:08:34.650603 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:34.660477 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:08:34.660926 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:08:34.661290 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:34.661402 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:34.675703 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-acbaad8e-463a-4391-af0c-0f566dcb741e req-679b69f4-94be-4706-8014-be587a9be3cb service nova] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:34.675970 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:34.677145 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:34.686510 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:34.719417 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Booting with volume 04a389a8-7635-4963-8971-7d4f4426c643 at /dev/vdc
Jun 27 04:08:34.728746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:34.781764 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:34.783470 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:34.800578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:34.802324 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:febf:b94c', 'fe80::ec39:ecff:fe58:15d3', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fe42:dc7f', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1'] 
Jun 27 04:08:34.802594 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:34.802594 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:34.806529 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:34.806529 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Updating existing volume attachment record: c9c4fb40-dae4-4807-b130-a37710fe5611 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:08:34.865945 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:34.881707 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a996571fb63c4c6e993f1fa02549a086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469d72ff5a3640dbb2193b8a91deeac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:08:34.891695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:34.925642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:34.984927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:34.986778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:35.000526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:35.000526 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:febf:b94c', 'fe80::ec39:ecff:fe58:15d3', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fe42:dc7f', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1'] 
Jun 27 04:08:35.000526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:35.000526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:35.001257 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:35.001872 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating existing volume attachment record: 6fcf7a71-4a85-47ef-b3e2-bd7a0f9f8bab {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:08:35.067690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-621fe593-5a02-4993-b9c6-f818078215ef req-511e6275-70b9-45c1-b2f3-ed9679e684f5 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:35.070074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:35.070372 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port 52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:35.213514 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:08:35.312980 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 99670311-67bb-4d60-b854-655dc01f2722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.313469 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.313469 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.313469 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.314182 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.314720 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 556b87cb-fbf9-4b7c-84c4-40f49005eb25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.317394 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.317394 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 14cba585-a366-4fd8-81c6-71235e708858 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.318174 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.318324 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6897732e-ea7e-4359-802b-42ded626f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.318608 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d020229-688f-487c-8458-d1f3cd69257b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.318725 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 30950d61-f1cd-4a81-ae4e-cce3af742f8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:08:35.318991 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:08:35.319164 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2880MB phys_disk=95GB used_disk=8GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:08:33 up 31 min,  2 users,  load average: 11.85, 8.19, 4.00\n', 'num_instances': '12', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_4b76ce35cec84d189228639d70c6be45': '2', 'io_workload': '3', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '5', 'num_proj_68fa5127b52042afb5b60ff945958fe1': '1', 'num_task_rebuild_block_device_mapping': '1', 'num_proj_85de4b575a314a0fa4c6352eaf5b1753': '1', 'num_proj_f5e9d0be58e546fc9c6986b88628c189': '1', 'num_vm_building': '3', 'num_task_block_device_mapping': '1', 'num_proj_5550c68573fa4ae7b3b9553209bb7625': '1', 'num_task_spawning': '1', 'num_proj_469d72ff5a3640dbb2193b8a91deeac0': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:08:35.333780 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:35.411970 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:35.411970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:35.411970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:35.412777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:35.412777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:35.431993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:35.433538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:35.438717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:35.439240 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:35.439468 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:35.439718 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:35.453968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:35.453968 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:35.464542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:35.464542 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643] added
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:35.473436 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:35.473787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:35.473787 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:35.473934 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643] added
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:35.479337 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:35.574312 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:35.608273 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Creating image(s)
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Ensure instance console log exists: /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:35.611384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Start _get_guest_xml network_info=[{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-27T04:01:43Z,direct_url=<?>,disk_format='qcow2',id=45a2fcb3-a65c-47e5-9cfb-4f177d29598e,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-27T04:01:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'd17d1a06-712c-497d-86f7-1c14f00ba0ba', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '556b87cb-fbf9-4b7c-84c4-40f49005eb25', 'attached_at': '', 'detached_at': '', 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'serial': '55d1eb6f-568d-4401-aa61-08e54f222bc2'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:35.619674 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jun 27 04:08:35.621318 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='45a2fcb3-a65c-47e5-9cfb-4f177d29598e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-980582709', uuid='556b87cb-fbf9-4b7c-84c4-40f49005eb25'), owner=OwnerMeta(userid='eab22bac1a364b3988558ae38ed50d34', username='tempest-ServerActionsV293TestJSON-165019121-project-member', projectid='85de4b575a314a0fa4c6352eaf5b1753', projectname='tempest-ServerActionsV293TestJSON-165019121'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533315.6203232) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:35.626041 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:35.626041 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:35.634030 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:35.634662 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:35.635678 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:35.636231 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-27T04:01:43Z,direct_url=<?>,disk_format='qcow2',id=45a2fcb3-a65c-47e5-9cfb-4f177d29598e,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-06-27T04:01:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:35.636432 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:35.637453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:35.637453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:35.637453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:35.637453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:35.637453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:35.637453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:35.638140 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:35.638140 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:35.638140 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:35.638140 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lazy-loading 'vcpu_model' on Instance uuid 556b87cb-fbf9-4b7c-84c4-40f49005eb25 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:35.649070 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:35.710053 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:35.728228 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:08:35.772704 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Successfully created port: 50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:08:35.828706 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: 23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:35.921258 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:35.923486 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-23658b37-4049-4577-9e1f-487c0e385129. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:35.925728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:35.927532 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:35.967368 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:36.181536 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:36.186060 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:36.186273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:36.355265 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:36.355728 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:36.433984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:36.434483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance network_info: |[{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:08:36.437771 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Start _get_guest_xml network_info=[{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:36.440055 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:36.441429 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='6d020229-688f-487c-8458-d1f3cd69257b'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533316.4408944) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:36.442441 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0025680979999833653 future=<Future at 0x7ec5183d1b80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:36.442441 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:36.442441 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.1087786539999342 future=<Future at 0x7ec51838a330 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:36.442899 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.108541237000054 future=<Future at 0x7ec51838a330 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:36.443433 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:36.446176 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] Emitting event <LifecycleEvent: 1782533301.4391334, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:36.446176 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Stopped (Lifecycle Event)
Jun 27 04:08:36.450941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:36.452144 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:36.461396 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:36.461620 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:36.462796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:36.463181 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:36.463389 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:36.467302 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:36.467479 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:36.468094 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:36.468094 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:36.468918 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:36.468918 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:36.469031 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:36.469169 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:36.469820 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:36.487391 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f347cfd0-d824-43bb-a40b-c4754177be53 req-3594b620-0ce7-4478-a6b4-519eb81e24fd service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:36.488878 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:36.490482 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:36.491183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:36.491435 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port 23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:36.502324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=26,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-kpbrjr46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=6d020229-688f-487c-8458-d1f3cd69257b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:08:36.502674 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:36.503811 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:36.506056 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:36.512984 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.517283 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:36.521733 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.532117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.548517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.555814 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.559899 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.568900 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.569325 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:36.616714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.40.100,3260]
Jun 27 04:08:36.616714 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:36.616714 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.623572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.50.100,3260]
Jun 27 04:08:36.623572 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:36.623572 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.633614 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.641947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.657131 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:36.658105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:36.658323 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:36.659356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] HCTL ('7', '-', '-', 0) found on session 47 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:36.659505 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.670670 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.232s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:36.671205 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:36.672346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] HCTL ('8', '-', '-', 0) found on session 48 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:36.672510 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:36.694653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Searching for a device in session 47 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:36.694653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:36.701599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Searching for a device in session 48 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:36.750681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:08:36.751395 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:08:36.752124 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Creating image(s)
Jun 27 04:08:36.752703 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:36.753040 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:36.754092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:36.754987 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:36.761006 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:36.762725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:36.808060 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Successfully updated port: 50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:36.861048 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:36.888352 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.125s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:36.888919 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:36.889786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:36.892436 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:36.901148 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:08:36.901638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:36.952122 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:37.005566 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <uuid>6d020229-688f-487c-8458-d1f3cd69257b</uuid>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <name>instance-0000001a</name>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:name>multiattach-server-1</nova:name>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:36</nova:creationTime>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         <nova:port uuid="dad80f04-574e-4c16-a005-e27d4fd01f73">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <entry name="serial">6d020229-688f-487c-8458-d1f3cd69257b</entry>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <entry name="uuid">6d020229-688f-487c-8458-d1f3cd69257b</entry>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:04:7e:18"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <target dev="tapdad80f04-57"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/console.log" append="off"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:08:37.011747 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Preparing to wait for external event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=26,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-kpbrjr46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=6d020229-688f-487c-8458-d1f3cd69257b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:37.017217 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:08:37.018316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:37.018537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3013968a-5d90-5cbf-aa0c-2a1efde84a3a', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:37.020391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:37.023103 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.121s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:37.023826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:37.024667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:37.048406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:37.049574 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdad80f04-57, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:37.051313 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdad80f04-57, col_values=(('qos', UUID('ea5b6ac3-822f-4b75-93c5-ca63749d05b2')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:37.051625 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdad80f04-57, col_values=(('external_ids', {'iface-id': 'dad80f04-574e-4c16-a005-e27d4fd01f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:7e:18', 'vm-uuid': '6d020229-688f-487c-8458-d1f3cd69257b'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:37.056667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:37.063513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:37.066716 np0000003830 nova-compute[98984]: INFO os_vif [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57')
Jun 27 04:08:37.095169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk 1073741824" returned: 0 in 0.071s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:37.095710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:37.096175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:37.140562 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:37.202263 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:08:37.203771 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:08:37.204443 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:37.204900 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Creating image(s)
Jun 27 04:08:37.205220 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:08:37.205388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Ensure instance console log exists: /opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:08:37.205862 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:08:37.206095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:37.206390 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:37.206650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:37.206835 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:37.275313 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: 40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:37.313796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:37.314003 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:37.314251 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:37.319149 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:37.321235 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Cannot resize image /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:08:37.321235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:08:37.321712 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Ensure instance console log exists: /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:08:37.321806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:37.322630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:37.323111 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:37.363671 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:37.364234 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-40af7eec-8fb8-464e-85a4-12ed12c5f6f0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:37.364692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:37.369122 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:37.373477 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:08:37.373774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.225s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:37.374106 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:08:37.702678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Searching for a device in session 48 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:37.703068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:37.872934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14ed8099-442e-45ad-9f40-62ac3152bbef req-89aa8092-8f48-4dd2-9b3b-0bbbd551e7f0 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:37.876406 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:37.876406 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port 40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:37.932597 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:38.045008 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:38.046045 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing instance network info cache due to event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:38.046045 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:38.160838 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:38.353208 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:38.378227 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:38.457864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Found WWN 3300000007b8d81c9 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:38.458346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:38.460240 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.273s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:38.460652 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '3300000007b8d81c9', 'path': '/dev/dm-0', 'multipath_id': '3300000007b8d81c9'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:38.460872 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007b8d81c9', 'path': '/dev/dm-0', 'multipath_id': '3300000007b8d81c9'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:38.461858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:38.464360 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:38.470867 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lazy-loading 'flavor' on Instance uuid 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:38.475933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:38.476423 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:38.476730 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:38.477537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:38.479076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:38.479076 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:38.492338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:38.492338 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:38.503285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:38.503285 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2] added
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:38.513067 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:38.513307 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:38.513627 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:38.513844 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2] added
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:38.531930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:38.532236 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0532(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:38.532236 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:38.534335 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:38.611250 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:38.612792 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:38.612792 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:04:7e:18, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:38.615826 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Using config drive
Jun 27 04:08:38.690019 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: 1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:38.719815 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:38.855960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:38.856224 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance network_info: |[{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:08:38.857942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:38.857942 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:38.859622 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Start _get_guest_xml network_info=[{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:38.864473 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:38.865875 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1132427580', uuid='30950d61-f1cd-4a81-ae4e-cce3af742f8e'), owner=OwnerMeta(userid='a996571fb63c4c6e993f1fa02549a086', username='tempest-AttachVolumeShelveTestJSON-1443827218-project-member', projectid='469d72ff5a3640dbb2193b8a91deeac0', projectname='tempest-AttachVolumeShelveTestJSON-1443827218'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533318.8654444) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:38.867166 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:38.867590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:38.868892 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:38.869092 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:38.870018 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:38.870328 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:38.870669 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:38.870669 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:38.870870 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:38.870932 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:38.871083 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:38.871393 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:38.871393 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:38.871472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:38.872546 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:38.872674 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:38.890623 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1132427580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-1132427580',id=27,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVt9g2d513AIYOYb6LiuPwYG6oX3C2oII3ItZ1PJ/n4MUe6a9MCUTqu9xNI2D3kplYH65gknH7G2IWBZOJr0bvELLDtyzp1751z25UlKgeFCB7JOkLCEZ2zV42L7VVOJg==',key_name='tempest-keypair-46950425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-lmts48ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=30950d61-f1cd-4a81-ae4e-cce3af742f8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:08:38.891307 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:38.891718 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:38.892521 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'pci_devices' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:38.974452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Attempting to attach volume c01f90fd-b743-41cd-9ae4-83f24a30f643 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]:   <alias name="ua-c01f90fd-b743-41cd-9ae4-83f24a30f643"/>
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]:   <serial>c01f90fd-b743-41cd-9ae4-83f24a30f643</serial>
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:38.976488 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:08:39.129295 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:39.135862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.224434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1bfe4b34-259d-4ff9-bd76-65dbc1690302 req-2cd2aded-b214-42b9-804c-94a98c9114d0 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:39.312559 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Creating config drive at /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config
Jun 27 04:08:39.318720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa8k5u3ty {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:39.364410 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:39.374364 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:39.374981 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:39.375367 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:39.375748 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:08:39.375931 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:08:39.376217 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.45 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:08:39.381776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa8k5u3ty" returned: 0 in 0.063s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <uuid>30950d61-f1cd-4a81-ae4e-cce3af742f8e</uuid>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <name>instance-0000001b</name>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1132427580</nova:name>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:38</nova:creationTime>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:user uuid="a996571fb63c4c6e993f1fa02549a086">tempest-AttachVolumeShelveTestJSON-1443827218-project-member</nova:user>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:project uuid="469d72ff5a3640dbb2193b8a91deeac0">tempest-AttachVolumeShelveTestJSON-1443827218</nova:project>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         <nova:port uuid="50c70b8e-7688-43e8-a450-c35d577448e4">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <entry name="serial">30950d61-f1cd-4a81-ae4e-cce3af742f8e</entry>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <entry name="uuid">30950d61-f1cd-4a81-ae4e-cce3af742f8e</entry>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:4d:51:28"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <target dev="tap50c70b8e-76"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/console.log" append="off"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Preparing to wait for external event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:08:39.397522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:39.403187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:39.403187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:39.403187 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1132427580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-1132427580',id=27,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVt9g2d513AIYOYb6LiuPwYG6oX3C2oII3ItZ1PJ/n4MUe6a9MCUTqu9xNI2D3kplYH65gknH7G2IWBZOJr0bvELLDtyzp1751z25UlKgeFCB7JOkLCEZ2zV42L7VVOJg==',key_name='tempest-keypair-46950425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-lmts48ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=30950d61-f1cd-4a81-ae4e-cce3af742f8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:08:39.403187 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:39.405583 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:39.405583 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:08:39.406547 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.406963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:39.407306 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:08:39.408768 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.409096 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac50d22c-2389-573f-9dcd-526b951301c0', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:39.412198 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:39.419065 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.429525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.429525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c70b8e-76, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:39.429525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50c70b8e-76, col_values=(('qos', UUID('4be9a6e7-926e-4f28-b591-efb9e2478961')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:39.429525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50c70b8e-76, col_values=(('external_ids', {'iface-id': '50c70b8e-7688-43e8-a450-c35d577448e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:51:28', 'vm-uuid': '30950d61-f1cd-4a81-ae4e-cce3af742f8e'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:39.430511 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.433375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:39.445422 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.447072 np0000003830 nova-compute[98984]: INFO os_vif [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76')
Jun 27 04:08:39.514340 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:39.532934 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.535691 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:39.549517 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.556236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.568327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.583597 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.584730 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.598167 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:39.625184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260]
Jun 27 04:08:39.625184 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:39.625184 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.642189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.658908 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260]
Jun 27 04:08:39.658908 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:39.658908 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:39.666828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:39.668471 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] HCTL ('11', '-', '-', 0) found on session 49 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:39.668645 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:39.677930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:39.692598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 49 and hctl ['11', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.703713 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:39.704161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:39.704447 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:39.704447 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:39.705548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] HCTL ('12', '-', '-', 0) found on session 50 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:39.705671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:39.727310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 50 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:39.832941 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:39.925410 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: 5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:39.934203 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:39.985389 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:40.089003 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updated VIF entry in instance network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:40.089543 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:40.106993 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:40.145067 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:40.145548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-1f4f675d-527d-4e2e-8610-0652a7a5f7c5. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:40.145816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:40.146042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:40.146265 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port 1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:40.199019 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:40.213807 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:40.228524 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b6eaf8dd-a7a4-469f-a188-f272e60fb5b6 req-c7c48525-14c4-4733-8c3c-3931c793cb55 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:40.228993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b6eaf8dd-a7a4-469f-a188-f272e60fb5b6 req-c7c48525-14c4-4733-8c3c-3931c793cb55 service nova] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:40.229367 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b6eaf8dd-a7a4-469f-a188-f272e60fb5b6 req-c7c48525-14c4-4733-8c3c-3931c793cb55 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:40.229633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b6eaf8dd-a7a4-469f-a188-f272e60fb5b6 req-c7c48525-14c4-4733-8c3c-3931c793cb55 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:40.229835 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b6eaf8dd-a7a4-469f-a188-f272e60fb5b6 req-c7c48525-14c4-4733-8c3c-3931c793cb55 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Processing event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:08:40.593814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40be39ee-8563-4484-9a13-6e5171b1a8f9 req-5e1432bc-ea44-4625-a86b-1a39fd47262c service nova] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:40.652516 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:40.669069 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:40.669069 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:40.669174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:40.669279 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] No VIF found with MAC fa:16:3e:bf:b9:4c, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:40.691724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 49 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:40.691923 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:40.729263 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Searching for a device in session 50 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:40.729921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:40.765485 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:40.960788 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:40.975259 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:40.975432 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:40.975473 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No VIF found with MAC fa:16:3e:4d:51:28, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:40.975984 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Using config drive
Jun 27 04:08:41.085913 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:08:41.086367 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533321.0859814, 6d020229-688f-487c-8458-d1f3cd69257b => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:41.086585 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Started (Lifecycle Event)
Jun 27 04:08:41.089733 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:08:41.092050 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance spawned successfully.
Jun 27 04:08:41.092514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:08:41.173954 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Successfully updated port: 3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:08:41.242894 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:41.243068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-3a72cb59-aa80-44f8-99ff-89dfb60ab399. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:41.243909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:41.463721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:41.463916 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:41.464176 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-5029793a-13f5-48f3-8d7a-a8076718daaa. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:41.466948 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:41.467399 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:41.468679 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port 3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:41.481763 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:41.486593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:08:41.589214 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:41.591319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:41.599515 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:41.599660 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:41.600201 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:41.600454 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:41.600800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:41.601079 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:41.645239 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Creating config drive at /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config
Jun 27 04:08:41.652454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzoa1217z {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:41.682693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:41.719214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzoa1217z" returned: 0 in 0.067s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:41.970781 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:42.065914 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:42.093856 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:08:42.094480 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533322.0940552, 6d020229-688f-487c-8458-d1f3cd69257b => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:42.094773 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Paused (Lifecycle Event)
Jun 27 04:08:42.108403 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Took 8.89 seconds to spawn the instance on the hypervisor.
Jun 27 04:08:42.108403 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:42.228773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.244017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b9692011-e26c-40e3-93e8-fcaeef8b5edf tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.667s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:42.263892 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.269738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.305920 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:42.332622 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19013f4b-d998-4b0f-ad6a-ef64f70eb947 req-aabbd5da-eb96-4e7e-90ea-6f7d624e3806 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:42.334644 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19013f4b-d998-4b0f-ad6a-ef64f70eb947 req-aabbd5da-eb96-4e7e-90ea-6f7d624e3806 service nova] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:42.334925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19013f4b-d998-4b0f-ad6a-ef64f70eb947 req-aabbd5da-eb96-4e7e-90ea-6f7d624e3806 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:42.335285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19013f4b-d998-4b0f-ad6a-ef64f70eb947 req-aabbd5da-eb96-4e7e-90ea-6f7d624e3806 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:42.335285 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19013f4b-d998-4b0f-ad6a-ef64f70eb947 req-aabbd5da-eb96-4e7e-90ea-6f7d624e3806 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] No waiting events found dispatching network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:42.335451 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-19013f4b-d998-4b0f-ad6a-ef64f70eb947 req-aabbd5da-eb96-4e7e-90ea-6f7d624e3806 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received unexpected event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 for instance with vm_state active and task_state None.
Jun 27 04:08:42.394420 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.484881 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event volume-extended-c01f90fd-b743-41cd-9ae4-83f24a30f643 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:42.512305 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Found WWN 3300000007b684c46 for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:42.513010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.054s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:42.513261 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== connect_volume: return (6326ms) {'type': 'block', 'scsi_wwn': '3300000007b684c46', 'path': '/dev/dm-2', 'multipath_id': '3300000007b684c46'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:42.514559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007b684c46', 'path': '/dev/dm-2', 'multipath_id': '3300000007b684c46'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:42.599337 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:42.604418 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533322.6026115, 6d020229-688f-487c-8458-d1f3cd69257b => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:42.604418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Resumed (Lifecycle Event)
Jun 27 04:08:42.625525 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Took 21.40 seconds to build instance.
Jun 27 04:08:42.667396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.670907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.673619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.675052 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.710233 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:42.809595 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d9f8a2e6-0719-4844-a63e-74c5afa19371 req-71e24101-1411-4374-8bea-be4428e0a918 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:42.810242 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:42.810539 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port 5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:42.986701 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Handling volume-extended event for volume c01f90fd-b743-41cd-9ae4-83f24a30f643 {{(pid=98984) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
Jun 27 04:08:43.023943 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-980582709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionsv293testjson-server-844248708',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuyiudFpREd/ABd9CQTPRBpKOMLvejaZPuRMCxP5zbNlnC7ydBW46wKbUDuAckdqgdn6b/On7/IwzxCCgukLifogPI5AHYn/D4u7jX134iPu48395wkEHLPrVpode/uhA==',key_name='tempest-keypair-1481687516',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:38Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85de4b575a314a0fa4c6352eaf5b1753',ramdisk_id='',reservation_id='r-cesx1l83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-165019121',owner_user_name='tempest-ServerActionsV293TestJSON-165019121-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eab22bac1a364b3988558ae38ed50d34',uuid=556b87cb-fbf9-4b7c-84c4-40f49005eb25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:08:43.024253 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converting VIF {"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:43.024852 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <uuid>556b87cb-fbf9-4b7c-84c4-40f49005eb25</uuid>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <name>instance-00000015</name>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsV293TestJSON-server-980582709</nova:name>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:35</nova:creationTime>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:image uuid="45a2fcb3-a65c-47e5-9cfb-4f177d29598e">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:user uuid="eab22bac1a364b3988558ae38ed50d34">tempest-ServerActionsV293TestJSON-165019121-project-member</nova:user>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:project uuid="85de4b575a314a0fa4c6352eaf5b1753">tempest-ServerActionsV293TestJSON-165019121</nova:project>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid="45a2fcb3-a65c-47e5-9cfb-4f177d29598e"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         <nova:port uuid="a7ab7cfb-650d-42d5-8cd4-a1aa1b943950">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <entry name="serial">556b87cb-fbf9-4b7c-84c4-40f49005eb25</entry>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <entry name="uuid">556b87cb-fbf9-4b7c-84c4-40f49005eb25</entry>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <alias name="ua-55d1eb6f-568d-4401-aa61-08e54f222bc2"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <serial>55d1eb6f-568d-4401-aa61-08e54f222bc2</serial>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fc:04:d5"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <target dev="tapa7ab7cfb-65"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/console.log" append="off"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:08:43.032067 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:08:43.034055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-980582709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionsv293testjson-server-844248708',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuyiudFpREd/ABd9CQTPRBpKOMLvejaZPuRMCxP5zbNlnC7ydBW46wKbUDuAckdqgdn6b/On7/IwzxCCgukLifogPI5AHYn/D4u7jX134iPu48395wkEHLPrVpode/uhA==',key_name='tempest-keypair-1481687516',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:38Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85de4b575a314a0fa4c6352eaf5b1753',ramdisk_id='',reservation_id='r-cesx1l83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-165019121',owner_user_name='tempest-ServerActionsV293TestJSON-165019121-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eab22bac1a364b3988558ae38ed50d34',uuid=556b87cb-fbf9-4b7c-84c4-40f49005eb25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:08:43.034055 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converting VIF {"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:43.034295 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:43.034528 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:08:43.036964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.037661 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:43.039624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:08:43.041016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.041280 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5065fb6-18e8-567b-b5c2-30f7911a80a9', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:43.044832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.045592 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:43.048921 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.052164 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.052435 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7ab7cfb-65, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:43.053021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7ab7cfb-65, col_values=(('qos', UUID('bbc84641-db54-4dbc-be41-3726c4855cc9')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:43.054171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7ab7cfb-65, col_values=(('external_ids', {'iface-id': 'a7ab7cfb-650d-42d5-8cd4-a1aa1b943950', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:04:d5', 'vm-uuid': '556b87cb-fbf9-4b7c-84c4-40f49005eb25'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:43.055891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.058705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:43.062446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:43.063896 np0000003830 nova-compute[98984]: INFO os_vif [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65')
Jun 27 04:08:43.107729 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:43.111661 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:43.128852 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fcb105e1-a6c6-4431-8f49-5e6344323b0b tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.907s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:43.317884 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:43.437407 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:43.491169 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Cinder extended volume c01f90fd-b743-41cd-9ae4-83f24a30f643; extending it to detect new size
Jun 27 04:08:43.615938 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533323.615573, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:43.616263 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Started (Lifecycle Event)
Jun 27 04:08:43.659889 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:44.035762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] calling os-brick to extend iSCSI Volume {{(pid=98984) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
Jun 27 04:08:44.036358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}), 'kwargs': {}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:44.036358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:44.036776 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:44.037176 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}
Jun 27 04:08:44.037176 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Multipath discovery for iSCSI enabled
Jun 27 04:08:44.037176 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0']
Jun 27 04:08:44.037379 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0'] {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
Jun 27 04:08:44.057247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0'] {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
Jun 27 04:08:44.057539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Running cmd (subprocess): lsscsi {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:44.106292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] CMD "lsscsi" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:44.106418 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98984) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
Jun 27 04:08:44.107614 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', 'host': '7', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
Jun 27 04:08:44.118448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Starting size: 1073741824 {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
Jun 27 04:08:44.121676 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:44.124033 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533324.1231706, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:44.124033 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Paused (Lifecycle Event)
Jun 27 04:08:44.142202 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:44.162812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab3b79da-439d-4615-a134-c3428c437f8c req-c6604685-c354-4d1f-bd07-3c92633b1892 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:44.164637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] volume size after scsi device rescan 2147483648 {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
Jun 27 04:08:44.164637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:44.164637 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:08:44.169669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Running cmd (subprocess): lsscsi {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:44.225814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] CMD "lsscsi" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:44.226325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98984) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
Jun 27 04:08:44.226489 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643-lun-0', 'host': '8', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
Jun 27 04:08:44.236707 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Starting size: 1073741824 {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
Jun 27 04:08:44.273942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] volume size after scsi device rescan 2147483648 {{(pid=98984) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
Jun 27 04:08:44.288807 np0000003830 nova-compute[98984]: INFO os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Find Multipath device file for volume WWN 3300000007b8d81c9
Jun 27 04:08:44.289170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-3300000007b8d81c9 exists yet. {{(pid=98984) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
Jun 27 04:08:44.289320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] /dev/disk/by-id/dm-uuid-mpath-3300000007b8d81c9 has shown up. {{(pid=98984) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
Jun 27 04:08:44.318986 np0000003830 nova-compute[98984]: INFO os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000007b8d81c9) current size 1073741824
Jun 27 04:08:44.406810 np0000003830 nova-compute[98984]: INFO os_brick.initiator.linuxscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000007b8d81c9) new size 2147483648
Jun 27 04:08:44.407301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.371s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:44.407572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] <== extend_volume: return (370ms) 2147483648 {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:44.407814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Extend iSCSI Volume: new_size=2147483648 {{(pid=98984) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
Jun 27 04:08:44.411957 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [req-3289f065-41e8-4527-ae30-1321bc786c77 req-7b11755e-b9ac-4502-b31a-a53043819d29 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Resizing target device /dev/dm-0 to 2147483648 {{(pid=98984) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2935}}
Jun 27 04:08:44.442685 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:44.442955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:44.445790 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Processing event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] No waiting events found dispatching network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:44.447989 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d504f57d-7c46-4bdc-94de-a3e26ccde9ff req-766667ba-a6af-459b-af8d-64eed4b887c2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received unexpected event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 for instance with vm_state building and task_state spawning.
Jun 27 04:08:44.448761 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:08:44.455983 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:08:44.458844 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance spawned successfully.
Jun 27 04:08:44.459580 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:08:44.583640 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-changed-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:44.584422 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing instance network info cache due to event network-changed-5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:44.584619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:44.584718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:44.584866 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:44.612514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:44.612745 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:44.612913 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] No VIF found with MAC fa:16:3e:fc:04:d5, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:44.613594 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Using config drive
Jun 27 04:08:44.628123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:44.632356 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533324.6320012, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:44.632593 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Resumed (Lifecycle Event)
Jun 27 04:08:44.759596 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:08:44.949868 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:44.971948 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:44.972266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:44.972667 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:44.973025 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:44.974434 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:44.977057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:45.094457 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:45.122596 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lazy-loading 'ec2_ids' on Instance uuid 556b87cb-fbf9-4b7c-84c4-40f49005eb25 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:45.138219 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:45.142116 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:45.435007 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:45.486049 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Took 8.74 seconds to spawn the instance on the hypervisor.
Jun 27 04:08:45.486227 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:45.565362 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:45.580125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:45.580125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:45.635480 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Object Instance<556b87cb-fbf9-4b7c-84c4-40f49005eb25> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:45.635711 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lazy-loading 'keypairs' on Instance uuid 556b87cb-fbf9-4b7c-84c4-40f49005eb25 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:45.669821 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:08:45.777704 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updated VIF entry in instance network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:45.780478 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:45.896933 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:46.006879 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Took 17.99 seconds to build instance.
Jun 27 04:08:46.075999 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Detaching volume c01f90fd-b743-41cd-9ae4-83f24a30f643
Jun 27 04:08:46.122538 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Attempting to driver detach volume c01f90fd-b743-41cd-9ae4-83f24a30f643 from mountpoint /dev/vdb
Jun 27 04:08:46.138198 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Found disk vdb by alias ua-c01f90fd-b743-41cd-9ae4-83f24a30f643 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:08:46.139636 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Object Instance<556b87cb-fbf9-4b7c-84c4-40f49005eb25> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:08:46.142754 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
Jun 27 04:08:46.146923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Found disk vdb by alias ua-c01f90fd-b743-41cd-9ae4-83f24a30f643 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:08:46.149801 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Attempting to detach device vdb from instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:   <alias name="ua-c01f90fd-b743-41cd-9ae4-83f24a30f643"/>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:   <serial>c01f90fd-b743-41cd-9ae4-83f24a30f643</serial>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:46.150137 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:08:46.181564 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Successfully detached device vdb from instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 from the persistent domain config.
Jun 27 04:08:46.181799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] (1/8): Attempting to detach device vdb with device alias ua-c01f90fd-b743-41cd-9ae4-83f24a30f643 from instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:   <alias name="ua-c01f90fd-b743-41cd-9ae4-83f24a30f643"/>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:   <serial>c01f90fd-b743-41cd-9ae4-83f24a30f643</serial>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:46.182150 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:08:46.283117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2961fbaa-5983-4eec-9a81-8d41491ec577 req-118b07c6-3294-47a1-9e40-5c9df198c1b2 service nova] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:46.336035 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:46.336035 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Creating config drive at /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config
Jun 27 04:08:46.361791 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo_o5g7gv {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:46.417771 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo_o5g7gv" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:08:46.510438 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.500s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:46.710437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:46.710437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing instance network info cache due to event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:46.710437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:46.710437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:46.710437 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:46.721834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:46.722061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:46.814941 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:46.899264 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533326.8987653, 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 => ua-c01f90fd-b743-41cd-9ae4-83f24a30f643> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:08:46.903670 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c01f90fd-b743-41cd-9ae4-83f24a30f643 for instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:08:46.906752 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Successfully detached device vdb from instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 from the live domain config.
Jun 27 04:08:46.911759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:08:46.911759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:46.911759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:46.911759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:46.911759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c01f90fd-b743-41cd-9ae4-83f24a30f643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:08:46.911759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:46.944130 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '50')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:08:46.944717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', '47')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:46.945894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643', '48')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:46.946883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51876d760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:08:46.947105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:08:46.958194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Flush multipath device 3300000007b8d81c9 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:08:46.986264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:47.045438 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:47.056088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.093585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.093585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:08:47.093585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:08:47.096465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:08:47.109324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:08:47.109576 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:08:47.132273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:47.199630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.40.100,3260]
Jun 27 04:08:47.199630 np0000003830 nova-compute[98984]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:47.199630 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:47.212313 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.216711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:47.220589 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:47.225732 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:47.240668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:47.294520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.50.100,3260]
Jun 27 04:08:47.294520 np0000003830 nova-compute[98984]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-c01f90fd-b743-41cd-9ae4-83f24a30f643, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:47.294520 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:47.308516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:47.308777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:47.308912 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] <== disconnect_volume: return (398ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:47.309033 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:08:47.456823 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:47.472981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4bcc9ad0-077e-4b0a-a230-be3e13d2c7d2 req-710cdb08-9850-472c-b68f-42a8582aa4e7 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:47.472981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4bcc9ad0-077e-4b0a-a230-be3e13d2c7d2 req-710cdb08-9850-472c-b68f-42a8582aa4e7 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:47.472981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4bcc9ad0-077e-4b0a-a230-be3e13d2c7d2 req-710cdb08-9850-472c-b68f-42a8582aa4e7 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:47.472981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4bcc9ad0-077e-4b0a-a230-be3e13d2c7d2 req-710cdb08-9850-472c-b68f-42a8582aa4e7 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:47.472981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4bcc9ad0-077e-4b0a-a230-be3e13d2c7d2 req-710cdb08-9850-472c-b68f-42a8582aa4e7 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:47.472981 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4bcc9ad0-077e-4b0a-a230-be3e13d2c7d2 req-710cdb08-9850-472c-b68f-42a8582aa4e7 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state rebuild_spawning.
Jun 27 04:08:47.524573 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.527918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.533827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.572243 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:47.804524 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:47.914733 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lazy-loading 'flavor' on Instance uuid 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:47.996259 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updated VIF entry in instance network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:47.996713 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:48.001516 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:48.056648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:48.208267 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [{"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:48.239636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:48.409883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:48.410069 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing instance network info cache due to event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:08:48.410260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:08:48.410376 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:08:48.410537 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:08:48.440692 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533328.4402204, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:48.440911 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Resumed (Lifecycle Event)
Jun 27 04:08:48.442404 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:08:48.442674 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:08:48.446321 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance spawned successfully.
Jun 27 04:08:48.446836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:08:48.499008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1cd94ae8-2ffa-431e-8f68-b9d0b5cdc1ed req-90b8e4fa-5a7a-4601-a3e2-8fc7f8ae632d service nova] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:48.710843 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:48.711366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance network_info: |[{"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:08:48.719281 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Start _get_guest_xml network_info=[{"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '871b96a1-6bfc-47b3-885d-49cf882d36bd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6897732e-ea7e-4359-802b-42ded626f5b4', 'attached_at': '', 'detached_at': '', 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'serial': '8e678f6e-3918-45c1-b14d-d57981f35cbb'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': 'd3fa67ec-22ed-4435-a341-84b18e2b98d5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6897732e-ea7e-4359-802b-42ded626f5b4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'serial': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '6fcf7a71-4a85-47ef-b3e2-bd7a0f9f8bab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6897732e-ea7e-4359-802b-42ded626f5b4', 'attached_at': '', 'detached_at': '', 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'serial': '04a389a8-7635-4963-8971-7d4f4426c643'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:08:48.719281 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-746171921', uuid='6897732e-ea7e-4359-802b-42ded626f5b4'), owner=OwnerMeta(userid='7aa12f7997774c398f0484c98050ca5e', username='tempest-TaggedBootDevicesTest-1248476091-project-member', projectid='5550c68573fa4ae7b3b9553209bb7625', projectname='tempest-TaggedBootDevicesTest-1248476091'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533328.7156124) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:08:48.719598 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:08:48.719968 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:08:48.719968 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:08:48.719968 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:08:48.720069 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:08:48.720391 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:08:48.720511 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:08:48.720711 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:08:48.720954 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:08:48.720954 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:08:48.721140 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:08:48.730864 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:48.731345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:48.731345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:48.731717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:48.731948 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:48.745722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:48.746244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:48.746480 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:48.755947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:48.756290 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:48.756663 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:48.762748 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:48.762748 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:48.771773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:48.771773 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb] added
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:48.781796 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:48.782177 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:48.782226 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:48.782653 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb] added
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:48.784257 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:48.917414 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:48.923594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d65abcf2-76df-429d-9618-d75efa9b4034 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.350s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:48.945433 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:48.952108 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:48.961173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:48.962612 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:48.962612 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:48.962612 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:48.963726 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:48.964174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:08:49.133722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:49.133927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:49.133982 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:49.134178 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:49.134234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:49.141872 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Terminating instance
Jun 27 04:08:49.143208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:49.432586 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:49.455936 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jun 27 04:08:49.455936 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533329.4556065, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:08:49.455936 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Started (Lifecycle Event)
Jun 27 04:08:49.471481 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:49.536322 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:49.536730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:49.536809 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Attaching volume a574ef50-0fb3-446f-997f-d6a7e94a232e to /dev/vdb
Jun 27 04:08:49.586309 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0c0761c1-b013-4d7b-b32f-a09dafb34ef2 req-af7f2900-151a-4cb1-8f90-79131f259dd9 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:49.586589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0c0761c1-b013-4d7b-b32f-a09dafb34ef2 req-af7f2900-151a-4cb1-8f90-79131f259dd9 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:49.589730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0c0761c1-b013-4d7b-b32f-a09dafb34ef2 req-af7f2900-151a-4cb1-8f90-79131f259dd9 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:49.589730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0c0761c1-b013-4d7b-b32f-a09dafb34ef2 req-af7f2900-151a-4cb1-8f90-79131f259dd9 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:49.589730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0c0761c1-b013-4d7b-b32f-a09dafb34ef2 req-af7f2900-151a-4cb1-8f90-79131f259dd9 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:49.589912 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-0c0761c1-b013-4d7b-b32f-a09dafb34ef2 req-af7f2900-151a-4cb1-8f90-79131f259dd9 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received unexpected event network-vif-plugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with vm_state active and task_state None.
Jun 27 04:08:49.616218 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:49.635888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:08:49.658170 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:08:49.665921 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:08:49.702547 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:49.707437 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:49.725115 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updated VIF entry in instance network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:08:49.727146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:08:49.727146 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:49.728863 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:08:49.739639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:49.742713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:08:49.745764 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::ec39:ecff:fe58:15d3', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fe42:dc7f', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:fe4d:5128', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fefc:4d5', 'fe80::d890:2ff:fe54:ccb4'] 
Jun 27 04:08:49.745764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:08:49.745764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:08:49.745764 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:49.745764 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating existing volume attachment record: af5f72ab-d71e-496f-9427-d5f7494d4946 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:08:49.756986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:49.783279 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:49.786327 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:49.790695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:49.805003 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:49.813267 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.825254 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.837826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.853449 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.863077 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.863584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:49.915465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.40.100,3260]
Jun 27 04:08:49.915465 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:49.915465 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.936083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.942087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.50.100,3260]
Jun 27 04:08:49.942087 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:49.942087 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.958677 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.959144 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:49.959412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:49.959540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:49.959820 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:49.962702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:08:49.965843 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] HCTL ('7', '-', '-', 0) found on session 51 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:49.966042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:49.972255 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:08:49.990735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:49.991441 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:49.992997 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98984) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.996928 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:49.999043 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:50.000076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.243s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:50.000076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:50.003244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] HCTL ('8', '-', '-', 0) found on session 52 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:50.003244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:50.010674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching for a device in session 51 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:50.011256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:50.015879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.028112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.050467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching for a device in session 52 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:50.050467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:50.050467 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Instance destroyed successfully.
Jun 27 04:08:50.050467 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lazy-loading 'resources' on Instance uuid 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:50.154093 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f9f6d62d-821d-4912-ab26-bf8962c1540b req-00d26ec3-812e-464d-b00b-8b851e6da2b7 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-unplugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:50.154093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f9f6d62d-821d-4912-ab26-bf8962c1540b req-00d26ec3-812e-464d-b00b-8b851e6da2b7 service nova] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:50.154093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f9f6d62d-821d-4912-ab26-bf8962c1540b req-00d26ec3-812e-464d-b00b-8b851e6da2b7 service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:50.154093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f9f6d62d-821d-4912-ab26-bf8962c1540b req-00d26ec3-812e-464d-b00b-8b851e6da2b7 service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:50.154093 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f9f6d62d-821d-4912-ab26-bf8962c1540b req-00d26ec3-812e-464d-b00b-8b851e6da2b7 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] No waiting events found dispatching network-vif-unplugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:50.154093 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f9f6d62d-821d-4912-ab26-bf8962c1540b req-00d26ec3-812e-464d-b00b-8b851e6da2b7 service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-unplugged-09b69400-d14a-4b80-a0d5-4e58c2e471af for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:08:50.239898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd4610d2-a04f-4350-bdd8-0b760d587e52 req-0811ee52-361e-4ebf-a656-ff3c069c5e7a service nova] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:08:50.359734 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:50.360141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:50.360312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:50.478525 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999539476000109 future=<Future at 0x7ec518709ac0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:50.479445 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998603537000008 future=<Future at 0x7ec518709ac0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:50.479636 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998381190000146 future=<Future at 0x7ec518709ac0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:50.553569 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-289477347',display_name='tempest-VolumesExtendAttachedTest-instance-289477347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesextendattachedtest-instance-289477347',id=23,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOuAOpPRnqw9imUa7xOgjjK3LVxoSqe5fIAJIv2QF48B1Z4bjDrBHm1XZt8bJzJPSzKqBkufPbzAtej4AOiN8cNu5eO6W/gOh+JCqcUTTGoYYLv0nnRNsd5JC058udffQ==',key_name='tempest-keypair-9453299',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:52Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5e9d0be58e546fc9c6986b88628c189',ramdisk_id='',reservation_id='r-1qbk48dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1697340961',owner_user_name='tempest-VolumesExtendAttachedTest-1697340961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b294bb1532b540cc970b2fe7aea50e6c',uuid=3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:08:50.553994 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Converting VIF {"id": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "address": "fa:16:3e:bf:b9:4c", "network": {"id": "0f00d6dd-b79d-488e-9f26-2155ce7f2b10", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-130660053-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5e9d0be58e546fc9c6986b88628c189", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b69400-d1", "ovs_interfaceid": "09b69400-d14a-4b80-a0d5-4e58c2e471af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:50.555257 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:50.556053 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:08:50.558107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.558430 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09b69400-d1, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:50.561347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.562803 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:50.563976 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.564819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94417e6d-f35b-4e69-a28c-5dd4caf3559d) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:50.566474 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.566474 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:50.570848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:50.573690 np0000003830 nova-compute[98984]: INFO os_vif [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:b9:4c,bridge_name='br-int',has_traffic_filtering=True,id=09b69400-d14a-4b80-a0d5-4e58c2e471af,network=Network(0f00d6dd-b79d-488e-9f26-2155ce7f2b10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b69400-d1')
Jun 27 04:08:50.574162 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Deleting instance files /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709_del
Jun 27 04:08:50.576207 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Deletion of /opt/stack/data/nova/instances/3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709_del complete
Jun 27 04:08:50.752454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:08:51.008455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07056591-b0ac-4037-8696-b53a7fdcfe67 tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.017s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:51.083475 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Took 1.42 seconds to destroy the instance on the hypervisor.
Jun 27 04:08:51.084646 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:08:51.085183 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:08:51.085349 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:08:51.085826 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:51.225258 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:51.774425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Found WWN 330000000c5e5906b for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:51.775059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:51.775059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000c5e5906b', 'path': '/dev/dm-0', 'multipath_id': '330000000c5e5906b'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:51.775205 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5e5906b', 'path': '/dev/dm-0', 'multipath_id': '330000000c5e5906b'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:51.775966 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.416s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:51.776201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:51.799261 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:51.799261 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:51.799775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:51.799999 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:51.801031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:51.801031 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:51.818308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:51.818308 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:51.830318 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:51.830318 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e] added
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:51.838194 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:51.838546 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:51.838716 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0387(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:51.838956 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e] added
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:51.845969 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:51.846316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:51.847405 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:51.847405 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-unplugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] Acquiring lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] No waiting events found dispatching network-vif-unplugged-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-unplugged-09b69400-d14a-4b80-a0d5-4e58c2e471af for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Received event network-vif-deleted-09b69400-d14a-4b80-a0d5-4e58c2e471af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Neutron deleted interface 09b69400-d14a-4b80-a0d5-4e58c2e471af; detaching it from the instance and deleting it from the info cache
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e93cc011-6660-4457-b09f-f0218cd17e22 req-eb8e865d-bbfc-406b-8ab2-c9bc0aa6dc2a service nova] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Detach interface failed, port_id=09b69400-d14a-4b80-a0d5-4e58c2e471af, reason: Instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:52.536482 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:08:52.839461 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:52.848400 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:52.862906 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:52.866640 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:52.885021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:52.893354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.909747 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.919930 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:52.920435 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:52.975016 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Took 1.89 seconds to deallocate network for instance.
Jun 27 04:08:52.983109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.50.100,3260]
Jun 27 04:08:52.983109 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:52.983109 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:52.998945 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:53.022842 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:53.023317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:53.023713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:53.024986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('14', '-', '-', 0) found on session 54 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:53.024986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:53.055914 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 54 and hctl ['14', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:53.487161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:53.487382 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:53.811876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:53.812152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:53.812407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:53.812808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:53.812808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:53.815328 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Terminating instance
Jun 27 04:08:53.973382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.40.100,3260]
Jun 27 04:08:53.973382 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:53.973382 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:53.985879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:54.005675 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:54.006186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.207s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:54.006821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:54.007753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('13', '-', '-', 0) found on session 53 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:54.007897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:54.025306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 53 and hctl ['13', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:54.057788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 54 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:54.057788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:54.146380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.321033 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:08:54.325511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:08:54.325900 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:08:54.356246 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.387738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.618462 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.625046 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.640689 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-709e2c8f-271c-4d31-9c3f-bff2fa81bbfd req-bafff3e1-d5c9-4004-ad25-b2187acca928 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:54.640689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-709e2c8f-271c-4d31-9c3f-bff2fa81bbfd req-bafff3e1-d5c9-4004-ad25-b2187acca928 service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:54.640689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-709e2c8f-271c-4d31-9c3f-bff2fa81bbfd req-bafff3e1-d5c9-4004-ad25-b2187acca928 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:54.640689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-709e2c8f-271c-4d31-9c3f-bff2fa81bbfd req-bafff3e1-d5c9-4004-ad25-b2187acca928 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:54.640689 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-709e2c8f-271c-4d31-9c3f-bff2fa81bbfd req-bafff3e1-d5c9-4004-ad25-b2187acca928 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:54.641219 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-709e2c8f-271c-4d31-9c3f-bff2fa81bbfd req-bafff3e1-d5c9-4004-ad25-b2187acca928 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:08:54.672587 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.684941 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:54.707364 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999602308000021 future=<Future at 0x7ec518353410 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:08:54.713920 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Instance destroyed successfully.
Jun 27 04:08:54.714735 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'resources' on Instance uuid 14cba585-a366-4fd8-81c6-71235e708858 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:54.829618 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:08:55.026216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 53 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:55.026763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:55.223091 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-959397301',display_name='tempest-ServerActionsTestOtherA-server-959397301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-959397301',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-oy0l1vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=14cba585-a366-4fd8-81c6-71235e708858,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:08:55.223378 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "address": "fa:16:3e:42:dc:7f", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f426ebf-0a", "ovs_interfaceid": "7f426ebf-0ad5-42b1-81d5-853a4740a1ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:08:55.223839 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:08:55.224325 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:08:55.226375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:55.226375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f426ebf-0a, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:55.227550 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:55.228671 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:55.229320 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:55.230243 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:55.230423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3110a541-3d71-4490-a8f4-875bd59c1a2c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:08:55.230908 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:55.231449 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:08:55.232062 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:55.234272 np0000003830 nova-compute[98984]: INFO os_vif [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:dc:7f,bridge_name='br-int',has_traffic_filtering=True,id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f426ebf-0a')
Jun 27 04:08:55.235510 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:08:55.235825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:55.235988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:55.345217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.858s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:55.420969 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Deleted allocations for instance 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709
Jun 27 04:08:55.821515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000d9190441 for multipath device dm-13 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:55.821994 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.046s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:55.822149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (5461ms) {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:55.822317 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:55.823529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.539s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:55.824180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:55.826258 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:08:55.839095 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:55.839580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:55.839840 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:55.843760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:55.843760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:55.843760 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:55.853601 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:55.853601 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:55.861873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:55.861873 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424] added
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:55.868415 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:55.868958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:55.868958 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:55.868958 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424] added
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:55.875218 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:55.875414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:55.875597 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:55.875754 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:56.329867 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Attempting to attach volume a574ef50-0fb3-446f-997f-d6a7e94a232e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:   <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-13"/>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:   <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:56.331119 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:08:56.430887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5b0e22a1-d8a2-4498-a5d6-54d0f9779497 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Lock "3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.297s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:56.726704 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-90b13409-acf0-4191-85d6-c2432e644f08 req-0fe621fd-cece-4cea-9cbe-9fe58e257667 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:08:56.730799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-90b13409-acf0-4191-85d6-c2432e644f08 req-0fe621fd-cece-4cea-9cbe-9fe58e257667 service nova] Acquiring lock "14cba585-a366-4fd8-81c6-71235e708858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:56.730799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-90b13409-acf0-4191-85d6-c2432e644f08 req-0fe621fd-cece-4cea-9cbe-9fe58e257667 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:56.730799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-90b13409-acf0-4191-85d6-c2432e644f08 req-0fe621fd-cece-4cea-9cbe-9fe58e257667 service nova] Lock "14cba585-a366-4fd8-81c6-71235e708858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:56.730799 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-90b13409-acf0-4191-85d6-c2432e644f08 req-0fe621fd-cece-4cea-9cbe-9fe58e257667 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] No waiting events found dispatching network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:08:56.731056 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-90b13409-acf0-4191-85d6-c2432e644f08 req-0fe621fd-cece-4cea-9cbe-9fe58e257667 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-unplugged-7f426ebf-0ad5-42b1-81d5-853a4740a1ab for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:08:56.869455 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:56.876262 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:56.885207 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:08:56.895337 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:56.901757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:56.910610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.925408 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.925872 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.931243 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:56.931812 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:56.990944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.40.100,3260]
Jun 27 04:08:56.990944 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:56.990944 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:57.000429 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.50.100,3260]
Jun 27 04:08:57.000429 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:57.000429 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:57.007779 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:57.015307 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.034903 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.035346 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:57.035925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:57.035925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:57.037729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] HCTL ('17', '-', '-', 0) found on session 55 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:57.037848 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.042409 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:57.042967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:57.043795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:08:57.044950 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] HCTL ('18', '-', '-', 0) found on session 56 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:08:57.045024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:08:57.061629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching for a device in session 55 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:57.061629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:57.080967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching for a device in session 56 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:08:57.081187 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:08:57.845456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:08:58.027976 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:58.028130 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:58.028484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:08:58.028484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:56:24:62, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:08:58.721075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:08:58.721075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:08:58.865088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Found WWN 330000000a6c8fcd8 for multipath device dm-14 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:08:58.866763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:58.866763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== connect_volume: return (6582ms) {'type': 'block', 'scsi_wwn': '330000000a6c8fcd8', 'path': '/dev/dm-14', 'multipath_id': '330000000a6c8fcd8'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:58.866763 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a6c8fcd8', 'path': '/dev/dm-14', 'multipath_id': '330000000a6c8fcd8'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:08:58.866919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.631s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:58.867313 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fb269625-f2be-4d1d-97de-7481e591d06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:08:58.867686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:58.916916 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:08:58.917560 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:08:58.917949 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '56')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:08:58.918038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '43')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:58.919215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e', '44')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:08:58.920655 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538139bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:08:58.921709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:08:58.921709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Flush multipath device 3300000006d458d78 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:08:58.977140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:59.029347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:08:59.093046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:08:59.093322 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:08:59.095796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:08:59.109269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:08:59.109269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:08:59.124781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.150107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:08:59.163982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260]
Jun 27 04:08:59.163982 np0000003830 nova-compute[98984]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:08:59.163982 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.188118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.206465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.217843 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Detaching volume 189bc189-e575-4bef-8b1a-102726373c49
Jun 27 04:08:59.251012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260]
Jun 27 04:08:59.251012 np0000003830 nova-compute[98984]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-fb269625-f2be-4d1d-97de-7481e591d06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:08:59.251012 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.279333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.279333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:08:59.279333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] <== disconnect_volume: return (4043ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:08:59.279333 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:08:59.282656 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Deleting instance files /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858_del
Jun 27 04:08:59.283103 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Deletion of /opt/stack/data/nova/instances/14cba585-a366-4fd8-81c6-71235e708858_del complete
Jun 27 04:08:59.287400 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Attempting to driver detach volume 189bc189-e575-4bef-8b1a-102726373c49 from mountpoint /dev/vdb
Jun 27 04:08:59.291280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Found disk vdb by alias ua-189bc189-e575-4bef-8b1a-102726373c49 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:08:59.297366 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Found disk vdb by alias ua-189bc189-e575-4bef-8b1a-102726373c49 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:08:59.297559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Attempting to detach device vdb from instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:   <alias name="ua-189bc189-e575-4bef-8b1a-102726373c49"/>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-11"/>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:   <serial>189bc189-e575-4bef-8b1a-102726373c49</serial>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:59.297831 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:08:59.309780 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Successfully detached device vdb from instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a from the persistent domain config.
Jun 27 04:08:59.309923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] (1/8): Attempting to detach device vdb with device alias ua-189bc189-e575-4bef-8b1a-102726373c49 from instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:   <alias name="ua-189bc189-e575-4bef-8b1a-102726373c49"/>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-11"/>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:   <serial>189bc189-e575-4bef-8b1a-102726373c49</serial>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:08:59.310109 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:08:59.376428 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:08:59.376814 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:59.377382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:59.377806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:59.378260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:08:59.391559 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:59.392533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:08:59.393230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:59.393393 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:08:59.394045 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:08:59.394317 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:08:59.408128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:59.408128 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.414295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:08:59.414295 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643] added
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:59.421821 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.422131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:59.422336 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:59.422552 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643] added
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:08:59.430113 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:08:59.430439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:08:59.431158 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:08:59.431158 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:08:59.614975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7df8dd0d-bbe4-4280-bbae-cb57cd1d6e52 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.078s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:08:59.795880 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Took 5.47 seconds to destroy the instance on the hypervisor.
Jun 27 04:08:59.797574 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:08:59.797780 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:08:59.797852 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:08:59.800330 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:59.863391 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:08:59.948408 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533339.9478068, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => ua-189bc189-e575-4bef-8b1a-102726373c49> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:08:59.952526 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-189bc189-e575-4bef-8b1a-102726373c49 for instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:08:59.965062 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Successfully detached device vdb from instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a from the live domain config.
Jun 27 04:08:59.966675 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:08:59.966964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:08:59.967108 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:00.074825 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:00.076108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:00.234618 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:00.338420 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:00.422983 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:09:00.431215 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:00.440437 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:00.448698 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.455942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.463645 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.482072 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.482478 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.483342 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.483738 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:00.535303 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.40.100,3260]
Jun 27 04:09:00.535303 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.40.100,3260] successful.
Jun 27 04:09:00.535303 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.547459 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.553540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.50.100,3260]
Jun 27 04:09:00.553540 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.50.100,3260] successful.
Jun 27 04:09:00.553540 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.568255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.569360 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:00.570076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:00.570076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:00.571025 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] HCTL ('9', '-', '-', 0) found on session 57 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:00.573090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:00.580833 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.598742 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:00.599069 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:00.599483 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:00.599577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:00.602719 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching for a device in session 57 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:00.602719 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:00.605099 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] HCTL ('10', '-', '-', 0) found on session 58 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:00.605592 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:00.625891 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Searching for a device in session 58 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:00.626174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:01.075827 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c1779fd5-d31e-42c0-bf71-e415dcf3915c req-2fff9ecc-e8cd-4e1e-8050-2126a11549a5 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Received event network-vif-deleted-7f426ebf-0ad5-42b1-81d5-853a4740a1ab {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:01.076280 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-c1779fd5-d31e-42c0-bf71-e415dcf3915c req-2fff9ecc-e8cd-4e1e-8050-2126a11549a5 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Neutron deleted interface 7f426ebf-0ad5-42b1-81d5-853a4740a1ab; detaching it from the instance and deleting it from the info cache
Jun 27 04:09:01.077632 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c1779fd5-d31e-42c0-bf71-e415dcf3915c req-2fff9ecc-e8cd-4e1e-8050-2126a11549a5 service nova] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Detach interface failed, port_id=7f426ebf-0ad5-42b1-81d5-853a4740a1ab, reason: Instance 14cba585-a366-4fd8-81c6-71235e708858 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:09:01.393275 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:09:01.528999 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:01.587840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:02.031074 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Took 2.23 seconds to deallocate network for instance.
Jun 27 04:09:02.409583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Found WWN 3300000007eaf252f for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:09:02.409583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:02.409583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000007eaf252f', 'path': '/dev/dm-1', 'multipath_id': '3300000007eaf252f'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:02.409583 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007eaf252f', 'path': '/dev/dm-1', 'multipath_id': '3300000007eaf252f'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:09:02.410065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.442s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:02.410065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '189bc189-e575-4bef-8b1a-102726373c49', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:09:02.410514 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:02.445683 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:02.446040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '58')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:09:02.446580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '41')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:09:02.447341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49', '42')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:09:02.450567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53841bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'): ({'sdk'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:09:02.450962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Removing multipathed devices sdk, sdj {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:09:02.451024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Flush multipath device 3300000008ef6a92f {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:09:02.500377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:09:02.556695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:09:02.605189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:09:02.605333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:09:02.608171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:09:02.621250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:09:02.621529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:09:02.633822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:02.640201 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Took 0.61 seconds to detach 1 volumes for instance.
Jun 27 04:09:02.642893 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Deleting volume: fb269625-f2be-4d1d-97de-7481e591d06e {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:09:02.681980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.40.100,3260]
Jun 27 04:09:02.681980 np0000003830 nova-compute[98984]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.40.100,3260] successful.
Jun 27 04:09:02.681980 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:02.702458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:02.702990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:02.703209 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Attaching volume a574ef50-0fb3-446f-997f-d6a7e94a232e to /dev/vdb
Jun 27 04:09:02.708468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:02.721887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:02.762721 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.50.100,3260]
Jun 27 04:09:02.762721 np0000003830 nova-compute[98984]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-189bc189-e575-4bef-8b1a-102726373c49, portal: 192.168.50.100,3260] successful.
Jun 27 04:09:02.762721 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:02.767105 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:02.779783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:09:02.790080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:02.790702 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:02.790853 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] <== disconnect_volume: return (2824ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:02.791013 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:09:02.806694 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:02.852254 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:09:02.852713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:09:02.865319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:09:02.880647 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fedc:c554', 'fe80::3051:f5ff:fe55:b674', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fecc:2449', 'fe80::38dc:63ff:fedd:d3e1', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:fe4d:5128', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fefc:4d5', 'fe80::d890:2ff:fe54:ccb4'] 
Jun 27 04:09:02.880647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:09:02.880647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:09:02.880647 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:02.880647 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating existing volume attachment record: ab31a5e3-1258-419e-bd0f-6691f3a59a84 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:09:02.916119 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.916367 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.917072 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.924523 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.924523 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.924523 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.924523 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.924523 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.924523 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.929220 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.929220 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.929220 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.929220 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.929220 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.929220 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:02.929753 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lazy-loading 'pci_devices' on Instance uuid 6897732e-ea7e-4359-802b-42ded626f5b4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:03.137472 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.272093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.272093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.403443 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'flavor' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <uuid>6897732e-ea7e-4359-802b-42ded626f5b4</uuid>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <name>instance-00000019</name>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:name>tempest-device-tagging-server-746171921</nova:name>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:08:48</nova:creationTime>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:user uuid="7aa12f7997774c398f0484c98050ca5e">tempest-TaggedBootDevicesTest-1248476091-project-member</nova:user>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:project uuid="5550c68573fa4ae7b3b9553209bb7625">tempest-TaggedBootDevicesTest-1248476091</nova:project>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="52e90d26-f0a7-4397-8a28-8ba0e675e834">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="23658b37-4049-4577-9e1f-487c0e385129">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="40af7eec-8fb8-464e-85a4-12ed12c5f6f0">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="1f4f675d-527d-4e2e-8610-0652a7a5f7c5">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.1.182" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="5029793a-13f5-48f3-8d7a-a8076718daaa">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         <nova:port uuid="3a72cb59-aa80-44f8-99ff-89dfb60ab399">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <entry name="serial">6897732e-ea7e-4359-802b-42ded626f5b4</entry>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <entry name="uuid">6897732e-ea7e-4359-802b-42ded626f5b4</entry>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4/disk.config"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <alias name="ua-8e678f6e-3918-45c1-b14d-d57981f35cbb"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <serial>8e678f6e-3918-45c1-b14d-d57981f35cbb</serial>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <alias name="ua-c6e6b53c-3278-4d18-a8a0-731ce1afe424"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-14"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <serial>c6e6b53c-3278-4d18-a8a0-731ce1afe424</serial>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <alias name="ua-04a389a8-7635-4963-8971-7d4f4426c643"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="vdc" bus="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <serial>04a389a8-7635-4963-8971-7d4f4426c643</serial>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:be:07:e7"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tapcc7b6e7c-8e"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:7e:0c:31"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tap52e90d26-f0"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:bd:6e:54"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tap23658b37-40"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:79:e5:96"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tap40af7eec-8f"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:bc:40:a2"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tap1f4f675d-52"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:2a:00:39"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tap5029793a-13"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:98:b9:a3"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <target dev="tap3a72cb59-aa"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4/console.log" append="off"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.437520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.441488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Preparing to wait for external event network-vif-plugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.444861 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf2ca1b8-7f24-5e71-8805-ce86606b6b59', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc7b6e7c-8e, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc7b6e7c-8e, col_values=(('qos', UUID('f8de3faf-7827-49b7-95d6-46822f4a35f1')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc7b6e7c-8e, col_values=(('external_ids', {'iface-id': 'cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:07:e7', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.458819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.462434 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.462434 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e')
Jun 27 04:09:03.462434 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.462434 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.462434 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.462434 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.464055 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.464421 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.464760 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.465959 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.466227 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85aaf168-631d-594d-bdc2-e5f87f837ebb', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.467324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.468358 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.477104 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.485778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.485778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e90d26-f0, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.485778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52e90d26-f0, col_values=(('qos', UUID('55c31892-3092-4771-865f-76fb3eabd16d')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.485778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52e90d26-f0, col_values=(('external_ids', {'iface-id': '52e90d26-f0a7-4397-8a28-8ba0e675e834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:0c:31', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.486343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.488005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.489201 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:09:03.490916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:03.490916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:03.490916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:03.490916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:09:03.499597 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.502368 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0')
Jun 27 04:09:03.502368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.502368 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.502368 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.502368 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.502893 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.502918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.503230 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.505354 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.505632 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f7ede7b-85ad-50cb-bb05-ec7649912f46', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.507406 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:03.511140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.511890 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:03.512092 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:09:03.512870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:03.513791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:03.514046 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:09:03.518701 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.524341 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.524657 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23658b37-40, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.525009 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23658b37-40, col_values=(('qos', UUID('19811c3f-0ac3-49ef-a96f-b9103b88da2c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.525298 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23658b37-40, col_values=(('external_ids', {'iface-id': '23658b37-4049-4577-9e1f-487c0e385129', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:6e:54', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.529873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.529873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:03.531402 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:03.540789 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:03.547277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:03.549403 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.550035 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40')
Jun 27 04:09:03.551397 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.553019 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.553019 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.553019 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.553900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:03.554108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.554453 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.554807 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.555980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.556257 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da1f799f-1369-5912-b14b-9f5459504a9c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.557315 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.558244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.571380 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.571825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:03.572153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:03.572153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:03.573291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.574755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('14', '0', '0', 0) found on session 54 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:03.574879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:03.576387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.576387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40af7eec-8f, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.576387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40af7eec-8f, col_values=(('qos', UUID('50ed7219-3e13-4c98-ace2-6fe13b563660')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.576567 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40af7eec-8f, col_values=(('external_ids', {'iface-id': '40af7eec-8fb8-464e-85a4-12ed12c5f6f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:e5:96', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.577898 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:03.580821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.583189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('13', '0', '0', 0) found on session 53 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:03.583320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:03.586393 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 54 and hctl ('14', '0', '0', 0) yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:03.586678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:03.593113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 53 and hctl ('13', '0', '0', 0) yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:03.593788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f')
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.611388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.615459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.616861 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.623412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c4b9598-af45-53e5-8e60-fbbb2b3e3179', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.623412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.623412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.643447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.653121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.653121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f4f675d-52, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.653121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f4f675d-52, col_values=(('qos', UUID('403a83b5-93dd-4d20-ae67-4fb24a709fb7')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.653121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f4f675d-52, col_values=(('external_ids', {'iface-id': '1f4f675d-527d-4e2e-8610-0652a7a5f7c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:40:a2', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.653121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.654271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.678938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.680187 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52')
Jun 27 04:09:03.681106 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.683518 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.683518 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.683518 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.683518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.683518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.683518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.684182 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.684362 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '753c610f-5e0d-5bd4-a8dc-e4fee961b920', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.688580 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.689599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.712690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.715092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.715343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5029793a-13, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.715801 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5029793a-13, col_values=(('qos', UUID('d9878c60-0c8a-4317-bee6-723b6d7efeb8')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.715985 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5029793a-13, col_values=(('external_ids', {'iface-id': '5029793a-13f5-48f3-8d7a-a8076718daaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:00:39', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.718080 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.719860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.754715 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.758122 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13')
Jun 27 04:09:03.758122 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:03.758122 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:03.758122 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:03.758122 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:03.770261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.770261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.770261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:03.770261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.770261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e373e63-ecb9-57c5-8c5d-80b2e3a5c9d5', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.780983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.780983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.805079 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.808064 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.808601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a72cb59-aa, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.808997 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a72cb59-aa, col_values=(('qos', UUID('9509d396-c233-4995-a869-e803081d3421')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.809157 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a72cb59-aa, col_values=(('external_ids', {'iface-id': '3a72cb59-aa80-44f8-99ff-89dfb60ab399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b9:a3', 'vm-uuid': '6897732e-ea7e-4359-802b-42ded626f5b4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:03.810144 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.811577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:03.846178 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:03.847314 np0000003830 nova-compute[98984]: INFO os_vif [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa')
Jun 27 04:09:03.962234 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:03.962296 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:04.160603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:04.421150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1073d087-21de-43e0-84c2-008045581610 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.707s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:04.465412 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:04.517386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:09:04.976298 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.704s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:05.066471 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Deleted allocations for instance 14cba585-a366-4fd8-81c6-71235e708858
Jun 27 04:09:05.379908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:05.380346 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:05.380809 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] No VIF found with MAC fa:16:3e:be:07:e7, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:05.381301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] No VIF found with MAC fa:16:3e:bc:40:a2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:05.381666 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Using config drive
Jun 27 04:09:05.481343 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0028826079999362264 future=<Future at 0x7ec518709ac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:05.481343 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:05.481343 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.225651657000071 future=<Future at 0x7ec518353410 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:05.481343 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.225513211000134 future=<Future at 0x7ec518353410 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:05.482267 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Emitting event <LifecycleEvent: 1782533330.4779472, 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:05.482337 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] VM Stopped (Lifecycle Event)
Jun 27 04:09:05.535042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000d9190441 for multipath device dm-13 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:09:05.535042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:05.535262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (2045ms) {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:05.535637 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:09:05.538099 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:05.840477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:05.840756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:05.840953 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:05.841117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:05.841216 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:05.844129 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Terminating instance
Jun 27 04:09:05.890693 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:05.988030 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 3a0b6cd4-67f6-4a32-b7d0-e3fdb95dc709] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:06.042928 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Attempting to attach volume a574ef50-0fb3-446f-997f-d6a7e94a232e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:   <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-13"/>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:   <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:09:06.046799 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:09:06.078242 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-65f58bd6-4d81-489e-bac3-29193f97ae81 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "14cba585-a366-4fd8-81c6-71235e708858" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.266s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:06.295083 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Creating config drive at /opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4/disk.config
Jun 27 04:09:06.299728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkyyv17qu {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:06.348739 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:09:06.367970 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkyyv17qu" returned: 0 in 0.068s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:06.468521 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:06.471078 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:06.496985 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:06.505665 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:06.571147 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:06.749286 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd4b5700-7917-4af0-b7da-c5e40e16876e req-ebc6b08e-de80-4b5a-be15-e8f2e25fbb40 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:06.749626 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd4b5700-7917-4af0-b7da-c5e40e16876e req-ebc6b08e-de80-4b5a-be15-e8f2e25fbb40 service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:06.750356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd4b5700-7917-4af0-b7da-c5e40e16876e req-ebc6b08e-de80-4b5a-be15-e8f2e25fbb40 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:06.750356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd4b5700-7917-4af0-b7da-c5e40e16876e req-ebc6b08e-de80-4b5a-be15-e8f2e25fbb40 service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:06.750356 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd4b5700-7917-4af0-b7da-c5e40e16876e req-ebc6b08e-de80-4b5a-be15-e8f2e25fbb40 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:06.750593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd4b5700-7917-4af0-b7da-c5e40e16876e req-ebc6b08e-de80-4b5a-be15-e8f2e25fbb40 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:09:07.038147 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999629941000194 future=<Future at 0x7ec544913260 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:07.040635 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Instance destroyed successfully.
Jun 27 04:09:07.041184 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lazy-loading 'resources' on Instance uuid 1dcb49d8-f1f8-435f-a9b9-13d640d8857a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:07.062980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.134775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.216073 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.262181 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.363458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.398978 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.406589 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a43fb01-ad4a-4a51-99ae-b90c88f988de req-c22e7a5e-ea65-4a45-aa3f-771374113def service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:07.406589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a43fb01-ad4a-4a51-99ae-b90c88f988de req-c22e7a5e-ea65-4a45-aa3f-771374113def service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:07.406589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a43fb01-ad4a-4a51-99ae-b90c88f988de req-c22e7a5e-ea65-4a45-aa3f-771374113def service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:07.406817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a43fb01-ad4a-4a51-99ae-b90c88f988de req-c22e7a5e-ea65-4a45-aa3f-771374113def service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:07.406817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a43fb01-ad4a-4a51-99ae-b90c88f988de req-c22e7a5e-ea65-4a45-aa3f-771374113def service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:07.438821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.442942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.500055 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.505048 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.544053 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2117052605',display_name='tempest-ServerStableDeviceRescueTest-server-2117052605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverstabledevicerescuetest-server-2117052605',id=17,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSFYd/JkH+Vz3YsGvTwO9jit43qVKUlHw0XT+6lNosIG0v40wc3s9VfFpr/hClJBHRnYZTS/XpX5bvytocfQkLZlpKa5rDe2MI/579Dc1a5pubKxHCtUVE13jqffmeUiQ==',key_name='tempest-keypair-857089329',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:18Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68fa5127b52042afb5b60ff945958fe1',ramdisk_id='',reservation_id='r-6geb1f7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-266477854',owner_user_name='tempest-ServerStableDeviceRescueTest-266477854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:08:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2d46125fda94029b2d5b7c8fdaf56fa',uuid=1dcb49d8-f1f8-435f-a9b9-13d640d8857a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:09:07.544445 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converting VIF {"id": "5c588384-6b02-40d8-ac17-e99ed811d602", "address": "fa:16:3e:cc:24:49", "network": {"id": "87490d2a-cdfa-4049-86ba-5ad78eba436c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1557066572-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68fa5127b52042afb5b60ff945958fe1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c588384-6b", "ovs_interfaceid": "5c588384-6b02-40d8-ac17-e99ed811d602", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:07.545221 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:07.545614 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:09:07.549940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.549940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c588384-6b, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:07.551561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.551561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:07.553166 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.571804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.573480 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.573480 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80c7129f-dd95-40c4-ab03-b7ddb916b1ad) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:07.575171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.575171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:07.593117 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.593715 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.598605 np0000003830 nova-compute[98984]: INFO os_vif [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:24:49,bridge_name='br-int',has_traffic_filtering=True,id=5c588384-6b02-40d8-ac17-e99ed811d602,network=Network(87490d2a-cdfa-4049-86ba-5ad78eba436c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c588384-6b')
Jun 27 04:09:07.599031 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Deleting instance files /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a_del
Jun 27 04:09:07.600063 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Deletion of /opt/stack/data/nova/instances/1dcb49d8-f1f8-435f-a9b9-13d640d8857a_del complete
Jun 27 04:09:07.615884 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.659111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.705669 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.718398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.757878 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.767598 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.774036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:07.774036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:07.774036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:07.774036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:07.774036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:07.777561 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:07.777796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:07.777947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:07.778679 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:04:7e:18, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:07.786414 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Terminating instance
Jun 27 04:09:07.838288 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.845821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.882803 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4f3bca7-fbc4-48ee-8906-9cf459f5285d req-7bfe4d84-a972-429a-96e4-7792b1f75f36 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:07.883261 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4f3bca7-fbc4-48ee-8906-9cf459f5285d req-7bfe4d84-a972-429a-96e4-7792b1f75f36 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:07.884850 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.892394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4f3bca7-fbc4-48ee-8906-9cf459f5285d req-7bfe4d84-a972-429a-96e4-7792b1f75f36 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:07.892394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4f3bca7-fbc4-48ee-8906-9cf459f5285d req-7bfe4d84-a972-429a-96e4-7792b1f75f36 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:07.892394 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4f3bca7-fbc4-48ee-8906-9cf459f5285d req-7bfe4d84-a972-429a-96e4-7792b1f75f36 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:07.917403 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:07.923945 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.028236 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.113788 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Took 1.76 seconds to destroy the instance on the hypervisor.
Jun 27 04:09:08.119565 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:09:08.119565 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:09:08.119565 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:09:08.121466 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:08.226190 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:08.297645 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:09:08.338862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.342348 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.368663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.385271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.394569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.400856 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.427060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.436175 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.642712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.701469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.709813 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999635803000047 future=<Future at 0x7ec5381f9a90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:08.717511 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Instance destroyed successfully.
Jun 27 04:09:08.718260 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lazy-loading 'resources' on Instance uuid 99670311-67bb-4d60-b854-655dc01f2722 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:08.725517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.752975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.758749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.867962 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:08.868181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Acquiring lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:08.868382 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:08.871434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:08.872125 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] No waiting events found dispatching network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:08.872287 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-unplugged-5c588384-6b02-40d8-ac17-e99ed811d602 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:09:08.872440 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:08.872651 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:08.873064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:08.873220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:08.873371 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:08.874001 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:08.874001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:08.874001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:08.874092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:08.874478 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No event matching network-vif-plugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 in dict_keys([('network-vif-plugged', '23658b37-4049-4577-9e1f-487c0e385129'), ('network-vif-plugged', '40af7eec-8fb8-464e-85a4-12ed12c5f6f0'), ('network-vif-plugged', '5029793a-13f5-48f3-8d7a-a8076718daaa'), ('network-vif-plugged', '3a72cb59-aa80-44f8-99ff-89dfb60ab399')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:09:08.874692 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-69605b23-aef4-4d9d-906a-e27e39d39b9e req-d489a6b7-dc69-4d36-8359-14b459636a8b service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 for instance with vm_state building and task_state spawning.
Jun 27 04:09:08.958700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:08.967703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.162374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.169079 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.179471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.222157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2083219872',display_name='tempest-ServerActionsTestOtherA-server-2083219872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestothera-server-2083219872',id=2,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtSO1MYUpZk8IQG3rX5P/uUY1/Nkzipch76r9SFkAGFrHKDQ1tzyVZxTbRQq+zZnh+BLpox8T0KzzbxL20IfQVDyoCqpK+0734DteEbsOptK0IlQntnVC++K7/g4AtNDA==',key_name='tempest-keypair-1748344787',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:04:17Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b76ce35cec84d189228639d70c6be45',ramdisk_id='',reservation_id='r-mwlag0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1390022329',owner_user_name='tempest-ServerActionsTestOtherA-1390022329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb2d09351b2447bbfce95b09ad97b23',uuid=99670311-67bb-4d60-b854-655dc01f2722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:09:09.222965 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converting VIF {"id": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "address": "fa:16:3e:dc:c5:54", "network": {"id": "60325392-0885-4ebe-a938-33c7d7179934", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-240758118-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b76ce35cec84d189228639d70c6be45", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8e16ef8-1d", "ovs_interfaceid": "e8e16ef8-1d1a-4e8b-8975-d89037659b92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:09.222965 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:09.223151 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:09:09.224900 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.225206 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8e16ef8-1d, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:09.226406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.227556 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:09.227949 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.228855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.229054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0be54612-a7d1-4733-92fb-0811a0391cb7) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:09.229744 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.230318 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:09.230757 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.232785 np0000003830 nova-compute[98984]: INFO os_vif [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:c5:54,bridge_name='br-int',has_traffic_filtering=True,id=e8e16ef8-1d1a-4e8b-8975-d89037659b92,network=Network(60325392-0885-4ebe-a938-33c7d7179934),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8e16ef8-1d')
Jun 27 04:09:09.233367 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Deleting instance files /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722_del
Jun 27 04:09:09.234518 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Deletion of /opt/stack/data/nova/instances/99670311-67bb-4d60-b854-655dc01f2722_del complete
Jun 27 04:09:09.262743 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533349.2623496, 6897732e-ea7e-4359-802b-42ded626f5b4 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:09.263519 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] VM Started (Lifecycle Event)
Jun 27 04:09:09.567607 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1bca1696-5eb0-4a30-9cc3-0b04a2cc35bf tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.862s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.609409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.609409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.614186 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.640626 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.707294 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004169259998434427 future=<Future at 0x7ec518353410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:09.707725 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:09.707725 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=12.330168622000201 future=<Future at 0x7ec544913260 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:09.707725 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=12.33004347300016 future=<Future at 0x7ec544913260 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:09.708095 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533334.7067673, 14cba585-a366-4fd8-81c6-71235e708858 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:09.708269 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] VM Stopped (Lifecycle Event)
Jun 27 04:09:09.747450 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Took 1.45 seconds to destroy the instance on the hypervisor.
Jun 27 04:09:09.747450 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:09:09.747450 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:09:09.747450 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:09:09.747450 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:09.753171 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No event matching network-vif-plugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 in dict_keys([('network-vif-plugged', '23658b37-4049-4577-9e1f-487c0e385129'), ('network-vif-plugged', '40af7eec-8fb8-464e-85a4-12ed12c5f6f0'), ('network-vif-plugged', '5029793a-13f5-48f3-8d7a-a8076718daaa'), ('network-vif-plugged', '3a72cb59-aa80-44f8-99ff-89dfb60ab399')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 for instance with vm_state building and task_state spawning.
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No event matching network-vif-plugged-23658b37-4049-4577-9e1f-487c0e385129 in dict_keys([('network-vif-plugged', '40af7eec-8fb8-464e-85a4-12ed12c5f6f0'), ('network-vif-plugged', '5029793a-13f5-48f3-8d7a-a8076718daaa'), ('network-vif-plugged', '3a72cb59-aa80-44f8-99ff-89dfb60ab399')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-23658b37-4049-4577-9e1f-487c0e385129 for instance with vm_state building and task_state spawning.
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No event matching network-vif-plugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 in dict_keys([('network-vif-plugged', '5029793a-13f5-48f3-8d7a-a8076718daaa'), ('network-vif-plugged', '3a72cb59-aa80-44f8-99ff-89dfb60ab399')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 for instance with vm_state building and task_state spawning.
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.760401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.773442 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f40c08fe-3324-4600-9b56-b97fa8e2c27b req-9cfe300b-7633-4e7a-bf67-fe6744988c4c service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:09.773442 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:09.773442 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533349.769371, 6897732e-ea7e-4359-802b-42ded626f5b4 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:09.773442 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] VM Paused (Lifecycle Event)
Jun 27 04:09:09.833648 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:09.970010 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.978366 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:09.990490 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7388c94d-9f0d-4d47-a8a5-6f5f9ffd9301 req-dc1c5e34-8269-4f5d-8ade-31136db70df4 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:09.990732 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7388c94d-9f0d-4d47-a8a5-6f5f9ffd9301 req-dc1c5e34-8269-4f5d-8ade-31136db70df4 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:09.990949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7388c94d-9f0d-4d47-a8a5-6f5f9ffd9301 req-dc1c5e34-8269-4f5d-8ade-31136db70df4 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:09.991117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7388c94d-9f0d-4d47-a8a5-6f5f9ffd9301 req-dc1c5e34-8269-4f5d-8ade-31136db70df4 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:09.991276 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7388c94d-9f0d-4d47-a8a5-6f5f9ffd9301 req-dc1c5e34-8269-4f5d-8ade-31136db70df4 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No event matching network-vif-plugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 in dict_keys([('network-vif-plugged', '5029793a-13f5-48f3-8d7a-a8076718daaa')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:09:09.992707 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-7388c94d-9f0d-4d47-a8a5-6f5f9ffd9301 req-dc1c5e34-8269-4f5d-8ade-31136db70df4 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 for instance with vm_state building and task_state spawning.
Jun 27 04:09:10.001907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:10.029081 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:10.056523 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:10.211444 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f71354c9-9712-4d9f-8165-4bc977e44f77 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 14cba585-a366-4fd8-81c6-71235e708858] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:10.287730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:10.287730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:10.571824 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Took 2.44 seconds to deallocate network for instance.
Jun 27 04:09:10.783746 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:09:10.944780 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:10.945405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:10.945584 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:10.945584 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:10.945757 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Processing event network-vif-plugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:10.945982 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:10.946150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:10.946340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:10.946502 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:10.946668 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-plugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:10.946808 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-45bc79fd-8f2f-4cee-97a4-e2f446a82048 req-4fa8902f-6496-4142-b06e-faa25e538e31 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-5029793a-13f5-48f3-8d7a-a8076718daaa for instance with vm_state building and task_state spawning.
Jun 27 04:09:10.947483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:09:10.951519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:09:10.952360 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533350.9520898, 6897732e-ea7e-4359-802b-42ded626f5b4 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:10.952692 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] VM Resumed (Lifecycle Event)
Jun 27 04:09:10.955510 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance spawned successfully.
Jun 27 04:09:10.955862 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:09:11.075973 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:11.076139 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:11.144955 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:11.455175 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:11.472073 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:11.480167 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:11.480409 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:11.495190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:11.495190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:11.495190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:11.495190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:11.646991 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Took 1.90 seconds to deallocate network for instance.
Jun 27 04:09:11.870627 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:11.871906 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:11.906331 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Received event network-vif-deleted-5c588384-6b02-40d8-ac17-e99ed811d602 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:11.906331 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-plugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:11.906540 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:11.906809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:11.907361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:11.907572 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-plugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:11.908707 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received unexpected event network-vif-plugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 for instance with vm_state building and task_state spawning.
Jun 27 04:09:11.908707 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:11.908707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:11.908707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:11.908707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:11.908707 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] No waiting events found dispatching network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:11.909482 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received unexpected event network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 for instance with vm_state deleted and task_state None.
Jun 27 04:09:11.909482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:11.909482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Acquiring lock "99670311-67bb-4d60-b854-655dc01f2722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:11.909482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:11.909671 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] Lock "99670311-67bb-4d60-b854-655dc01f2722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:11.909837 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] No waiting events found dispatching network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:11.910070 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received unexpected event network-vif-unplugged-e8e16ef8-1d1a-4e8b-8975-d89037659b92 for instance with vm_state deleted and task_state None.
Jun 27 04:09:11.910365 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a902060-958f-4973-821a-e8fd64a2cd04 req-8b87c824-e58a-4380-a9a8-41f9e7965c86 service nova] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Received event network-vif-deleted-e8e16ef8-1d1a-4e8b-8975-d89037659b92 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:11.978426 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:09:12.000573 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Took 34.80 seconds to spawn the instance on the hypervisor.
Jun 27 04:09:12.000573 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:12.157256 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:12.374035 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:12.511247 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Took 51.75 seconds to build instance.
Jun 27 04:09:12.882222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.805s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:12.883082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.724s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:13.013916 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e782c477-bcc6-401a-8676-21767327fd10 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.268s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:13.017957 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Stashing vm_state: active {{(pid=98984) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 27 04:09:13.046534 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Deleted allocations for instance 1dcb49d8-f1f8-435f-a9b9-13d640d8857a
Jun 27 04:09:13.143754 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:13.607761 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:13.651382 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:13.651680 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:14.061659 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-044eecf4-9b69-4127-a3b3-9d22ec76c2d3 tempest-ServerStableDeviceRescueTest-266477854 tempest-ServerStableDeviceRescueTest-266477854-project-member] Lock "1dcb49d8-f1f8-435f-a9b9-13d640d8857a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.215s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:14.154955 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:14.167103 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:14.229594 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:14.665536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.784s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:14.670044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.060s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:14.851913 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Deleted allocations for instance 99670311-67bb-4d60-b854-655dc01f2722
Jun 27 04:09:15.088366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-changed-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:15.088366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing instance network info cache due to event network-changed-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:15.090690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] Acquiring lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:15.091955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] Acquired lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:15.094992 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Refreshing network info cache for port cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:15.173410 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:09:15.173621 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Claim successful on node np0000003830
Jun 27 04:09:15.600380 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:15.681300 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating resource usage from migration fe0da4ab-e68d-4a68-89ea-527da568c577
Jun 27 04:09:15.869335 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0fcf5e4a-e139-4d70-8ba7-8cbb23e9b1a4 tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Lock "99670311-67bb-4d60-b854-655dc01f2722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.096s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:16.134065 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:16.392522 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updated VIF entry in instance network info cache for port cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:16.392925 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [{"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:16.407239 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:16.407239 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:16.899273 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d8fe5c20-fff9-4542-8050-f3f9b2a813c6 req-ab260f42-1acf-49e3-8a1b-49a5bb1e2449 service nova] Releasing lock "refresh_cache-6897732e-ea7e-4359-802b-42ded626f5b4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:16.911838 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:17.422135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.755s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:17.422775 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Migrating
Jun 27 04:09:17.422775 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:09:17.875452 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:17.941747 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:17.941890 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:17.942120 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:18.446188 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:19.170599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:19.230279 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:19.669219 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:19.709798 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:19.922367 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:20.114322 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:20.425962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:20.515564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:21.940290 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Starting migrate_disk_and_power_off {{(pid=98984) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12623}}
Jun 27 04:09:21.975647 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:21.983074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.007739 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.038436 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00035586399985731987 future=<Future at 0x7ec544913260 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:22.038851 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Emitting event <LifecycleEvent: 1782533347.0376422, 1dcb49d8-f1f8-435f-a9b9-13d640d8857a => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:22.039055 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] VM Stopped (Lifecycle Event)
Jun 27 04:09:22.039550 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:22.039672 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.6695560200000727 future=<Future at 0x7ec5381f9a90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:22.039755 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.6694632730000194 future=<Future at 0x7ec5381f9a90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:22.206298 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.218853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.320393 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999612841000044 future=<Future at 0x7ec5545b2de0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:22.324028 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance destroyed successfully.
Jun 27 04:09:22.325511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=24,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:14Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-geh2au0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=e52a57a3-19dd-482d-bd3a-20e3a5230c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:09:22.325893 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:22.326629 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:22.326932 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:09:22.328038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.328440 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5621924f-9e, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:22.329582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.331944 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:22.332641 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.334509 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.334720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c82b7e75-fa36-4283-8d42-250e3edbaac0) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:22.335411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.336059 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:22.338415 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:22.342760 np0000003830 nova-compute[98984]: INFO os_vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e')
Jun 27 04:09:22.384300 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dc01a65b-987d-48eb-bfa9-804fcce5c5ce req-b613fe2f-9fe9-4477-9ba7-351af80b5756 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:22.387795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dc01a65b-987d-48eb-bfa9-804fcce5c5ce req-b613fe2f-9fe9-4477-9ba7-351af80b5756 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:22.387795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dc01a65b-987d-48eb-bfa9-804fcce5c5ce req-b613fe2f-9fe9-4477-9ba7-351af80b5756 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:22.387795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dc01a65b-987d-48eb-bfa9-804fcce5c5ce req-b613fe2f-9fe9-4477-9ba7-351af80b5756 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:22.387795 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dc01a65b-987d-48eb-bfa9-804fcce5c5ce req-b613fe2f-9fe9-4477-9ba7-351af80b5756 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:22.387795 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-dc01a65b-987d-48eb-bfa9-804fcce5c5ce req-b613fe2f-9fe9-4477-9ba7-351af80b5756 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received unexpected event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with vm_state active and task_state resize_migrating.
Jun 27 04:09:22.543560 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 1dcb49d8-f1f8-435f-a9b9-13d640d8857a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:22.891863 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Detected multiple connections on this host for volume: a574ef50-0fb3-446f-997f-d6a7e94a232e, skipping target disconnect.
Jun 27 04:09:22.894811 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:23.003194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:23.006646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:23.133733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:23.135124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:23.136633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_resize/disk /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:23.264109 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "cp -r /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_resize/disk /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk" returned: 0 in 0.126s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:23.264109 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_resize/disk.config /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:23.312363 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "cp -r /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_resize/disk.config /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:23.313702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_resize/disk.info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:23.351044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "cp -r /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_resize/disk.info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" returned: 0 in 0.037s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:23.709798 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005036150000705675 future=<Future at 0x7ec5381f9a90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:23.709976 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:23.710091 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=13.609883628000034 future=<Future at 0x7ec5545b2de0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:23.710185 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=13.609776814000043 future=<Future at 0x7ec5545b2de0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:23.710838 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] Emitting event <LifecycleEvent: 1782533348.7091713, 99670311-67bb-4d60-b854-655dc01f2722 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:23.711042 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] VM Stopped (Lifecycle Event)
Jun 27 04:09:24.179931 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:24.214726 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c85cc012-69fa-49d6-bd18-0c9219d2163d None None] [instance: 99670311-67bb-4d60-b854-655dc01f2722] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:24.520125 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c6d3dbaf-960a-49f9-a1ca-d8dab38097d4 req-e85efcc6-e0e5-4f29-b9f6-3b9407580095 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:24.520393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c6d3dbaf-960a-49f9-a1ca-d8dab38097d4 req-e85efcc6-e0e5-4f29-b9f6-3b9407580095 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:24.520727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c6d3dbaf-960a-49f9-a1ca-d8dab38097d4 req-e85efcc6-e0e5-4f29-b9f6-3b9407580095 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:24.520832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c6d3dbaf-960a-49f9-a1ca-d8dab38097d4 req-e85efcc6-e0e5-4f29-b9f6-3b9407580095 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:24.521237 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c6d3dbaf-960a-49f9-a1ca-d8dab38097d4 req-e85efcc6-e0e5-4f29-b9f6-3b9407580095 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:24.521237 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c6d3dbaf-960a-49f9-a1ca-d8dab38097d4 req-e85efcc6-e0e5-4f29-b9f6-3b9407580095 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received unexpected event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with vm_state active and task_state resize_migrating.
Jun 27 04:09:24.552323 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:24.552774 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:24.666518 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Port 5621924f-9e14-46a7-bd15-6952d449805b binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:09:24.830801 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:24.832205 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:25.155162 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:25.336199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:25.336930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:25.336930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:25.336930 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:09:25.679217 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:09:25.687518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:25.687760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:25.687908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:26.039223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:26.382252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:26.484013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:26.485647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:26.584412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:26.589986 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:26.596905 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:26.598148 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:26.598148 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:26.600429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:26.719360 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:26.719360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:26.719360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:26.793439 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:26.794375 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:26.798987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:26.878622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:26.878754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:26.878939 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:26.893155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:26.893762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:26.999338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:26.999719 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:27.003689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:27.113702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:27.114620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:27.194478 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.215473 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:27.223590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:27.335251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:27.335251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:27.348220 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.377366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:27.377366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:27.377366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:27.377366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:27.378065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:27.381070 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Terminating instance
Jun 27 04:09:27.382847 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:27.430179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:27.435272 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:09:27.442417 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:27.443897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:27.496348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:27.496859 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50001MB free_disk=73.69483947753906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:09:27.497075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:27.501011 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:27.912774 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:09:27.912774 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:27.925569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.926271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.955720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.955720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.977625 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:27.982723 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.102715 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:28.273554 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999546205000115 future=<Future at 0x7ec54da00e00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:28.290716 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Instance destroyed successfully.
Jun 27 04:09:28.293473 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lazy-loading 'resources' on Instance uuid 556b87cb-fbf9-4b7c-84c4-40f49005eb25 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:28.413981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04263b0c-3e7b-4d43-8edc-a1728cda2f72 req-2e9aac73-dbca-4372-81a1-f5cf6d9d185e service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:28.413981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04263b0c-3e7b-4d43-8edc-a1728cda2f72 req-2e9aac73-dbca-4372-81a1-f5cf6d9d185e service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:28.413981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04263b0c-3e7b-4d43-8edc-a1728cda2f72 req-2e9aac73-dbca-4372-81a1-f5cf6d9d185e service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:28.413981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04263b0c-3e7b-4d43-8edc-a1728cda2f72 req-2e9aac73-dbca-4372-81a1-f5cf6d9d185e service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:28.413981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04263b0c-3e7b-4d43-8edc-a1728cda2f72 req-2e9aac73-dbca-4372-81a1-f5cf6d9d185e service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:28.413981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04263b0c-3e7b-4d43-8edc-a1728cda2f72 req-2e9aac73-dbca-4372-81a1-f5cf6d9d185e service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:09:28.518696 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Applying migration context for instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e as it has an incoming, in-progress migration fe0da4ab-e68d-4a68-89ea-527da568c577. Migration status is post-migrating {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 27 04:09:28.519975 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating resource usage from migration fe0da4ab-e68d-4a68-89ea-527da568c577
Jun 27 04:09:28.605881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 556b87cb-fbf9-4b7c-84c4-40f49005eb25 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6897732e-ea7e-4359-802b-42ded626f5b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d020229-688f-487c-8458-d1f3cd69257b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 30950d61-f1cd-4a81-ae4e-cce3af742f8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Migration fe0da4ab-e68d-4a68-89ea-527da568c577 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 9 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:09:28.677001 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2304MB phys_disk=95GB used_disk=6GB total_vcpus=16 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:09:27 up 32 min,  2 users,  load average: 11.86, 8.83, 4.46\n', 'num_instances': '8', 'num_vm_active': '8', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '5', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_85de4b575a314a0fa4c6352eaf5b1753': '1', 'num_task_resize_migrated': '1', 'num_proj_5550c68573fa4ae7b3b9553209bb7625': '1', 'num_proj_469d72ff5a3640dbb2193b8a91deeac0': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:09:28.795758 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-980582709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionsv293testjson-server-844248708',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuyiudFpREd/ABd9CQTPRBpKOMLvejaZPuRMCxP5zbNlnC7ydBW46wKbUDuAckdqgdn6b/On7/IwzxCCgukLifogPI5AHYn/D4u7jX134iPu48395wkEHLPrVpode/uhA==',key_name='tempest-keypair-1481687516',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:49Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85de4b575a314a0fa4c6352eaf5b1753',ramdisk_id='',reservation_id='r-cesx1l83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='45a2fcb3-a65c-47e5-9cfb-4f177d29598e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-165019121',owner_user_name='tempest-ServerActionsV293TestJSON-165019121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eab22bac1a364b3988558ae38ed50d34',uuid=556b87cb-fbf9-4b7c-84c4-40f49005eb25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:09:28.795935 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converting VIF {"id": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "address": "fa:16:3e:fc:04:d5", "network": {"id": "324fe954-da11-4ffd-a51e-a27310c0d40a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1207960612-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "85de4b575a314a0fa4c6352eaf5b1753", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ab7cfb-65", "ovs_interfaceid": "a7ab7cfb-650d-42d5-8cd4-a1aa1b943950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:28.796640 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:28.796944 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:09:28.802817 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.803030 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7ab7cfb-65, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:28.804227 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.805209 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:28.806025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.806847 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.807029 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbc84641-db54-4dbc-be41-3726c4855cc9) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:28.807540 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.808267 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:28.808829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:28.813376 np0000003830 nova-compute[98984]: INFO os_vif [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:04:d5,bridge_name='br-int',has_traffic_filtering=True,id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950,network=Network(324fe954-da11-4ffd-a51e-a27310c0d40a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ab7cfb-65')
Jun 27 04:09:28.819437 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:09:28.820993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:28.820993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:29.116557 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:29.130615 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:09:29.162182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:29.184368 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:29.218911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:09:29.219326 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:09:29.230754 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:09:29.232457 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:fe4d:5128', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:febe:7e7', 'fe80::fc16:3eff:fe7e:c31', 'fe80::fc16:3eff:febd:6e54', 'fe80::5c7e:41ff:fed9:c369', 'fe80::fc16:3eff:fe79:e596', 'fe80::fc16:3eff:febc:40a2', 'fe80::fc16:3eff:fe2a:39', 'fe80::fc16:3eff:fe98:b9a3', 'fe80::e0ca:11ff:fee7:50a7', 'fe80::6cbd:96ff:fec2:6718'] 
Jun 27 04:09:29.232457 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:09:29.232685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:09:29.232954 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:29.382599 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:29.382599 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:29.885198 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:29.988686 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:30.393739 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:09:30.394294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.897s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:30.394332 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:09:30.474995 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eef049d0-f427-4487-9ead-45e76f395e11 req-f3feadeb-8c9a-4c13-9b1a-3ce189b15a39 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:30.475396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eef049d0-f427-4487-9ead-45e76f395e11 req-f3feadeb-8c9a-4c13-9b1a-3ce189b15a39 service nova] Acquiring lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:30.475674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eef049d0-f427-4487-9ead-45e76f395e11 req-f3feadeb-8c9a-4c13-9b1a-3ce189b15a39 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:30.475859 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eef049d0-f427-4487-9ead-45e76f395e11 req-f3feadeb-8c9a-4c13-9b1a-3ce189b15a39 service nova] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:30.476390 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eef049d0-f427-4487-9ead-45e76f395e11 req-f3feadeb-8c9a-4c13-9b1a-3ce189b15a39 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] No waiting events found dispatching network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:30.476568 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eef049d0-f427-4487-9ead-45e76f395e11 req-f3feadeb-8c9a-4c13-9b1a-3ce189b15a39 service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-unplugged-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:09:30.664082 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Starting finish_migration {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12810}}
Jun 27 04:09:30.664947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:09:30.665049 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Creating image(s)
Jun 27 04:09:30.665674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:30.753257 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:30.754247 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:09:30.754247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:30.843669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:30.843669 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Cannot resize image /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:09:31.135048 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:31.135678 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:31.195466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.372s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:31.195466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55d1eb6f-568d-4401-aa61-08e54f222bc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:09:31.195466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:09:31.196026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:31.196026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:31.199459 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Shelving
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.234439 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '60')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:09:31.235211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '49')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:09:31.237670 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2', '50')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:09:31.238536 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53812a660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:09:31.238891 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:09:31.239201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Flush multipath device 3300000007b684c46 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:09:31.307523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:09:31.347940 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:09:31.348134 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:09:31.348535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:31.348760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:31.348983 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:31.353200 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Start _get_guest_xml network_info=[{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '6083159d-2d10-409d-98c5-032257036fa4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'e52a57a3-19dd-482d-bd3a-20e3a5230c4e', 'attached_at': '2026-06-27T04:09:30.000000', 'detached_at': '', 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'multiattach': True, 'serial': 'a574ef50-0fb3-446f-997f-d6a7e94a232e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:09:31.364199 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:09:31.378862 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:31.378862 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='e52a57a3-19dd-482d-bd3a-20e3a5230c4e'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533371.378177) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:09:31.381547 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:09:31.382010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:09:31.392839 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:09:31.395323 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:09:31.395323 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:09:31.401219 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:09:31.402359 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:09:31.407320 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.407789 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.408344 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.410434 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.415825 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.41 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:09:31.426123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:31.445608 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:09:31.458325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:09:31.458816 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:09:31.482003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.532523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:31.533157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:31.533452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:31.534069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260]
Jun 27 04:09:31.534069 np0000003830 nova-compute[98984]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.40.100,3260] successful.
Jun 27 04:09:31.534069 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.535086 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:31.535463 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:09:31.535850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:31.536116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:31.564070 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.579706 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.638936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:09:31.642123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260]
Jun 27 04:09:31.642123 np0000003830 nova-compute[98984]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-55d1eb6f-568d-4401-aa61-08e54f222bc2, portal: 192.168.50.100,3260] successful.
Jun 27 04:09:31.642123 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.652123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:31.652375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:31.667092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.667386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:31.667562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] <== disconnect_volume: return (2846ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:31.667723 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:09:31.668195 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Deleting instance files /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25_del
Jun 27 04:09:31.676979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.132s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:31.676979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:09:31.678141 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Deletion of /opt/stack/data/nova/instances/556b87cb-fbf9-4b7c-84c4-40f49005eb25_del complete
Jun 27 04:09:31.685408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:31.685408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:31.685408 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:09:31.685408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:31.685827 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:31.687061 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:31.704086 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:31.711966 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.736197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.736197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:31.738141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:31.738980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:31.739034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('13', '0', '0', 0) found on session 53 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:31.739166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:31.745087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:31.745819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:31.746327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('14', '0', '0', 0) found on session 54 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:31.746529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:31.749662 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 53 and hctl ('13', '0', '0', 0) yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:31.750155 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:31.757523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 54 and hctl ('14', '0', '0', 0) yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:31.757689 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:32.154836 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:09:32.193485 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Took 4.30 seconds to destroy the instance on the hypervisor.
Jun 27 04:09:32.195403 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:09:32.196251 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:09:32.196395 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:09:32.196610 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:32.204575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:32.205195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:32.210671 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:09:32.210862 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Claim successful on node np0000003830
Jun 27 04:09:32.258055 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:32.290883 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:32.290883 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:32.320491 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:32.346236 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:32.536171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:32.551329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:32.564112 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999630084000046 future=<Future at 0x7ec5384a9cd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:32.575010 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance destroyed successfully.
Jun 27 04:09:32.575884 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'numa_topology' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:32.685801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:09:32.720287 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:32.946011 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-99d289af-7c9e-481f-8783-ae859b376a5a req-35b39a46-9137-4032-ba7a-7e8d7a1fd49f service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Received event network-vif-deleted-a7ab7cfb-650d-42d5-8cd4-a1aa1b943950 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:32.946146 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-99d289af-7c9e-481f-8783-ae859b376a5a req-35b39a46-9137-4032-ba7a-7e8d7a1fd49f service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Neutron deleted interface a7ab7cfb-650d-42d5-8cd4-a1aa1b943950; detaching it from the instance and deleting it from the info cache
Jun 27 04:09:32.947715 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-99d289af-7c9e-481f-8783-ae859b376a5a req-35b39a46-9137-4032-ba7a-7e8d7a1fd49f service nova] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Detach interface failed, port_id=a7ab7cfb-650d-42d5-8cd4-a1aa1b943950, reason: Instance 556b87cb-fbf9-4b7c-84c4-40f49005eb25 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:09:33.195935 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Beginning cold snapshot process
Jun 27 04:09:33.357296 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:33.809836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:33.860188 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Took 1.66 seconds to deallocate network for instance.
Jun 27 04:09:33.940975 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:33.941163 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:34.184708 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:34.193862 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:34.194077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:34.425511 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Took 0.57 seconds to detach 1 volumes for instance.
Jun 27 04:09:34.427250 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Deleting volume: 55d1eb6f-568d-4401-aa61-08e54f222bc2 {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:09:34.443686 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:34.699304 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:09:34.714424 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:09:34.714424 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk /opt/stack/data/nova/instances/snapshots/tmplxriwoaw/8d82368b804a48718f9717058289f743 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:34.952288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.746s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:34.952288 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:09:34.955031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.235s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:34.960416 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:09:34.961219 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Claim successful on node np0000003830
Jun 27 04:09:35.003255 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:35.246901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:35.458900 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:09:35.458900 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:09:35.459392 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:35.459392 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:35.540914 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b427e506578a4121bf0d008321dacac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7adc2502eb6e45c19f6b8646b60669f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:09:35.961618 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:09:36.011673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk /opt/stack/data/nova/instances/snapshots/tmplxriwoaw/8d82368b804a48718f9717058289f743" returned: 0 in 1.298s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:36.011673 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Snapshot extracted, beginning image upload
Jun 27 04:09:36.108004 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Successfully created port: 045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:09:36.465573 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:09:36.631672 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:36.632845 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:36.681091 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Successfully updated port: 045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:09:36.726274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-changed-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:36.726429 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Refreshing instance network info cache due to event network-changed-045ddeda-5a24-4df2-826c-346068bd099c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:36.727554 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] Acquiring lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:36.727554 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] Acquired lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:36.727554 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Refreshing network info cache for port 045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:37.135670 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:37.183142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:37.230239 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:37.309420 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:09:37.320433 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00041599699989092187 future=<Future at 0x7ec5545b2de0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:37.320653 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:37.323514 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.952084341000045 future=<Future at 0x7ec54da00e00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:37.323514 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.951978540000027 future=<Future at 0x7ec54da00e00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:37.323514 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533362.3199003, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:37.323514 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Stopped (Lifecycle Event)
Jun 27 04:09:37.473201 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:09:37.474283 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:09:37.474680 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Creating image(s)
Jun 27 04:09:37.475091 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:37.475299 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:37.476249 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:37.476862 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:37.480990 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:37.482714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:37.508256 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:37.579224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:37.579664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:37.580157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:37.580610 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:37.583996 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:37.584404 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:37.646259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.691s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:37.647076 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:09:37.651148 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.648s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:37.680948 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:37.690592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:37.738281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk 1073741824" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:37.738692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:37.738972 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:37.818602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.079s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:37.819077 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:09:37.819941 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:37.831682 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:37.845520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:37.903291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:37.903717 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Cannot resize image /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:09:37.904022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:09:37.904164 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Ensure instance console log exists: /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:09:37.904472 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:37.904683 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:37.904815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:38.014162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-14ba96b1-183a-4390-a758-4c16df58109c req-c7547662-c70d-4f63-a822-085bb5acd5b5 service nova] Releasing lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:38.017211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:38.017478 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:38.158102 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:09:38.158102 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:09:38.158102 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:38.158102 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:38.258372 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b427e506578a4121bf0d008321dacac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7adc2502eb6e45c19f6b8646b60669f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:09:38.336461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:38.336461 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:38.350435 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:09:38.640312 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:09:38.661476 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:09:38.812360 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:38.827187 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:38.840127 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:38.953288 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Snapshot image upload complete
Jun 27 04:09:38.953624 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:38.986372 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Successfully created port: d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:09:39.000469 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Updating instance_info_cache with network_info: [{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:39.164632 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:09:39.186558 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:39.345014 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.694s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:39.346476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.099s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:39.349688 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:09:39.349857 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Claim successful on node np0000003830
Jun 27 04:09:39.399529 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Deleted allocations for instance 556b87cb-fbf9-4b7c-84c4-40f49005eb25
Jun 27 04:09:39.464969 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Shelve offloading
Jun 27 04:09:39.502375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:39.502657 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance network_info: |[{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:09:39.504753 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Start _get_guest_xml network_info=[{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:09:39.507603 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:39.508735 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1902559260', uuid='e4cc11fc-1add-45d0-9bd3-e1f6de51ea39'), owner=OwnerMeta(userid='b427e506578a4121bf0d008321dacac9', username='tempest-ServerRescueNegativeTestJSON-1862600164-project-member', projectid='7adc2502eb6e45c19f6b8646b60669f5', projectname='tempest-ServerRescueNegativeTestJSON-1862600164'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533379.508373) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:09:39.509673 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:09:39.510037 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:09:39.510964 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:09:39.511141 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:09:39.512001 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:09:39.512282 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:09:39.512418 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:09:39.512525 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:09:39.512641 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:09:39.512719 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:09:39.512806 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:09:39.512947 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:09:39.513057 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:09:39.513168 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:09:39.513276 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:09:39.513382 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:09:39.527786 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1902559260',display_name='tempest-ServerRescueNegativeTestJSON-server-1902559260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1902559260',id=28,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-cvd59xdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:37Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=e4cc11fc-1add-45d0-9bd3-e1f6de51ea39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:39.528058 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:39.528804 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:39.529553 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'pci_devices' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:39.611867 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Successfully updated port: d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:09:39.666797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-changed-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:39.667226 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Refreshing instance network info cache due to event network-changed-d13a3de0-7db1-43f6-a996-1eb633e8717f. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:39.667532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] Acquiring lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:39.667642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] Acquired lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:39.667801 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Refreshing network info cache for port d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:39.721900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000d9190441 for multipath device dm-13 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:09:39.722193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.054s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:39.722383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (8186ms) {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:39.722539 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:09:39.970904 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance destroyed successfully.
Jun 27 04:09:39.971575 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:39.972795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:39.972855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:39.972953 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <uuid>e4cc11fc-1add-45d0-9bd3-e1f6de51ea39</uuid>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <name>instance-0000001c</name>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1902559260</nova:name>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:09:39</nova:creationTime>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:user uuid="b427e506578a4121bf0d008321dacac9">tempest-ServerRescueNegativeTestJSON-1862600164-project-member</nova:user>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:project uuid="7adc2502eb6e45c19f6b8646b60669f5">tempest-ServerRescueNegativeTestJSON-1862600164</nova:project>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         <nova:port uuid="045ddeda-5a24-4df2-826c-346068bd099c">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <entry name="serial">e4cc11fc-1add-45d0-9bd3-e1f6de51ea39</entry>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <entry name="uuid">e4cc11fc-1add-45d0-9bd3-e1f6de51ea39</entry>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d0:ca:33"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <target dev="tap045ddeda-5a"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/console.log" append="off"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:40.032294 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Preparing to wait for external event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1902559260',display_name='tempest-ServerRescueNegativeTestJSON-server-1902559260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1902559260',id=28,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-cvd59xdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:37Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=e4cc11fc-1add-45d0-9bd3-e1f6de51ea39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:40.034392 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:40.035137 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:40.035186 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.035675 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.035862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:40.037001 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.037169 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9743e301-63c3-5986-964c-dd8b5f7bfcba', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.045925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.046735 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:40.051311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.053649 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.053770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap045ddeda-5a, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.054073 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap045ddeda-5a, col_values=(('qos', UUID('6eb55894-87f0-49f6-97dd-457f122942f4')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.054275 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap045ddeda-5a, col_values=(('external_ids', {'iface-id': '045ddeda-5a24-4df2-826c-346068bd099c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ca:33', 'vm-uuid': 'e4cc11fc-1add-45d0-9bd3-e1f6de51ea39'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.055219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.056331 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:40.065462 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.066314 np0000003830 nova-compute[98984]: INFO os_vif [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a')
Jun 27 04:09:40.113985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:40.173588 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:09:40.175110 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:40.176703 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:09:40.177809 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Creating image(s)
Jun 27 04:09:40.179455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:40.180260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:40.180803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:40.181427 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:40.190376 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:40.192131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:40.231525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=24,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:14Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-geh2au0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=e52a57a3-19dd-482d-bd3a-20e3a5230c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:40.231525 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:40.231525 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <uuid>e52a57a3-19dd-482d-bd3a-20e3a5230c4e</uuid>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <name>instance-00000018</name>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <memory>262144</memory>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:name>multiattach-server-0</nova:name>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:09:31</nova:creationTime>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.micro" id="84">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:memory>256</nova:memory>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         <nova:port uuid="5621924f-9e14-46a7-bd15-6952d449805b">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <entry name="serial">e52a57a3-19dd-482d-bd3a-20e3a5230c4e</entry>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <entry name="uuid">e52a57a3-19dd-482d-bd3a-20e3a5230c4e</entry>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk.config"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-13"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <shareable/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:56:24:62"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <target dev="tap5621924f-9e"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/console.log" append="off"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:40.233133 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=24,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:14Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-geh2au0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=e52a57a3-19dd-482d-bd3a-20e3a5230c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:56:24:62"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.237057 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:40.237832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.243577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b088bb0f-6b8e-587e-bb52-dc52b6628158', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.243577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.243577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:40.251556 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.254886 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.254886 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5621924f-9e, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.255218 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5621924f-9e, col_values=(('qos', UUID('fdff8529-4ace-41f9-94f8-ba20644c4d40')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.255382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5621924f-9e, col_values=(('external_ids', {'iface-id': '5621924f-9e14-46a7-bd15-6952d449805b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:24:62', 'vm-uuid': 'e52a57a3-19dd-482d-bd3a-20e3a5230c4e'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:40.256347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.257634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:40.267273 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:09:40.270925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:40.272333 np0000003830 nova-compute[98984]: INFO os_vif [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e')
Jun 27 04:09:40.279119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:40.279527 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:40.279926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:40.280467 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:40.283272 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:40.283589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:40.370534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:40.370534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:40.408174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8395d685-6370-4f40-81ac-c458a7f66b5c tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Lock "556b87cb-fbf9-4b7c-84c4-40f49005eb25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:40.415883 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk 1073741824" returned: 0 in 0.045s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:40.416336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:40.416667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:40.475433 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:40.488464 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:40.510334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:40.510809 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:09:40.511097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:40.598133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:40.598868 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Cannot resize image /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:09:40.601555 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:09:40.602233 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Ensure instance console log exists: /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:09:40.602567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:40.602770 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:40.603019 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:40.908785 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:40.990637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f7b68166-08c1-418f-a588-3a0d5c454fa2 req-fae48df0-3d74-4b2c-a18f-523c5d9679fa service nova] Releasing lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:40.991167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:40.991402 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:41.074342 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:41.078948 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:41.079182 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:41.461058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:41.562973 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:09:41.576657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:41.576942 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:41.577235 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:41.582241 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:41.593079 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:41.593244 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:41.593375 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:d0:ca:33, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:41.593957 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Using config drive
Jun 27 04:09:41.723614 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:41.799317 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e6e2313c-e130-4a50-9de7-c57fc5285de5 req-4f4f2372-939e-4e01-b989-df283b12c1ac service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:41.799528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6e2313c-e130-4a50-9de7-c57fc5285de5 req-4f4f2372-939e-4e01-b989-df283b12c1ac service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:41.799730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6e2313c-e130-4a50-9de7-c57fc5285de5 req-4f4f2372-939e-4e01-b989-df283b12c1ac service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:41.799876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6e2313c-e130-4a50-9de7-c57fc5285de5 req-4f4f2372-939e-4e01-b989-df283b12c1ac service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:41.800141 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e6e2313c-e130-4a50-9de7-c57fc5285de5 req-4f4f2372-939e-4e01-b989-df283b12c1ac service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] No waiting events found dispatching network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:41.800338 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e6e2313c-e130-4a50-9de7-c57fc5285de5 req-4f4f2372-939e-4e01-b989-df283b12c1ac service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received unexpected event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 for instance with vm_state shelved and task_state shelving_offloading.
Jun 27 04:09:41.819351 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:41.819515 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:41.819593 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:41.819710 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:56:24:62, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:41.820154 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Using config drive
Jun 27 04:09:41.958460 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Updating instance_info_cache with network_info: [{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:42.088034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.743s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:42.088510 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:09:42.101657 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:42.187295 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance destroyed successfully.
Jun 27 04:09:42.187895 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'resources' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:42.241370 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:42.242656 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing instance network info cache due to event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:42.242901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:42.243055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:42.243226 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:42.279922 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Creating config drive at /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config
Jun 27 04:09:42.284042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.288903 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjpqmenyz {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:42.325433 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.330570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.350113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjpqmenyz" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:42.441197 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.461025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:42.461520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance network_info: |[{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:09:42.464945 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Start _get_guest_xml network_info=[{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:09:42.473650 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:42.475752 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1332807486', uuid='f5611e50-86aa-420c-9f94-e13d8f80f4b0'), owner=OwnerMeta(userid='b427e506578a4121bf0d008321dacac9', username='tempest-ServerRescueNegativeTestJSON-1862600164-project-member', projectid='7adc2502eb6e45c19f6b8646b60669f5', projectname='tempest-ServerRescueNegativeTestJSON-1862600164'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533382.4752414) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:09:42.479337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.481142 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:09:42.481682 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:09:42.483413 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:09:42.483689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:09:42.484946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:09:42.485339 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:09:42.485550 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:09:42.485680 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:09:42.485863 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:09:42.485997 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:09:42.486136 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:09:42.486354 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:09:42.486607 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:09:42.487547 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:09:42.487547 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:09:42.487547 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:09:42.494803 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.507116 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332807486',display_name='tempest-ServerRescueNegativeTestJSON-server-1332807486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1332807486',id=29,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-i83bwfym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:39Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=f5611e50-86aa-420c-9f94-e13d8f80f4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:42.507404 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:42.508256 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:42.509077 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'pci_devices' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:42.542635 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c2b4829c-2f64-48e9-a1b1-8561a9175f6c req-9efe153c-efa5-4a1f-9f57-d460853095a7 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:42.543109 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c2b4829c-2f64-48e9-a1b1-8561a9175f6c req-9efe153c-efa5-4a1f-9f57-d460853095a7 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:42.543748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c2b4829c-2f64-48e9-a1b1-8561a9175f6c req-9efe153c-efa5-4a1f-9f57-d460853095a7 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:42.543927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c2b4829c-2f64-48e9-a1b1-8561a9175f6c req-9efe153c-efa5-4a1f-9f57-d460853095a7 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:42.544169 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c2b4829c-2f64-48e9-a1b1-8561a9175f6c req-9efe153c-efa5-4a1f-9f57-d460853095a7 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:42.544302 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c2b4829c-2f64-48e9-a1b1-8561a9175f6c req-9efe153c-efa5-4a1f-9f57-d460853095a7 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received unexpected event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with vm_state active and task_state resize_finish.
Jun 27 04:09:42.595199 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:09:42.595199 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:09:42.595689 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:42.595996 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:42.671114 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '216588ecf8894ad5aeb6914196a090db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fed82034484f13a228c535b175c167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:09:42.691404 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: numa_topology,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:42.692200 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1132427580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-1132427580',id=27,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVt9g2d513AIYOYb6LiuPwYG6oX3C2oII3ItZ1PJ/n4MUe6a9MCUTqu9xNI2D3kplYH65gknH7G2IWBZOJr0bvELLDtyzp1751z25UlKgeFCB7JOkLCEZ2zV42L7VVOJg==',key_name='tempest-keypair-46950425',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-lmts48ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member',shelved_at='2026-06-27T04:09:38.953317',shelved_host='np0000003830',shelved_image_id='01131c66-180d-44a2-8c09-67d54f88bf62'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=30950d61-f1cd-4a81-ae4e-cce3af742f8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:09:42.692460 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:42.693044 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:42.693330 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:09:42.695088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.695088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c70b8e-76, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:42.701797 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.701797 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:42.705781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.706121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.706223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4be9a6e7-926e-4f28-b591-efb9e2478961) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:42.707154 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.707703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:42.713242 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.715151 np0000003830 nova-compute[98984]: INFO os_vif [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76')
Jun 27 04:09:42.715560 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Deleting instance files /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e_del
Jun 27 04:09:42.722433 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Deletion of /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e_del complete
Jun 27 04:09:42.745605 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:42.837017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:42.837158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:42.920915 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.949343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:42.962446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <uuid>f5611e50-86aa-420c-9f94-e13d8f80f4b0</uuid>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <name>instance-0000001d</name>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1332807486</nova:name>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:09:42</nova:creationTime>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:user uuid="b427e506578a4121bf0d008321dacac9">tempest-ServerRescueNegativeTestJSON-1862600164-project-member</nova:user>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:project uuid="7adc2502eb6e45c19f6b8646b60669f5">tempest-ServerRescueNegativeTestJSON-1862600164</nova:project>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         <nova:port uuid="d13a3de0-7db1-43f6-a996-1eb633e8717f">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <entry name="serial">f5611e50-86aa-420c-9f94-e13d8f80f4b0</entry>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <entry name="uuid">f5611e50-86aa-420c-9f94-e13d8f80f4b0</entry>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:b9:c9:99"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <target dev="tapd13a3de0-7d"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/console.log" append="off"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:43.012856 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:43.015759 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Preparing to wait for external event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:43.015759 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:43.015759 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:43.015759 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:43.015759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332807486',display_name='tempest-ServerRescueNegativeTestJSON-server-1332807486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1332807486',id=29,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-i83bwfym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:39Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=f5611e50-86aa-420c-9f94-e13d8f80f4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:43.015759 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:43.016303 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:43.016642 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:43.019235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.019438 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:43.019669 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:43.020862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.021026 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31932881-62d4-5233-8c96-60c1a91f300d', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:43.021871 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.022933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:43.026018 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.028596 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.028815 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd13a3de0-7d, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:43.029181 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd13a3de0-7d, col_values=(('qos', UUID('b529a509-95a1-49b3-9952-fb2acc2a77ff')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:43.029381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd13a3de0-7d, col_values=(('external_ids', {'iface-id': 'd13a3de0-7db1-43f6-a996-1eb633e8717f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:c9:99', 'vm-uuid': 'f5611e50-86aa-420c-9f94-e13d8f80f4b0'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:43.032549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.033652 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:43.041265 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.042509 np0000003830 nova-compute[98984]: INFO os_vif [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d')
Jun 27 04:09:43.044182 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.097462 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:09:43.125514 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:43.212286 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Successfully created port: eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:09:43.262203 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f827109-8ff5-4746-8390-5ed328b3eec9 req-09ef3693-0295-4b42-8b70-11bc4719573b service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:43.262307 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f827109-8ff5-4746-8390-5ed328b3eec9 req-09ef3693-0295-4b42-8b70-11bc4719573b service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:43.262646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f827109-8ff5-4746-8390-5ed328b3eec9 req-09ef3693-0295-4b42-8b70-11bc4719573b service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:43.262711 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f827109-8ff5-4746-8390-5ed328b3eec9 req-09ef3693-0295-4b42-8b70-11bc4719573b service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:43.262883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f827109-8ff5-4746-8390-5ed328b3eec9 req-09ef3693-0295-4b42-8b70-11bc4719573b service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Processing event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:43.273352 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00048356499996771163 future=<Future at 0x7ec54da00e00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:43.273608 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:43.273673 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.289923444000124 future=<Future at 0x7ec5384a9cd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:43.273791 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.289786493000065 future=<Future at 0x7ec5384a9cd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:43.274449 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533368.272701, 556b87cb-fbf9-4b7c-84c4-40f49005eb25 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:43.274935 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] VM Stopped (Lifecycle Event)
Jun 27 04:09:43.296054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.304877 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.308831 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.323194 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updated VIF entry in instance network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:43.323545 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap50c70b8e-76", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:43.325119 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Deleted allocations for instance 30950d61-f1cd-4a81-ae4e-cce3af742f8e
Jun 27 04:09:43.337659 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.341754 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:09:43.349100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.517690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:43.601298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:09:43.747444 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533383.7470138, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:43.747635 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Resumed (Lifecycle Event)
Jun 27 04:09:43.748945 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:09:43.752291 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance running successfully.
Jun 27 04:09:43.753668 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Failed to set time: agent not configured {{(pid=98984) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 27 04:09:43.753865 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6ada2b7-0cbc-49da-bb68-4c5490b10f3c tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] finish_migration finished successfully. {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12905}}
Jun 27 04:09:43.777931 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 556b87cb-fbf9-4b7c-84c4-40f49005eb25] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:43.832647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cc624e2-aa74-427c-a12a-a21ee4babb65 req-388a46dd-ad24-4647-99d9-974a31c767e2 service nova] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:43.833757 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:43.834326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:43.883952 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff280245-4185-47e2-9193-0aa48648b978 req-38114031-026e-4251-90f8-3fd28ccd878a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:43.884136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff280245-4185-47e2-9193-0aa48648b978 req-38114031-026e-4251-90f8-3fd28ccd878a service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:43.884335 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff280245-4185-47e2-9193-0aa48648b978 req-38114031-026e-4251-90f8-3fd28ccd878a service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:43.884735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff280245-4185-47e2-9193-0aa48648b978 req-38114031-026e-4251-90f8-3fd28ccd878a service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:43.884843 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff280245-4185-47e2-9193-0aa48648b978 req-38114031-026e-4251-90f8-3fd28ccd878a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] No waiting events found dispatching network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:43.884975 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ff280245-4185-47e2-9193-0aa48648b978 req-38114031-026e-4251-90f8-3fd28ccd878a service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received unexpected event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 for instance with vm_state shelved_offloaded and task_state None.
Jun 27 04:09:43.918358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:43.919021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:09:43.924007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:09:43.926253 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance spawned successfully.
Jun 27 04:09:43.926850 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:09:43.951623 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Successfully updated port: eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:09:44.188652 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:44.250648 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:44.258289 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:44.436522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:44.436522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:44.436522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:44.436522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:44.436522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:44.436522 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:44.453542 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:44.453784 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:44.454803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:44.454914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquired lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:44.455021 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:44.575724 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:44.575836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:44.576028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:b9:c9:99, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:44.576333 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Using config drive
Jun 27 04:09:44.611621 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:09:44.612273 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:09:44.612570 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Creating image(s)
Jun 27 04:09:44.613063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:44.613260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:44.614096 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:44.614633 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:44.618967 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:44.623878 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:44.624092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:44.624440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:44.626175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:44.626306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:44.626524 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:44.626750 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received unexpected event network-vif-plugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with vm_state resized and task_state None.
Jun 27 04:09:44.626867 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-changed-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:44.626959 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Refreshing instance network info cache due to event network-changed-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:44.627074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] Acquiring lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:44.725003 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:44.725429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:44.725905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:44.726413 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:44.729565 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:44.729911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:44.762430 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:09:44.763103 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533384.762788, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:44.763318 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Started (Lifecycle Event)
Jun 27 04:09:44.827565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:44.827945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:44.876400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk 1073741824" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:44.876917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:44.877247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:44.952708 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Took 7.48 seconds to spawn the instance on the hypervisor.
Jun 27 04:09:44.953011 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:44.964738 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:45.007612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:45.007612 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:09:45.007612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:45.091763 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:45.098411 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:09:45.105042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:45.105768 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Cannot resize image /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:09:45.106060 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:09:45.106249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Ensure instance console log exists: /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:09:45.106582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:45.106780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:45.106925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:45.270392 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:45.278734 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Creating config drive at /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config
Jun 27 04:09:45.279905 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:45.287721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3edkwsbr {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:45.338928 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3edkwsbr" returned: 0 in 0.051s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:45.348366 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:45.348756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:45.350221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:45.350422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:45.350701 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:45.350890 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state active and task_state None.
Jun 27 04:09:45.351018 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:45.351404 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:45.351661 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:45.351837 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:45.352002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:45.352164 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-37d09366-bbcd-410c-a221-5dd195c53867 req-2b624796-6c12-41cd-8ef0-75277d3456a9 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state building and task_state spawning.
Jun 27 04:09:45.355989 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:45.478745 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.644s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:45.481633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:45.486120 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.562s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:45.491843 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:45.492062 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Going to confirm migration 2 {{(pid=98984) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
Jun 27 04:09:45.496195 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Took 13.35 seconds to build instance.
Jun 27 04:09:45.499369 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:09:45.499619 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Claim successful on node np0000003830
Jun 27 04:09:45.526692 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating instance_info_cache with network_info: [{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:45.783306 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533385.78287, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:45.783399 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Started (Lifecycle Event)
Jun 27 04:09:45.789391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:45.820837 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:45.824465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:45.951938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:45.975477 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:45.978360 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.000004 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:46.011947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.876s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:46.024043 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc290e71-6873-4436-8b6c-46626ef719a4 tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.827s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:46.027214 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-00856149-ba91-4020-8a79-e72ba9ca88d7 req-bb46b9c0-c8e2-4627-8751-3556febfe373 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:46.028748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-00856149-ba91-4020-8a79-e72ba9ca88d7 req-bb46b9c0-c8e2-4627-8751-3556febfe373 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:46.031003 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Releasing lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:46.032680 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-00856149-ba91-4020-8a79-e72ba9ca88d7 req-bb46b9c0-c8e2-4627-8751-3556febfe373 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:46.033582 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance network_info: |[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:09:46.034038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] Acquired lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:46.034139 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Refreshing network info cache for port eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:46.037796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start _get_guest_xml network_info=[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:09:46.038104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-00856149-ba91-4020-8a79-e72ba9ca88d7 req-bb46b9c0-c8e2-4627-8751-3556febfe373 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:46.038817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-00856149-ba91-4020-8a79-e72ba9ca88d7 req-bb46b9c0-c8e2-4627-8751-3556febfe373 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Processing event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:46.050757 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:46.052356 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1106153631', uuid='075f803b-49f2-4084-9d8a-10d59d1c62eb'), owner=OwnerMeta(userid='216588ecf8894ad5aeb6914196a090db', username='tempest-AttachVolumeTestJSON-559471176-project-member', projectid='72fed82034484f13a228c535b175c167', projectname='tempest-AttachVolumeTestJSON-559471176'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533386.051899) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:09:46.059863 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:09:46.060364 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:09:46.063852 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:09:46.064552 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:09:46.065370 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:09:46.065864 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:09:46.066101 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:09:46.066228 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:09:46.066398 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:09:46.066590 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:09:46.066770 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:09:46.066983 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:09:46.067136 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:09:46.067303 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:09:46.067451 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:09:46.067793 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:09:46.086254 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:46.086254 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:46.087035 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:46.087836 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'pci_devices' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:46.177471 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:46.178062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:46.178192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:46.178379 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:46.178577 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'info_cache' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:46.286841 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:46.294339 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:46.540320 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <uuid>075f803b-49f2-4084-9d8a-10d59d1c62eb</uuid>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <name>instance-0000001e</name>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeTestJSON-server-1106153631</nova:name>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:09:46</nova:creationTime>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:user uuid="216588ecf8894ad5aeb6914196a090db">tempest-AttachVolumeTestJSON-559471176-project-member</nova:user>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:project uuid="72fed82034484f13a228c535b175c167">tempest-AttachVolumeTestJSON-559471176</nova:project>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         <nova:port uuid="eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <entry name="serial">075f803b-49f2-4084-9d8a-10d59d1c62eb</entry>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <entry name="uuid">075f803b-49f2-4084-9d8a-10d59d1c62eb</entry>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fd:3a:c2"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <target dev="tapeef0b1e2-12"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/console.log" append="off"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Preparing to wait for external event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:46.593665 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:46.598405 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:46.598405 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:46.598405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.598405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:46.598617 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:46.601608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.602280 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7daec925-7a62-5e1b-8d4e-a09dd2bb2453', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:46.612647 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.613912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:46.616560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.616560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeef0b1e2-12, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:46.617777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeef0b1e2-12, col_values=(('qos', UUID('a45a01e0-56ff-457f-9ce8-faaad427179e')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:46.617777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeef0b1e2-12, col_values=(('external_ids', {'iface-id': 'eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:3a:c2', 'vm-uuid': '075f803b-49f2-4084-9d8a-10d59d1c62eb'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:46.620747 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.620747 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:46.626683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:46.627273 np0000003830 nova-compute[98984]: INFO os_vif [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12')
Jun 27 04:09:46.803963 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533386.8020067, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:46.803963 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Paused (Lifecycle Event)
Jun 27 04:09:46.842261 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:09:46.847598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:09:46.852740 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance spawned successfully.
Jun 27 04:09:46.853251 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:09:46.996159 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:09:47.003119 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:47.185815 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updated VIF entry in instance network info cache for port eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:47.186672 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating instance_info_cache with network_info: [{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:47.192452 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:47.306414 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:47.309462 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533387.309009, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:47.309660 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Resumed (Lifecycle Event)
Jun 27 04:09:47.342701 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:47.342991 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:47.360880 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:47.361080 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:47.361676 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:47.362158 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:47.362341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:47.362800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:47.564304 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0006279009999161644 future=<Future at 0x7ec5384a9cd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:47.564475 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:47.565053 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Emitting event <LifecycleEvent: 1782533372.5634823, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:47.565302 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Stopped (Lifecycle Event)
Jun 27 04:09:47.626143 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:47.690219 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7328336b-9b8c-4c54-891a-dbfb8874bfc1 req-583d62a6-e4e8-4b76-a77b-baa321f2c203 service nova] Releasing lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:47.785179 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:47.812328 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:47.814511 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:47.845905 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:47.868657 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Took 7.69 seconds to spawn the instance on the hypervisor.
Jun 27 04:09:47.868803 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:48.068639 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d9982f78-a1e7-4d5f-9648-5dc4f075824b tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:48.071032 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d74ed6d9-aa10-4be9-9f46-b180716ef2d8 req-73f097b4-9836-4659-8f55-03773ad25627 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:48.071032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d74ed6d9-aa10-4be9-9f46-b180716ef2d8 req-73f097b4-9836-4659-8f55-03773ad25627 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:48.071032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d74ed6d9-aa10-4be9-9f46-b180716ef2d8 req-73f097b4-9836-4659-8f55-03773ad25627 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:48.071032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d74ed6d9-aa10-4be9-9f46-b180716ef2d8 req-73f097b4-9836-4659-8f55-03773ad25627 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:48.071032 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d74ed6d9-aa10-4be9-9f46-b180716ef2d8 req-73f097b4-9836-4659-8f55-03773ad25627 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:48.072187 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d74ed6d9-aa10-4be9-9f46-b180716ef2d8 req-73f097b4-9836-4659-8f55-03773ad25627 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state active and task_state None.
Jun 27 04:09:48.155904 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:48.156110 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:48.156275 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:fd:3a:c2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:48.156936 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Using config drive
Jun 27 04:09:48.287426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:48.287659 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'migration_context' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:48.317591 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533388.3172412, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:48.317987 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] VM Started (Lifecycle Event)
Jun 27 04:09:48.358068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.879s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:48.359977 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:09:48.380675 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Took 15.72 seconds to build instance.
Jun 27 04:09:48.450108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:48.450261 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:48.450433 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Unshelving
Jun 27 04:09:48.664337 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:48.790311 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Object Instance<e52a57a3-19dd-482d-bd3a-20e3a5230c4e> lazy-loaded attributes: info_cache,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:48.800094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:48.800094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:48.820717 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:48.822885 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:48.854771 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Creating config drive at /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config
Jun 27 04:09:48.861123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8ejsurbm {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:48.886267 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.233s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:48.890035 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:09:48.890035 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:09:48.890692 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:48.891078 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:48.919960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8ejsurbm" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:48.990201 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5936c57c39c4c6d8da18fb52cc1b214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f8cbfe84ce4a48938255e422c7159b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:09:49.202709 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.326143 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533389.3257282, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:49.326702 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] VM Paused (Lifecycle Event)
Jun 27 04:09:49.394913 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:09:49.475484 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.490846 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.519249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.520487 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.531541 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:49.600933 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Rescuing
Jun 27 04:09:49.601080 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:49.601189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:49.601464 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:49.623308 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Successfully created port: d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:09:49.648831 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.829074 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:49.832520 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533389.8320732, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:49.832652 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] VM Resumed (Lifecycle Event)
Jun 27 04:09:49.898561 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:09:49.920337 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1ea19c23-7037-43b2-8cee-b80c9f57c62c req-9c92e91c-756a-4f1d-b7d2-d5f98fb21143 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:49.920337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1ea19c23-7037-43b2-8cee-b80c9f57c62c req-9c92e91c-756a-4f1d-b7d2-d5f98fb21143 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:49.920976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1ea19c23-7037-43b2-8cee-b80c9f57c62c req-9c92e91c-756a-4f1d-b7d2-d5f98fb21143 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:49.920976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1ea19c23-7037-43b2-8cee-b80c9f57c62c req-9c92e91c-756a-4f1d-b7d2-d5f98fb21143 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:49.920976 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1ea19c23-7037-43b2-8cee-b80c9f57c62c req-9c92e91c-756a-4f1d-b7d2-d5f98fb21143 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Processing event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:09:49.948033 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.980700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:49.985786 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:50.112373 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:50.192283 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:50.192487 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:50.337329 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:50.349130 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:50.404234 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Booting with volume d56c54f1-0697-4663-b94a-eb058da0b44f at /dev/vda
Jun 27 04:09:50.461377 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:50.481228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:09:50.510350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:50.538379 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:50.546483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:09:50.552735 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:09:50.557248 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance spawned successfully.
Jun 27 04:09:50.559942 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:09:50.568250 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:09:50.569755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:09:50.584302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:09:50.586562 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:febe:7e7', 'fe80::fc16:3eff:fe7e:c31', 'fe80::fc16:3eff:febd:6e54', 'fe80::5c7e:41ff:fed9:c369', 'fe80::fc16:3eff:fe79:e596', 'fe80::fc16:3eff:febc:40a2', 'fe80::fc16:3eff:fe2a:39', 'fe80::fc16:3eff:fe98:b9a3', 'fe80::e0ca:11ff:fee7:50a7', 'fe80::6cbd:96ff:fec2:6718', 'fe80::fc16:3eff:fe56:2462', 'fe80::fc16:3eff:fed0:ca33', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c'] 
Jun 27 04:09:50.586562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:09:50.586562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:09:50.586808 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:50.587135 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating existing volume attachment record: 65f408be-45db-497f-a41c-4e66dab70abe {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:09:50.681605 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Successfully updated port: d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:09:50.695976 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:50.763263 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Updating instance_info_cache with network_info: [{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:50.852213 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] During sync_power_state the instance has a pending task (rescuing). Skip.
Jun 27 04:09:50.852613 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533390.8523753, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:50.852783 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Started (Lifecycle Event)
Jun 27 04:09:51.072462 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:51.072647 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:51.072890 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:51.073123 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:51.073437 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:51.073799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:09:51.183998 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:51.184098 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquired lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:51.184230 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:51.265774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-f5611e50-86aa-420c-9f94-e13d8f80f4b0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:51.356025 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:51.358934 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:51.578707 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Took 6.97 seconds to spawn the instance on the hypervisor.
Jun 27 04:09:51.578893 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:51.619084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:51.712905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.913s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:51.717040 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.182s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:51.721853 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'pci_requests' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:51.779550 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:09:51.864915 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:09:51.865524 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533391.864992, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:51.865524 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Paused (Lifecycle Event)
Jun 27 04:09:51.987038 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:52.010370 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:52.010370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:52.010370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:52.010370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:52.010370 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:52.010591 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state active and task_state None.
Jun 27 04:09:52.010704 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:52.010857 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing instance network info cache due to event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:52.011640 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] Acquiring lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:52.087945 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Took 16.89 seconds to build instance.
Jun 27 04:09:52.156306 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:52.231809 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'numa_topology' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:52.365520 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocation for migration fe0da4ab-e68d-4a68-89ea-527da568c577
Jun 27 04:09:52.369622 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:52.373415 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533392.3719265, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:09:52.373415 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Resumed (Lifecycle Event)
Jun 27 04:09:52.590352 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1c2286e7-eee6-4c53-9cfe-7cbb4cb0d11d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.396s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:52.658585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Releasing lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:52.658922 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Instance network_info: |[{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:09:52.659299 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] Acquired lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:52.659571 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:52.738521 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:09:52.742202 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:09:52.742456 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:09:52.742719 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Claim successful on node np0000003830
Jun 27 04:09:52.744742 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Creating image(s)
Jun 27 04:09:52.745087 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:09:52.745215 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Ensure instance console log exists: /opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:09:52.745457 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:52.745641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:52.745748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:52.746182 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Start _get_guest_xml network_info=[{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '65f408be-45db-497f-a41c-4e66dab70abe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5a289016-ec72-454c-aec8-e92b65727e16', 'attached_at': '', 'detached_at': '', 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'serial': 'd56c54f1-0697-4663-b94a-eb058da0b44f'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:09:52.748035 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:52.749285 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-141774026', uuid='5a289016-ec72-454c-aec8-e92b65727e16'), owner=OwnerMeta(userid='f5936c57c39c4c6d8da18fb52cc1b214', username='tempest-TestInstancesWithCinderVolumes-76740034-project-member', projectid='f8f8cbfe84ce4a48938255e422c7159b', projectname='tempest-TestInstancesWithCinderVolumes-76740034'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533392.7487326) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:09:52.752085 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:09:52.752679 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:09:52.753429 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:09:52.753513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:09:52.754356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:09:52.754619 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:09:52.754748 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:09:52.754885 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:09:52.755046 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:09:52.755169 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:09:52.755268 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:09:52.755436 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:09:52.755567 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:09:52.756001 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:09:52.756001 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:09:52.756001 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:09:52.767622 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:09:52.768037 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:09:52.769020 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:52.770083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:52.770651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:09:52.785024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:52.785443 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:52.785873 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:09:52.786486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:09:52.787001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:09:52.787187 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:09:52.799933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:09:52.799933 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:52.811339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:09:52.811339 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f] added
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:09:52.819537 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:09:52.819885 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f] added
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:09:52.824631 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:52.825214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:09:52.825214 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:09:52.825280 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:09:52.871903 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bf6e4312-7ab4-40bd-837b-869263dc9eba tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.390s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:52.876864 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:09:52.885076 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:09:52.923789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:52.931613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:52.965241 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:53.154599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:53.162386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:53.165179 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:53.216354 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ab300bfd-e8ec-4b9c-8850-ceef4f673cb3 req-1ff3c369-c666-470c-a366-d1341e6e454a service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:53.218556 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab300bfd-e8ec-4b9c-8850-ceef4f673cb3 req-1ff3c369-c666-470c-a366-d1341e6e454a service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:53.218556 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab300bfd-e8ec-4b9c-8850-ceef4f673cb3 req-1ff3c369-c666-470c-a366-d1341e6e454a service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:53.218556 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ab300bfd-e8ec-4b9c-8850-ceef4f673cb3 req-1ff3c369-c666-470c-a366-d1341e6e454a service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:53.218556 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ab300bfd-e8ec-4b9c-8850-ceef4f673cb3 req-1ff3c369-c666-470c-a366-d1341e6e454a service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:53.218556 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ab300bfd-e8ec-4b9c-8850-ceef4f673cb3 req-1ff3c369-c666-470c-a366-d1341e6e454a service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state active and task_state rescuing.
Jun 27 04:09:53.262297 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance destroyed successfully.
Jun 27 04:09:53.266825 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'numa_topology' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:53.388335 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99964627700001 future=<Future at 0x7ec5187bbd40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:53.389078 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998881736000158 future=<Future at 0x7ec5187bbd40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:53.389238 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998686805000034 future=<Future at 0x7ec5187bbd40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:09:53.605913 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:53.744846 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-changed-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:53.745405 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Refreshing instance network info cache due to event network-changed-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:53.745604 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] Acquiring lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:53.745688 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] Acquired lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:53.745833 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Refreshing network info cache for port eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:53.775167 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Attempting rescue
Jun 27 04:09:53.775787 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98984) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 27 04:09:53.780145 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:09:53.780272 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Creating image(s)
Jun 27 04:09:53.780981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:53.781123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:53.781646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:53.782222 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:53.793936 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updated VIF entry in instance network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:53.794552 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:53.820223 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:09:53.825724 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:53.836640 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:09:53.842745 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.856017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.866180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.891143 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.892383 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.900426 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.900714 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:53.948206 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.40.100,3260]
Jun 27 04:09:53.948206 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.40.100,3260] successful.
Jun 27 04:09:53.948206 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.955200 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.50.100,3260]
Jun 27 04:09:53.955200 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.50.100,3260] successful.
Jun 27 04:09:53.955200 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.963214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.978486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:53.990179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:53.992208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] HCTL ('11', '-', '-', 0) found on session 61 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:53.992208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:54.004628 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:09:54.005154 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:09:54.006462 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:54.006462 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:09:54.007341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] HCTL ('12', '-', '-', 0) found on session 62 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:09:54.007545 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:09:54.010195 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 61 and hctl ['11', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:54.037774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 62 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:54.038061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:54.205724 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:54.248690 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:54.283978 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:54.285563 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:54.292054 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:54.296652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:54.296652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:54.297146 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:54.299376 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88053e35-7179-48c4-ba46-43761c04bb48 req-8b8ee6e9-eceb-49de-a6ab-fedfb68c89b9 service nova] Releasing lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:54.302133 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:09:54.303031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:54.347787 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:54.350288 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing instance network info cache due to event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:54.350988 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:54.351562 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:54.354689 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:54.412756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:54.413333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:54.497911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:54.499710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:54.501397 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'migration_context' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:54.638828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:09:54.639054 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:09:54.806666 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:54.858578 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:54.991983 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updated VIF entry in instance network info cache for port eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:54.992319 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating instance_info_cache with network_info: [{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:55.003423 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:55.003726 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:09:55.004722 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Start _get_guest_xml network_info=[{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:b9:c9:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:09:55.004959 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'resources' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:55.010820 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 61 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:09:55.011004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:09:55.142721 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:09:55.229952 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:55.286028 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-74fa2938-808e-4a56-9949-8966bab059e4 req-1515e5df-e4c1-432d-bb14-15182b3d76b2 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:55.287049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-74fa2938-808e-4a56-9949-8966bab059e4 req-1515e5df-e4c1-432d-bb14-15182b3d76b2 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:55.287049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-74fa2938-808e-4a56-9949-8966bab059e4 req-1515e5df-e4c1-432d-bb14-15182b3d76b2 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:55.287049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-74fa2938-808e-4a56-9949-8966bab059e4 req-1515e5df-e4c1-432d-bb14-15182b3d76b2 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:55.287049 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-74fa2938-808e-4a56-9949-8966bab059e4 req-1515e5df-e4c1-432d-bb14-15182b3d76b2 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:09:55.287258 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-74fa2938-808e-4a56-9949-8966bab059e4 req-1515e5df-e4c1-432d-bb14-15182b3d76b2 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state active and task_state rescuing.
Jun 27 04:09:55.389250 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updated VIF entry in instance network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:55.389548 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:55.495031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bb9c0110-94bf-4e83-810a-ce2cc384724f req-72011a4e-8cd0-4e63-9af9-36884a301966 service nova] Releasing lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:55.507067 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:55.509864 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:09:55.511594 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1332807486', uuid='f5611e50-86aa-420c-9f94-e13d8f80f4b0'), owner=OwnerMeta(userid='b427e506578a4121bf0d008321dacac9', username='tempest-ServerRescueNegativeTestJSON-1862600164-project-member', projectid='7adc2502eb6e45c19f6b8646b60669f5', projectname='tempest-ServerRescueNegativeTestJSON-1862600164'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:b9:c9:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533395.511205) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:09:55.512644 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:09:55.513029 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:09:55.513953 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:09:55.514149 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:09:55.515089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:09:55.515432 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:09:55.515632 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:09:55.515764 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:09:55.516047 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:09:55.516171 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:09:55.516309 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:09:55.516505 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:09:55.516658 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:09:55.516807 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:09:55.516971 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:09:55.517143 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:09:55.517337 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:55.654526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.939s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:55.654526 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:55.744719 np0000003830 nova-compute[98984]: INFO nova.network.neutron [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating port 50c70b8e-7688-43e8-a450-c35d577448e4 with attributes {'binding:host_id': 'np0000003830', 'device_owner': 'compute:nova'}
Jun 27 04:09:55.808420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found WWN 3300000008322aa1f for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:09:55.808886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:09:55.809119 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000008322aa1f', 'path': '/dev/dm-2', 'multipath_id': '3300000008322aa1f'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:09:55.809226 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008322aa1f', 'path': '/dev/dm-2', 'multipath_id': '3300000008322aa1f'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:09:55.892386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0094e8b7-75f6-4ad9-b5af-8b5d583e9b40 req-3a73bd03-2e2e-484f-a8eb-09476c2f4497 service nova] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:56.019474 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:56.030746 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332807486',display_name='tempest-ServerRescueNegativeTestJSON-server-1332807486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1332807486',id=29,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:47Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-i83bwfym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:48Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=f5611e50-86aa-420c-9f94-e13d8f80f4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:b9:c9:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:56.030998 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:b9:c9:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:56.031549 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:56.032232 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'pci_devices' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:56.315269 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-141774026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testinstanceswithcindervolumes-server-141774026',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRn1mQCDv4XoqU/h+IFCbbSSuBLTGJCJL7Ib2TqC+BBDt/R/vtfwLy57/1UEDA1XrqwgHNKBTtbovTsoEHAt0fHCDKKc0q/cqFgxMChq5D2hQ1FgB0SruTJf1YrWFBoDw==',key_name='tempest-TestInstancesWithCinderVolumes-37772236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8f8cbfe84ce4a48938255e422c7159b',ramdisk_id='',reservation_id='r-w9mhez4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-76740034',owner_user_name='tempest-TestInstancesWithCinderVolumes-76740034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:50Z,user_data=None,user_id='f5936c57c39c4c6d8da18fb52cc1b214',uuid=5a289016-ec72-454c-aec8-e92b65727e16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:09:56.315513 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Converting VIF {"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:56.316414 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:56.317169 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:56.391284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:56.391452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:56.391722 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:09:56.412735 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-changed-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:56.412735 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing instance network info cache due to event network-changed-5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:56.412735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:56.412735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:56.412735 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:56.534388 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <uuid>f5611e50-86aa-420c-9f94-e13d8f80f4b0</uuid>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <name>instance-0000001d</name>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1332807486</nova:name>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:09:55</nova:creationTime>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:user uuid="b427e506578a4121bf0d008321dacac9">tempest-ServerRescueNegativeTestJSON-1862600164-project-member</nova:user>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:project uuid="7adc2502eb6e45c19f6b8646b60669f5">tempest-ServerRescueNegativeTestJSON-1862600164</nova:project>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         <nova:port uuid="d13a3de0-7db1-43f6-a996-1eb633e8717f">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <entry name="serial">f5611e50-86aa-420c-9f94-e13d8f80f4b0</entry>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <entry name="uuid">f5611e50-86aa-420c-9f94-e13d8f80f4b0</entry>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config.rescue"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:b9:c9:99"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <target dev="tapd13a3de0-7d"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/console.log" append="off"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:56.535688 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:56.540186 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance destroyed successfully.
Jun 27 04:09:56.631608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <uuid>5a289016-ec72-454c-aec8-e92b65727e16</uuid>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <name>instance-0000001f</name>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-141774026</nova:name>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:09:52</nova:creationTime>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:properties/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:user uuid="f5936c57c39c4c6d8da18fb52cc1b214">tempest-TestInstancesWithCinderVolumes-76740034-project-member</nova:user>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:project uuid="f8f8cbfe84ce4a48938255e422c7159b">tempest-TestInstancesWithCinderVolumes-76740034</nova:project>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         <nova:port uuid="d070e5cd-599a-4462-a0e7-1480f6bcb3c0">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <entry name="serial">5a289016-ec72-454c-aec8-e92b65727e16</entry>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <entry name="uuid">5a289016-ec72-454c-aec8-e92b65727e16</entry>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16/disk.config"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <alias name="ua-d56c54f1-0697-4663-b94a-eb058da0b44f"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <serial>d56c54f1-0697-4663-b94a-eb058da0b44f</serial>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:97:a8:ba"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <target dev="tapd070e5cd-59"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16/console.log" append="off"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:09:56.820024 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Preparing to wait for external event network-vif-plugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-141774026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testinstanceswithcindervolumes-server-141774026',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRn1mQCDv4XoqU/h+IFCbbSSuBLTGJCJL7Ib2TqC+BBDt/R/vtfwLy57/1UEDA1XrqwgHNKBTtbovTsoEHAt0fHCDKKc0q/cqFgxMChq5D2hQ1FgB0SruTJf1YrWFBoDw==',key_name='tempest-TestInstancesWithCinderVolumes-37772236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8f8cbfe84ce4a48938255e422c7159b',ramdisk_id='',reservation_id='r-w9mhez4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-76740034',owner_user_name='tempest-TestInstancesWithCinderVolumes-76740034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:50Z,user_data=None,user_id='f5936c57c39c4c6d8da18fb52cc1b214',uuid=5a289016-ec72-454c-aec8-e92b65727e16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Converting VIF {"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:09:56.823118 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:09:56.825589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.825872 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:56.826162 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:09:56.827302 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.827456 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0776e759-6adf-5e62-8fef-f94b07deb6f3', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:56.829925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.830789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:56.836788 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.839396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.839685 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd070e5cd-59, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:56.840153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd070e5cd-59, col_values=(('qos', UUID('c4206168-7369-43aa-90a4-aba4fa322633')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:56.840383 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd070e5cd-59, col_values=(('external_ids', {'iface-id': 'd070e5cd-599a-4462-a0e7-1480f6bcb3c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:a8:ba', 'vm-uuid': '5a289016-ec72-454c-aec8-e92b65727e16'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:09:56.841470 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.842952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:09:56.855343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:56.855826 np0000003830 nova-compute[98984]: INFO os_vif [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59')
Jun 27 04:09:56.893824 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:56.916521 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:57.353278 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:57.358383 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:57.532464 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:57.555416 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updated VIF entry in instance network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:57.556242 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:58.035010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:58.036487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:09:58.036941 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Creating image(s)
Jun 27 04:09:58.039361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:58.039361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:58.040049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:09:58.040266 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'trusted_certs' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:58.058364 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-59377a58-20c5-4a5c-a888-3ecf49a790d7 req-3380b014-92e8-4be8-ba65-d140e9dce667 service nova] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:09:58.068201 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:58.068318 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:58.068933 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:58.068933 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:b9:c9:99, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:58.069173 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Using config drive
Jun 27 04:09:58.376190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:58.376383 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:09:58.376451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No VIF found with MAC fa:16:3e:97:a8:ba, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:09:58.380117 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Using config drive
Jun 27 04:09:58.484289 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:09:58.489229 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing instance network info cache due to event network-changed-50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:09:58.489229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] Acquiring lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:09:58.489229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] Acquired lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:09:58.489229 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Refreshing network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:09:58.542254 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:58.542558 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "c84d84584386333f2d202509e03c33f94356d3c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:09:58.553521 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "c84d84584386333f2d202509e03c33f94356d3c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:09:58.572538 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'ec2_ids' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:58.887762 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:58.987482 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:59.075969 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:59.076160 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'keypairs' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:09:59.189914 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Creating config drive at /opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16/disk.config
Jun 27 04:09:59.202773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj4cxeszz {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:59.220227 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:59.260901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj4cxeszz" returned: 0 in 0.058s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:59.530242 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:59.580177 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<f5611e50-86aa-420c-9f94-e13d8f80f4b0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:09:59.585555 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:09:59.757359 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updated VIF entry in instance network info cache for port 50c70b8e-7688-43e8-a450-c35d577448e4. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:09:59.760823 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Creating config drive at /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config.rescue
Jun 27 04:09:59.765174 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:09:59.778809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp15camz5e {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:09:59.831926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp15camz5e" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:09:59.853209 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:59.896600 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:09:59.905285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.108385 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.171289 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:00.175278 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:00.175685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:00.258543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.265519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a6141281-6d3e-4b71-a309-57b5123ad652 req-8fc41798-69ea-49cd-9bff-92dcf2a7253f service nova] Releasing lock "refresh_cache-30950d61-f1cd-4a81-ae4e-cce3af742f8e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:00.273050 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.279422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.part --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:00.279789 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] 01131c66-180d-44a2-8c09-67d54f88bf62 was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:10:00.280752 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:10:00.281016 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.part /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:00.301888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.527525 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.552185 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-plugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:00.553466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:00.553737 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:00.553902 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:00.554070 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Processing event network-vif-plugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:10:00.554288 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-plugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:00.554455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:00.554805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:00.556239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:00.556443 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] No waiting events found dispatching network-vif-plugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:00.559108 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-dcbd2497-aa19-47d4-91d4-2b89dc39fc57 req-69ddc420-0f9e-489a-aa13-462ea7090639 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received unexpected event network-vif-plugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 for instance with vm_state building and task_state spawning.
Jun 27 04:10:00.565374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.577604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.658188 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.705233 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.705233 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:00.799724 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2708285f-1642-4967-a7d7-357eff13d5be req-44d8786f-22c2-4c00-b406-a62684e78400 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:00.799724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2708285f-1642-4967-a7d7-357eff13d5be req-44d8786f-22c2-4c00-b406-a62684e78400 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:00.799724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2708285f-1642-4967-a7d7-357eff13d5be req-44d8786f-22c2-4c00-b406-a62684e78400 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:00.800026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2708285f-1642-4967-a7d7-357eff13d5be req-44d8786f-22c2-4c00-b406-a62684e78400 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:00.800026 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2708285f-1642-4967-a7d7-357eff13d5be req-44d8786f-22c2-4c00-b406-a62684e78400 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:00.800165 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2708285f-1642-4967-a7d7-357eff13d5be req-44d8786f-22c2-4c00-b406-a62684e78400 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state active and task_state rescuing.
Jun 27 04:10:01.228576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.part /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.converted" returned: 0 in 0.947s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:01.246744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:01.378645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:01.381783 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "c84d84584386333f2d202509e03c33f94356d3c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.838s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:01.386606 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:01.394018 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:01.394992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:01.510159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8 --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:01.511022 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "c84d84584386333f2d202509e03c33f94356d3c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:01.511760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "c84d84584386333f2d202509e03c33f94356d3c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:01.512529 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:01.517416 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:01.517916 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:01.642071 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8 --force-share --output=json" returned: 0 in 0.124s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:01.642688 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8,backing_fmt=raw /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:01.662013 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533401.6606476, 5a289016-ec72-454c-aec8-e92b65727e16 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:01.662714 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] VM Started (Lifecycle Event)
Jun 27 04:10:01.667443 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:10:01.675081 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:10:01.701391 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Instance spawned successfully.
Jun 27 04:10:01.701391 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:10:01.715466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8,backing_fmt=raw /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk 1073741824" returned: 0 in 0.073s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:01.716006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "c84d84584386333f2d202509e03c33f94356d3c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:01.716751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:01.824645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c84d84584386333f2d202509e03c33f94356d3c8 --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:01.825842 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'migration_context' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:01.844532 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:01.871106 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-517c0046-9859-4b38-bd84-49ef6a27e7c4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:02.170341 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:02.177377 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:02.209455 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:02.209672 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:02.210117 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:02.213306 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:02.213306 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:02.213306 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:02.331217 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:02.332401 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Rebasing disk image.
Jun 27 04:10:02.333218 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:02.428013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:02.428450 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 -F raw /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:02.475321 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:02.475321 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:02.477676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:02.478295 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:02.478295 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:02.485877 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Terminating instance
Jun 27 04:10:02.680881 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:10:02.681449 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533402.6811247, 5a289016-ec72-454c-aec8-e92b65727e16 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:02.681640 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] VM Paused (Lifecycle Event)
Jun 27 04:10:02.719663 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Took 9.98 seconds to spawn the instance on the hypervisor.
Jun 27 04:10:02.719663 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:02.872611 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-96204021-7d58-4fcc-81b3-375ac2bb679d req-5bc9aebf-79ef-422c-b493-af5c045d3c00 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:02.879282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96204021-7d58-4fcc-81b3-375ac2bb679d req-5bc9aebf-79ef-422c-b493-af5c045d3c00 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:02.879282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96204021-7d58-4fcc-81b3-375ac2bb679d req-5bc9aebf-79ef-422c-b493-af5c045d3c00 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:02.879282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96204021-7d58-4fcc-81b3-375ac2bb679d req-5bc9aebf-79ef-422c-b493-af5c045d3c00 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:02.879282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-96204021-7d58-4fcc-81b3-375ac2bb679d req-5bc9aebf-79ef-422c-b493-af5c045d3c00 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:02.879282 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-96204021-7d58-4fcc-81b3-375ac2bb679d req-5bc9aebf-79ef-422c-b493-af5c045d3c00 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state rescued and task_state None.
Jun 27 04:10:02.994450 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:10:03.050458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.060726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.097663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.132460 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.148404 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.155932 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.185516 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:03.197200 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533403.1943483, 5a289016-ec72-454c-aec8-e92b65727e16 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:03.197200 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] VM Resumed (Lifecycle Event)
Jun 27 04:10:03.233325 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Took 19.38 seconds to build instance.
Jun 27 04:10:03.295805 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.356817 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.400356 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a325a172-0b4e-4f0f-92a8-faff17365414 req-b1ed0109-c41a-4e78-830f-19ba84cd22cf service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:03.400356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a325a172-0b4e-4f0f-92a8-faff17365414 req-b1ed0109-c41a-4e78-830f-19ba84cd22cf service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:03.400568 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a325a172-0b4e-4f0f-92a8-faff17365414 req-b1ed0109-c41a-4e78-830f-19ba84cd22cf service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:03.401189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a325a172-0b4e-4f0f-92a8-faff17365414 req-b1ed0109-c41a-4e78-830f-19ba84cd22cf service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:03.402818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a325a172-0b4e-4f0f-92a8-faff17365414 req-b1ed0109-c41a-4e78-830f-19ba84cd22cf service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:03.402818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a325a172-0b4e-4f0f-92a8-faff17365414 req-b1ed0109-c41a-4e78-830f-19ba84cd22cf service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:03.441319 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.500573 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.575340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.703313 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:03.712533 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ca7a4ba-55a2-426f-9bc2-4694692301d1 req-97aa0fdb-2a9c-4ea9-80a7-21b208629b5a service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:03.715129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ca7a4ba-55a2-426f-9bc2-4694692301d1 req-97aa0fdb-2a9c-4ea9-80a7-21b208629b5a service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:03.715129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ca7a4ba-55a2-426f-9bc2-4694692301d1 req-97aa0fdb-2a9c-4ea9-80a7-21b208629b5a service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:03.715129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ca7a4ba-55a2-426f-9bc2-4694692301d1 req-97aa0fdb-2a9c-4ea9-80a7-21b208629b5a service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:03.715129 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ca7a4ba-55a2-426f-9bc2-4694692301d1 req-97aa0fdb-2a9c-4ea9-80a7-21b208629b5a service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:03.715129 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ca7a4ba-55a2-426f-9bc2-4694692301d1 req-97aa0fdb-2a9c-4ea9-80a7-21b208629b5a service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-5029793a-13f5-48f3-8d7a-a8076718daaa for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:03.732172 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:03.735201 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.742060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.905s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:03.760718 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Instance destroyed successfully.
Jun 27 04:10:03.763670 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lazy-loading 'resources' on Instance uuid 6897732e-ea7e-4359-802b-42ded626f5b4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:03.763670 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:03.812581 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.110638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 -F raw /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk" returned: 0 in 1.682s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:04.111062 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:10:04.111300 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Ensure instance console log exists: /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:10:04.111587 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:04.112381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:04.112674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:04.114595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Start _get_guest_xml network_info=[{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='28d86ffde0a5a18250bfc391f6435beb',container_format='bare',created_at=2026-06-27T04:09:31Z,direct_url=<?>,disk_format='qcow2',id=01131c66-180d-44a2-8c09-67d54f88bf62,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1132427580-shelved',owner='469d72ff5a3640dbb2193b8a91deeac0',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-06-27T04:09:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:10:04.119695 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:04.121796 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1132427580', uuid='30950d61-f1cd-4a81-ae4e-cce3af742f8e'), owner=OwnerMeta(userid='a996571fb63c4c6e993f1fa02549a086', username='tempest-AttachVolumeShelveTestJSON-1443827218-project-member', projectid='469d72ff5a3640dbb2193b8a91deeac0', projectname='tempest-AttachVolumeShelveTestJSON-1443827218'), image=ImageMeta(id='01131c66-180d-44a2-8c09-67d54f88bf62', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533404.1208317) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:10:04.128707 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:10:04.128707 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:10:04.134604 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:10:04.134604 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:10:04.136798 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:10:04.137116 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='28d86ffde0a5a18250bfc391f6435beb',container_format='bare',created_at=2026-06-27T04:09:31Z,direct_url=<?>,disk_format='qcow2',id=01131c66-180d-44a2-8c09-67d54f88bf62,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1132427580-shelved',owner='469d72ff5a3640dbb2193b8a91deeac0',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-06-27T04:09:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:10:04.137622 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:10:04.137622 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:10:04.137622 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:10:04.137622 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:10:04.138090 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:10:04.138090 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:10:04.138090 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:10:04.139578 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:10:04.139578 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:10:04.139578 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:10:04.139578 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'vcpu_model' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:04.220423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.242061 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for f5611e50-86aa-420c-9f94-e13d8f80f4b0 due to new event <LifecycleEvent: 1782533404.241418, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:10:04.242490 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533404.241418, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:04.243404 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] VM Resumed (Lifecycle Event)
Jun 27 04:10:04.272058 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.272058 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "address": "fa:16:3e:be:07:e7", "network": {"id": "bfbd2a16-73b8-497f-a125-61049045f40f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-216111308-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc7b6e7c-8e", "ovs_interfaceid": "cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.272058 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.272792 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.276132 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.276829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc7b6e7c-8e, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.278579 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.279757 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.319261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.320879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.321112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8de3faf-7827-49b7-95d6-46822f4a35f1) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.322977 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.323559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.357552 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.362875 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:07:e7,bridge_name='br-int',has_traffic_filtering=True,id=cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40,network=Network(bfbd2a16-73b8-497f-a125-61049045f40f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc7b6e7c-8e')
Jun 27 04:10:04.362875 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.362875 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "address": "fa:16:3e:7e:0c:31", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e90d26-f0", "ovs_interfaceid": "52e90d26-f0a7-4397-8a28-8ba0e675e834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.362875 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.362875 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.363193 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.363550 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e90d26-f0, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.364739 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.367717 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.395444 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.396860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.397111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55c31892-3092-4771-865f-76fb3eabd16d) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.397856 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.398389 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.427801 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.432632 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:0c:31,bridge_name='br-int',has_traffic_filtering=True,id=52e90d26-f0a7-4397-8a28-8ba0e675e834,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap52e90d26-f0')
Jun 27 04:10:04.435750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.435750 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "23658b37-4049-4577-9e1f-487c0e385129", "address": "fa:16:3e:bd:6e:54", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23658b37-40", "ovs_interfaceid": "23658b37-4049-4577-9e1f-487c0e385129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.435750 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.435750 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.437374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.437646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23658b37-40, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.438730 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.439703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.464660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.469756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.469756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19811c3f-0ac3-49ef-a96f-b9103b88da2c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.469756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.469756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.494980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.499246 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:6e:54,bridge_name='br-int',has_traffic_filtering=True,id=23658b37-4049-4577-9e1f-487c0e385129,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23658b37-40')
Jun 27 04:10:04.499459 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.499637 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "address": "fa:16:3e:79:e5:96", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40af7eec-8f", "ovs_interfaceid": "40af7eec-8fb8-464e-85a4-12ed12c5f6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.500204 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.500465 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.502871 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.503091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40af7eec-8f, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.504938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.505869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.531796 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.533443 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.533680 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50ed7219-3e13-4c98-ace2-6fe13b563660) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.534318 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.535008 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.556259 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.559005 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:e5:96,bridge_name='br-int',has_traffic_filtering=True,id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40af7eec-8f')
Jun 27 04:10:04.560086 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.560288 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "address": "fa:16:3e:bc:40:a2", "network": {"id": "18b09209-8a51-4152-8774-6cb0b9bb9f16", "bridge": "br-int", "label": "tempest-device-tagging-net1-1421682312", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f4f675d-52", "ovs_interfaceid": "1f4f675d-527d-4e2e-8610-0652a7a5f7c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.560899 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.561089 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.563483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.563736 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f4f675d-52, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.565218 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.567318 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.578792 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.579857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.580026 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=403a83b5-93dd-4d20-ae67-4fb24a709fb7) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.580681 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.581234 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.594539 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.598171 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:40:a2,bridge_name='br-int',has_traffic_filtering=True,id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5,network=Network(18b09209-8a51-4152-8774-6cb0b9bb9f16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f4f675d-52')
Jun 27 04:10:04.600590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.600590 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "5029793a-13f5-48f3-8d7a-a8076718daaa", "address": "fa:16:3e:2a:00:39", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5029793a-13", "ovs_interfaceid": "5029793a-13f5-48f3-8d7a-a8076718daaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.600590 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.600590 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.601122 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.601557 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5029793a-13, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.602437 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.603656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.609513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.610685 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.611036 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9878c60-0c8a-4317-bee6-723b6d7efeb8) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.611903 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.613152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.619002 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.621407 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:00:39,bridge_name='br-int',has_traffic_filtering=True,id=5029793a-13f5-48f3-8d7a-a8076718daaa,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5029793a-13')
Jun 27 04:10:04.622464 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-746171921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-device-tagging-server-746171921',id=25,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO53hmVMM9+xDpcV6YQGhexhw8l27MHcE3W6y1bYaoy7J2yVPA9N2/rowQuFvncLD7XssvhCxivRcN24kBheuBH3EOAt4ZVHpRiM9mqoW2/nNPVFq1+9BO2QzGBe0oSr/g==',key_name='tempest-keypair-1878587191',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:11Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5550c68573fa4ae7b3b9553209bb7625',ramdisk_id='',reservation_id='r-70qf3ckq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1248476091',owner_user_name='tempest-TaggedBootDevicesTest-1248476091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa12f7997774c398f0484c98050ca5e',uuid=6897732e-ea7e-4359-802b-42ded626f5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:04.622783 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converting VIF {"id": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "address": "fa:16:3e:98:b9:a3", "network": {"id": "fa4f259d-0346-4b68-ae56-c47b9af50b8e", "bridge": "br-int", "label": "tempest-device-tagging-net2-924446427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5550c68573fa4ae7b3b9553209bb7625", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a72cb59-aa", "ovs_interfaceid": "3a72cb59-aa80-44f8-99ff-89dfb60ab399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.623074 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.623330 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:04.624119 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.624384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a72cb59-aa, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.625545 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.626367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.628253 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.629206 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.629338 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9509d396-c233-4995-a869-e803081d3421) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:04.629933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.630467 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:04.631976 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:04.634262 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b9:a3,bridge_name='br-int',has_traffic_filtering=True,id=3a72cb59-aa80-44f8-99ff-89dfb60ab399,network=Network(fa4f259d-0346-4b68-ae56-c47b9af50b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a72cb59-aa')
Jun 27 04:10:04.635706 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:10:04.636129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:04.636336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:04.636880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:04.637317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8e678f6e-3918-45c1-b14d-d57981f35cbb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:10:04.637582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:10:04.641086 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:04.663134 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1132427580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-1132427580',id=27,image_ref='01131c66-180d-44a2-8c09-67d54f88bf62',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-46950425',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-lmts48ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member',shelved_at='2026-06-27T04:09:38.953317',shelved_host='np0000003830',shelved_image_id='01131c66-180d-44a2-8c09-67d54f88bf62'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=30950d61-f1cd-4a81-ae4e-cce3af742f8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:10:04.663701 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:04.664591 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:04.665688 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'pci_devices' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:04.677077 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:04.677569 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:04.677771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:10:04.677845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '51')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:04.679926 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb', '52')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:04.681145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181d09a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:10:04.681437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:10:04.681717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Flush multipath device 330000000c5e5906b {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:10:04.715992 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Rescuing
Jun 27 04:10:04.716569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:04.716569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:04.716569 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:04.737341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:04.747188 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:04.750365 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:04.790846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:04.840444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:10:04.840636 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:10:04.842351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:10:04.854702 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:10:04.855036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:10:04.869629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:04.913643 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.40.100,3260]
Jun 27 04:10:04.913643 np0000003830 nova-compute[98984]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:04.913643 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:04.940708 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:04.954885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:04.960737 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:04.960901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:04.961087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:04.961392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:04.961608 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:04.961747 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:04.961866 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:04.962222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:04.962423 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:04.962645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:04.964048 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:04.964048 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-17ca975c-e22c-4d13-a2d2-1da9117be800 req-a5ad7950-42e6-459b-9459-25b99c8f6700 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-52e90d26-f0a7-4397-8a28-8ba0e675e834 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:04.997101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.50.100,3260]
Jun 27 04:10:04.997101 np0000003830 nova-compute[98984]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-8e678f6e-3918-45c1-b14d-d57981f35cbb, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:04.997101 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.022418 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.022797 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:05.022971 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== disconnect_volume: return (386ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:05.023130 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:10:05.024649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:10:05.024969 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:05.025168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:05.025569 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:05.025979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6e6b53c-3278-4d18-a8a0-731ce1afe424', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:10:05.026211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.057523 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424 (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:05.058000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:10:05.058472 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '55')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:05.059757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424', '56')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:05.061154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181d1bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'): ({'sdm'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:10:05.061388 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Removing multipathed devices sdl, sdm {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:10:05.061659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Flush multipath device 330000000a6c8fcd8 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:10:05.099430 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:05.149004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:05.167837 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <uuid>30950d61-f1cd-4a81-ae4e-cce3af742f8e</uuid>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <name>instance-0000001b</name>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1132427580</nova:name>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:10:04</nova:creationTime>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:user uuid="a996571fb63c4c6e993f1fa02549a086">tempest-AttachVolumeShelveTestJSON-1443827218-project-member</nova:user>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:project uuid="469d72ff5a3640dbb2193b8a91deeac0">tempest-AttachVolumeShelveTestJSON-1443827218</nova:project>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         <nova:port uuid="50c70b8e-7688-43e8-a450-c35d577448e4">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <entry name="serial">30950d61-f1cd-4a81-ae4e-cce3af742f8e</entry>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <entry name="uuid">30950d61-f1cd-4a81-ae4e-cce3af742f8e</entry>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:4d:51:28"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <target dev="tap50c70b8e-76"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/console.log" append="off"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:10:05.169169 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:10:05.171938 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Preparing to wait for external event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:10:05.171938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.171938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.171938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.172701 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1132427580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-1132427580',id=27,image_ref='01131c66-180d-44a2-8c09-67d54f88bf62',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-46950425',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-lmts48ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member',shelved_at='2026-06-27T04:09:38.953317',shelved_host='np0000003830',shelved_image_id='01131c66-180d-44a2-8c09-67d54f88bf62'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=30950d61-f1cd-4a81-ae4e-cce3af742f8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:10:05.172866 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:05.173482 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:05.173720 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:10:05.173983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:05.174185 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:05.174441 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:10:05.175255 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:05.175398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac50d22c-2389-573f-9dcd-526b951301c0', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:05.177018 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:05.178066 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:05.180763 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:05.180960 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c70b8e-76, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:05.181351 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50c70b8e-76, col_values=(('qos', UUID('b02a745b-3a78-4a28-bf22-4a64af9e49c9')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:05.181557 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50c70b8e-76, col_values=(('external_ids', {'iface-id': '50c70b8e-7688-43e8-a450-c35d577448e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:51:28', 'vm-uuid': '30950d61-f1cd-4a81-ae4e-cce3af742f8e'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:05.183901 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:05.185364 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:05.189664 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:05.191344 np0000003830 nova-compute[98984]: INFO os_vif [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76')
Jun 27 04:10:05.207625 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:10:05.207822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:10:05.210031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:10:05.220400 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:05.224436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:10:05.224761 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:10:05.238806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.256259 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533405.2549703, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:05.256259 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] VM Started (Lifecycle Event)
Jun 27 04:10:05.280432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.40.100,3260]
Jun 27 04:10:05.280432 np0000003830 nova-compute[98984]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:05.280432 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.303420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.315302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.350148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.50.100,3260]
Jun 27 04:10:05.350148 np0000003830 nova-compute[98984]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-c6e6b53c-3278-4d18-a8a0-731ce1afe424, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:05.350148 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.372574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.372574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:05.372574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== disconnect_volume: return (347ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:05.372574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:10:05.373689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:10:05.374715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:05.374715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:05.375727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:05.375727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04a389a8-7635-4963-8971-7d4f4426c643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:10:05.375727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.414398 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643 (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:05.414728 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:05.415031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:10:05.415123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '57')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:05.416143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643', '58')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:05.417073 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518777a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:10:05.417315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:10:05.418539 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Flush multipath device 3300000007eaf252f {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:10:05.454515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:05.503856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:05.519164 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.523690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.525088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.525088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.525088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.525208 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.525922 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.525922 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-23658b37-4049-4577-9e1f-487c0e385129 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.525922 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.525922 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.525922 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.526175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.526407 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-23658b37-4049-4577-9e1f-487c0e385129 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.526856 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-23658b37-4049-4577-9e1f-487c0e385129 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.527005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.527166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.527512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.529057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.529212 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.530056 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04976e41-77a4-49a7-b849-c4767930991b req-c2372ce5-35be-4a0a-814f-07b280684e66 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.560717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:10:05.560913 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:10:05.562520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:10:05.577230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:10:05.577511 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:10:05.591567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.634317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.40.100,3260]
Jun 27 04:10:05.634317 np0000003830 nova-compute[98984]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:05.634317 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.656466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.671057 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.676656 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:05.707699 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.50.100,3260]
Jun 27 04:10:05.707699 np0000003830 nova-compute[98984]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-04a389a8-7635-4963-8971-7d4f4426c643, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:05.707699 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.725193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:05.725682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:05.725682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] <== disconnect_volume: return (350ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:05.725682 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:10:05.725995 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Deleting instance files /opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4_del
Jun 27 04:10:05.726492 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Deletion of /opt/stack/data/nova/instances/6897732e-ea7e-4359-802b-42ded626f5b4_del complete
Jun 27 04:10:05.761685 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:05.770579 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:05.823047 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.823301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.823792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.823792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.823885 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.828810 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-5029793a-13f5-48f3-8d7a-a8076718daaa for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.831445 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.834202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.835188 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.836152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.838171 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Updating instance_info_cache with network_info: [{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:05.839883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.840138 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:05.840285 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:05.840470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:05.841318 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:05.841435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:05.841578 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:05.841700 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3ab87cfa-d85f-463b-9584-f4658a620762 req-305961b7-c760-44a7-a62c-86d11b6ba3d7 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:06.245857 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Took 3.25 seconds to destroy the instance on the hypervisor.
Jun 27 04:10:06.247360 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:10:06.247936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:10:06.247936 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:10:06.247936 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:06.273906 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999654435000139 future=<Future at 0x7ec518164800 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:06.341444 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:06.538327 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:06.712814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:06.712814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:06.712814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] No VIF found with MAC fa:16:3e:4d:51:28, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:06.713531 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Using config drive
Jun 27 04:10:07.222079 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'ec2_ids' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:07.645348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:07.645348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] Acquiring lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:07.645348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:07.645904 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] Lock "6897732e-ea7e-4359-802b-42ded626f5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:07.648981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] No waiting events found dispatching network-vif-unplugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:07.650844 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-unplugged-3a72cb59-aa80-44f8-99ff-89dfb60ab399 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:07.650844 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:07.650844 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing instance network info cache due to event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:07.650844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] Acquiring lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:07.650844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] Acquired lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:07.652033 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:07.728907 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:07.728907 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'keypairs' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:08.015219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:08.019533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:08.050911 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:08.157228 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:08.231988 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Object Instance<30950d61-f1cd-4a81-ae4e-cce3af742f8e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:08.236229 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:08.272264 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:08.288662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:08.356800 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999513046999937 future=<Future at 0x7ec5382c1520 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:08.363774 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance destroyed successfully.
Jun 27 04:10:08.364770 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'numa_topology' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:08.388398 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003260749999753898 future=<Future at 0x7ec5187bbd40 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:08.388564 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:08.388564 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=12.884933770000089 future=<Future at 0x7ec518164800 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:08.388765 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=12.884839472000067 future=<Future at 0x7ec518164800 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:08.455824 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Creating config drive at /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config
Jun 27 04:10:08.470942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5pwo6h0z {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:08.533391 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5pwo6h0z" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:08.736534 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:08.742696 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:08.743104 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing instance network info cache due to event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:08.743305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] Acquiring lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:08.876140 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Attempting rescue
Jun 27 04:10:08.877054 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98984) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 27 04:10:08.885365 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:10:08.885784 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Creating image(s)
Jun 27 04:10:08.886999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:08.887342 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:08.888002 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:08.888745 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'trusted_certs' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:08.967893 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updated VIF entry in instance network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:08.968623 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:09.090631 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.129549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.131687 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.228131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.392575 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:09.394522 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:09.400453 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:09.402686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:09.403057 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:09.404621 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:09.410626 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:09.411628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:09.441871 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f3557cd-67c8-45bc-8f7b-d16e419e5efb req-014199d8-644e-47a6-ac03-69dba89f2033 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:09.441871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f3557cd-67c8-45bc-8f7b-d16e419e5efb req-014199d8-644e-47a6-ac03-69dba89f2033 service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:09.441871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f3557cd-67c8-45bc-8f7b-d16e419e5efb req-014199d8-644e-47a6-ac03-69dba89f2033 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:09.441871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f3557cd-67c8-45bc-8f7b-d16e419e5efb req-014199d8-644e-47a6-ac03-69dba89f2033 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:09.441871 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f3557cd-67c8-45bc-8f7b-d16e419e5efb req-014199d8-644e-47a6-ac03-69dba89f2033 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Processing event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:10:09.474807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8242d18b-f585-429a-9005-9ef673a4e2b5 req-66a0d1c4-cb8d-4c06-83e3-9196558402c3 service nova] Releasing lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:09.475916 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] Acquired lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:09.475916 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:09.538268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.127s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:09.540594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.rescue {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:09.564402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.574271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.614778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:09.623212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.rescue" returned: 0 in 0.083s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:09.623927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:09.625370 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'migration_context' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:09.763392 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:09.763818 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:09.763818 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:09.764191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:09.764191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:09.764295 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state active and task_state rescuing.
Jun 27 04:10:09.764654 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-deleted-1f4f675d-527d-4e2e-8610-0652a7a5f7c5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:09.764654 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Neutron deleted interface 1f4f675d-527d-4e2e-8610-0652a7a5f7c5; detaching it from the instance and deleting it from the info cache
Jun 27 04:10:09.774295 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Detach interface failed, port_id=1f4f675d-527d-4e2e-8610-0652a7a5f7c5, reason: Instance 6897732e-ea7e-4359-802b-42ded626f5b4 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:10:09.774516 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:09.774905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:09.775137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:09.775313 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:09.775485 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:09.775606 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state active and task_state rescuing.
Jun 27 04:10:09.775702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-deleted-40af7eec-8fb8-464e-85a4-12ed12c5f6f0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:09.775817 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Neutron deleted interface 40af7eec-8fb8-464e-85a4-12ed12c5f6f0; detaching it from the instance and deleting it from the info cache
Jun 27 04:10:09.778956 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f1a1eeb-f00c-42c2-9939-0b31f5e2151e req-179f449b-3071-476b-9314-cfaa2bf615b2 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Detach interface failed, port_id=40af7eec-8fb8-464e-85a4-12ed12c5f6f0, reason: Instance 6897732e-ea7e-4359-802b-42ded626f5b4 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:10:09.974852 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7a1a4299-babd-4266-b764-a795975a936f req-b6536785-42d6-4fee-83e9-43d1970dfb58 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-deleted-3a72cb59-aa80-44f8-99ff-89dfb60ab399 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:09.974852 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-7a1a4299-babd-4266-b764-a795975a936f req-b6536785-42d6-4fee-83e9-43d1970dfb58 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Neutron deleted interface 3a72cb59-aa80-44f8-99ff-89dfb60ab399; detaching it from the instance and deleting it from the info cache
Jun 27 04:10:09.979933 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:09.982595 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7a1a4299-babd-4266-b764-a795975a936f req-b6536785-42d6-4fee-83e9-43d1970dfb58 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Detach interface failed, port_id=3a72cb59-aa80-44f8-99ff-89dfb60ab399, reason: Instance 6897732e-ea7e-4359-802b-42ded626f5b4 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:10:10.127958 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:10.128328 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:10:10.129595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Start _get_guest_xml network_info=[{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:d0:ca:33"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:10:10.129837 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'resources' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:10.183192 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:10.231931 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533410.2314677, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:10.232404 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Started (Lifecycle Event)
Jun 27 04:10:10.234384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:10:10.237881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:10:10.246315 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance spawned successfully.
Jun 27 04:10:10.427105 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:10.613884 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updated VIF entry in instance network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:10.616559 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:10.631848 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:10.637928 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:10.639960 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1902559260', uuid='e4cc11fc-1add-45d0-9bd3-e1f6de51ea39'), owner=OwnerMeta(userid='b427e506578a4121bf0d008321dacac9', username='tempest-ServerRescueNegativeTestJSON-1862600164-project-member', projectid='7adc2502eb6e45c19f6b8646b60669f5', projectname='tempest-ServerRescueNegativeTestJSON-1862600164'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:d0:ca:33"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533410.639369) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:10:10.641379 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:10:10.642318 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:10:10.643890 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:10:10.644072 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:10:10.645239 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:10:10.645659 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:10:10.645869 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:10:10.645996 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:10:10.646130 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:10:10.646303 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:10:10.646303 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:10:10.646489 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:10:10.646641 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:10:10.646781 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:10:10.646904 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:10:10.647020 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:10:10.647161 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:10.736712 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:10.741470 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:10.787075 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:10.919753 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:11.116567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2a800334-3222-4aa8-9a5f-a2ad603d0330 req-812f0638-88c5-4f25-be9b-e2e98006094b service nova] Releasing lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:11.149153 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:11.166947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1902559260',display_name='tempest-ServerRescueNegativeTestJSON-server-1902559260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1902559260',id=28,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:44Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-cvd59xdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:09:45Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=e4cc11fc-1add-45d0-9bd3-e1f6de51ea39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:d0:ca:33"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:10:11.167247 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:d0:ca:33"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:11.167846 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:11.171786 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'pci_devices' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:11.245808 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:10:11.246634 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533411.2462966, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:11.246895 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Paused (Lifecycle Event)
Jun 27 04:10:11.295376 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd31a7ed-1458-4600-993f-d48feaa72fad tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.845s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:11.422531 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Took 5.17 seconds to deallocate network for instance.
Jun 27 04:10:11.511938 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-deleted-5029793a-13f5-48f3-8d7a-a8076718daaa {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:11.512402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:11.512402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:11.512702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:11.512754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:11.522270 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] No waiting events found dispatching network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:11.522270 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a9079349-db95-4f62-9ef2-0d5ef652c6a5 req-e74e2e35-4f95-41c6-8b24-f717b2b35ce4 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received unexpected event network-vif-plugged-50c70b8e-7688-43e8-a450-c35d577448e4 for instance with vm_state active and task_state None.
Jun 27 04:10:11.676443 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <uuid>e4cc11fc-1add-45d0-9bd3-e1f6de51ea39</uuid>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <name>instance-0000001c</name>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1902559260</nova:name>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:10:10</nova:creationTime>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:user uuid="b427e506578a4121bf0d008321dacac9">tempest-ServerRescueNegativeTestJSON-1862600164-project-member</nova:user>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:project uuid="7adc2502eb6e45c19f6b8646b60669f5">tempest-ServerRescueNegativeTestJSON-1862600164</nova:project>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         <nova:port uuid="045ddeda-5a24-4df2-826c-346068bd099c">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <entry name="serial">e4cc11fc-1add-45d0-9bd3-e1f6de51ea39</entry>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <entry name="uuid">e4cc11fc-1add-45d0-9bd3-e1f6de51ea39</entry>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.rescue"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config.rescue"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d0:ca:33"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <target dev="tap045ddeda-5a"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/console.log" append="off"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:10:11.677545 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:10:11.683305 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance destroyed successfully.
Jun 27 04:10:11.749956 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:11.751752 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533411.7515156, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:11.751940 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Resumed (Lifecycle Event)
Jun 27 04:10:11.829179 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6e6630b9-52bf-4aaf-a49c-11d009f4213c req-0b54a24f-d6b9-4582-808d-01becb550212 service nova] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Received event network-vif-deleted-cc7b6e7c-8ec8-43ab-baae-1f7462ef7a40 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:12.254395 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:12.260755 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:13.192659 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Took 1.77 seconds to detach 3 volumes for instance.
Jun 27 04:10:13.227399 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:13.227615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:13.227812 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:13.227970 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:d0:ca:33, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:13.228637 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Using config drive
Jun 27 04:10:13.701139 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:13.701354 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:13.733655 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'ec2_ids' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:14.237469 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:14.238085 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'keypairs' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:14.249436 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:14.393832 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:14.394130 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:14.741281 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:14.745338 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:14.901358 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:14.923875 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Creating config drive at /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config.rescue
Jun 27 04:10:14.929927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpozxs708t {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:14.998925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpozxs708t" returned: 0 in 0.070s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:15.185376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:15.413642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.712s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:15.524049 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:15.542184 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Deleted allocations for instance 6897732e-ea7e-4359-802b-42ded626f5b4
Jun 27 04:10:15.582092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:15.677131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:15.738320 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:15.739807 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:15.859227 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5c4263c1-03e9-4e52-84c7-90cd8b656583 req-e8473165-1947-48cb-a1db-92c238f1482a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:15.859931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5c4263c1-03e9-4e52-84c7-90cd8b656583 req-e8473165-1947-48cb-a1db-92c238f1482a service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:15.860229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5c4263c1-03e9-4e52-84c7-90cd8b656583 req-e8473165-1947-48cb-a1db-92c238f1482a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:15.860468 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5c4263c1-03e9-4e52-84c7-90cd8b656583 req-e8473165-1947-48cb-a1db-92c238f1482a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:15.861240 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5c4263c1-03e9-4e52-84c7-90cd8b656583 req-e8473165-1947-48cb-a1db-92c238f1482a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:15.861240 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5c4263c1-03e9-4e52-84c7-90cd8b656583 req-e8473165-1947-48cb-a1db-92c238f1482a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state active and task_state rescuing.
Jun 27 04:10:16.561532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c8eedd7-0274-44e7-b906-d7a36a574ad8 tempest-TaggedBootDevicesTest-1248476091 tempest-TaggedBootDevicesTest-1248476091-project-member] Lock "6897732e-ea7e-4359-802b-42ded626f5b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.086s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:16.679650 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Stashing vm_state: active {{(pid=98984) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 27 04:10:16.847458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 due to new event <LifecycleEvent: 1782533416.8470125, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:10:16.847684 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533416.8470125, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:16.847857 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Resumed (Lifecycle Event)
Jun 27 04:10:16.854344 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-169071f2-33fb-4675-ac58-0d9be265c73a tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:17.259429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:17.259429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:17.354342 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:17.359645 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:17.772453 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:10:17.772997 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Claim successful on node np0000003830
Jun 27 04:10:17.862624 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533417.8622496, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:17.862836 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Started (Lifecycle Event)
Jun 27 04:10:17.951913 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-08a5e71d-e78f-4ce9-9c36-285eb8f03c3a req-f10818cf-ad3e-4601-88b3-a0873c18b150 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:17.952855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-08a5e71d-e78f-4ce9-9c36-285eb8f03c3a req-f10818cf-ad3e-4601-88b3-a0873c18b150 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:17.952855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-08a5e71d-e78f-4ce9-9c36-285eb8f03c3a req-f10818cf-ad3e-4601-88b3-a0873c18b150 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:17.952855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-08a5e71d-e78f-4ce9-9c36-285eb8f03c3a req-f10818cf-ad3e-4601-88b3-a0873c18b150 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:17.952855 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-08a5e71d-e78f-4ce9-9c36-285eb8f03c3a req-f10818cf-ad3e-4601-88b3-a0873c18b150 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:17.952855 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-08a5e71d-e78f-4ce9-9c36-285eb8f03c3a req-f10818cf-ad3e-4601-88b3-a0873c18b150 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:10:17.970849 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Unrescuing
Jun 27 04:10:17.971263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:17.971365 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:17.971523 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:18.280053 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating resource usage from migration 0795f6e0-39b1-40c5-ad79-78a9fbde7b1d
Jun 27 04:10:18.365443 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:18.367670 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:18.474714 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:18.757225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:18.873329 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jun 27 04:10:18.957711 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:19.083870 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:19.084123 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:19.182336 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Updating instance_info_cache with network_info: [{"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:19.252459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:19.587130 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:19.684933 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:19.685804 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'flavor' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:20.096868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.837s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:20.097432 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Migrating
Jun 27 04:10:20.097432 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:10:20.189472 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:20.213867 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:20.219159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:20.248801 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:20.434332 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60065c67-4bb9-485c-bdcb-8d0abe73037b req-640fb171-eafd-4277-953c-82cdc3f2a229 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:20.435540 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60065c67-4bb9-485c-bdcb-8d0abe73037b req-640fb171-eafd-4277-953c-82cdc3f2a229 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:20.435540 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60065c67-4bb9-485c-bdcb-8d0abe73037b req-640fb171-eafd-4277-953c-82cdc3f2a229 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:20.435540 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-60065c67-4bb9-485c-bdcb-8d0abe73037b req-640fb171-eafd-4277-953c-82cdc3f2a229 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:20.436257 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-60065c67-4bb9-485c-bdcb-8d0abe73037b req-640fb171-eafd-4277-953c-82cdc3f2a229 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:20.436257 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-60065c67-4bb9-485c-bdcb-8d0abe73037b req-640fb171-eafd-4277-953c-82cdc3f2a229 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:10:20.442708 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:20.450365 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:20.594548 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999634358000094 future=<Future at 0x7ec518447980 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:20.596039 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance destroyed successfully.
Jun 27 04:10:20.596546 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'numa_topology' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:20.620535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:20.620702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:20.620892 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:21.098790 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<e4cc11fc-1add-45d0-9bd3-e1f6de51ea39> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:21.123312 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:21.273921 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003622019999056647 future=<Future at 0x7ec518164800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.274095 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.274255 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.0813297639999746 future=<Future at 0x7ec5382c1520 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.274437 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.081209467000008 future=<Future at 0x7ec5382c1520 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.274513 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.274635 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.319315866000125 future=<Future at 0x7ec518447980 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.274704 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.319230524999966 future=<Future at 0x7ec518447980 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:21.275211 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] Emitting event <LifecycleEvent: 1782533406.2734394, 6897732e-ea7e-4359-802b-42ded626f5b4 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:21.275517 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] VM Stopped (Lifecycle Event)
Jun 27 04:10:21.515391 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:21.615035 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:21.656965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:21.661519 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:21.721888 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:21.759703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:21.780572 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9151f3f2-5237-41a8-8da4-a8270c93484b tempest-ServerActionsV293TestJSON-165019121 tempest-ServerActionsV293TestJSON-165019121-project-member] [instance: 6897732e-ea7e-4359-802b-42ded626f5b4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:21.824670 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:21.826782 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:22.227125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:22.520681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:22.521259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:22.521487 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:22.521627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:22.521782 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:22.522128 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:10:22.522128 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:22.522177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:22.523804 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:22.524314 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:22.524314 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:22.526647 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-42b078e4-ee5a-4548-81d4-003c1fb40378 req-f079f396-e3d6-45c0-8a19-13c9c883320a service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:10:22.593681 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 due to new event <LifecycleEvent: 1782533422.593278, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:10:22.594198 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533422.593278, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:22.594198 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Resumed (Lifecycle Event)
Jun 27 04:10:22.595533 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2294da50-b9ae-42cb-9f00-b3fb9da6c056 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:23.097849 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:23.099710 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:23.605376 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533423.6050587, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:23.605887 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Started (Lifecycle Event)
Jun 27 04:10:23.742828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Starting migrate_disk_and_power_off {{(pid=98984) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12623}}
Jun 27 04:10:23.767974 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:23.774909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:23.800448 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:23.968478 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:23.974915 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.057507 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.068624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.092791 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance destroyed successfully.
Jun 27 04:10:24.096297 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=26,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:42Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-kpbrjr46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=6d020229-688f-487c-8458-d1f3cd69257b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:24.096581 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:24.097164 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:24.097423 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:24.104145 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.104472 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdad80f04-57, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:24.107268 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.108566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:24.110637 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:24.111061 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.112767 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.113097 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea5b6ac3-822f-4b75-93c5-ca63749d05b2) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:24.120844 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.122622 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:24.126396 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:24.126902 np0000003830 nova-compute[98984]: INFO os_vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57')
Jun 27 04:10:24.159544 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1886aaa9-c95a-454e-9f36-ddd64452a4a4 req-c51a4d78-7c38-4ba7-a421-b742b9c8ffc6 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-unplugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:24.159636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1886aaa9-c95a-454e-9f36-ddd64452a4a4 req-c51a4d78-7c38-4ba7-a421-b742b9c8ffc6 service nova] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:24.159831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1886aaa9-c95a-454e-9f36-ddd64452a4a4 req-c51a4d78-7c38-4ba7-a421-b742b9c8ffc6 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:24.159966 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1886aaa9-c95a-454e-9f36-ddd64452a4a4 req-c51a4d78-7c38-4ba7-a421-b742b9c8ffc6 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:24.160103 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1886aaa9-c95a-454e-9f36-ddd64452a4a4 req-c51a4d78-7c38-4ba7-a421-b742b9c8ffc6 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] No waiting events found dispatching network-vif-unplugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:24.160264 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-1886aaa9-c95a-454e-9f36-ddd64452a4a4 req-c51a4d78-7c38-4ba7-a421-b742b9c8ffc6 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received unexpected event network-vif-unplugged-dad80f04-574e-4c16-a005-e27d4fd01f73 for instance with vm_state active and task_state resize_migrating.
Jun 27 04:10:24.254741 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:24.629459 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999680596999951 future=<Future at 0x7ec5181ffbf0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:24.712940 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Detected multiple connections on this host for volume: a574ef50-0fb3-446f-997f-d6a7e94a232e, skipping target disconnect.
Jun 27 04:10:24.715438 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:24.827706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:24.828411 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:24.844357 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:24.845304 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.98 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:10:24.933252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:24.937235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:10:24.937235 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_resize/disk /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:25.129653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "cp -r /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_resize/disk /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk" returned: 0 in 0.194s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:25.129962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_resize/disk.config /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:25.175283 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "cp -r /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_resize/disk.config /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config" returned: 0 in 0.045s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:25.175739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_resize/disk.info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:25.222416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "cp -r /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_resize/disk.info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:25.468780 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:26.241852 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ea9316a4-f2c6-4b03-b07d-d2ca2d236c44 req-3f1358f6-1f84-4daa-98fd-2c2f112135bc service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-unplugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:26.243319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ea9316a4-f2c6-4b03-b07d-d2ca2d236c44 req-3f1358f6-1f84-4daa-98fd-2c2f112135bc service nova] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:26.243541 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ea9316a4-f2c6-4b03-b07d-d2ca2d236c44 req-3f1358f6-1f84-4daa-98fd-2c2f112135bc service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:26.243722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ea9316a4-f2c6-4b03-b07d-d2ca2d236c44 req-3f1358f6-1f84-4daa-98fd-2c2f112135bc service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:26.243884 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ea9316a4-f2c6-4b03-b07d-d2ca2d236c44 req-3f1358f6-1f84-4daa-98fd-2c2f112135bc service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] No waiting events found dispatching network-vif-unplugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:26.244060 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ea9316a4-f2c6-4b03-b07d-d2ca2d236c44 req-3f1358f6-1f84-4daa-98fd-2c2f112135bc service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received unexpected event network-vif-unplugged-dad80f04-574e-4c16-a005-e27d4fd01f73 for instance with vm_state active and task_state resize_migrating.
Jun 27 04:10:26.579904 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:26.580292 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:26.712052 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Port dad80f04-574e-4c16-a005-e27d4fd01f73 binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:10:26.830765 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:26.832584 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:27.338170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:27.338170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:27.338170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:27.338170 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:10:27.721655 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:10:27.735267 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:27.736098 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:27.736528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:28.342641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:28.342641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:28.403636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:28.485160 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:28.491006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:28.491817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:28.587440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:28.589380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:10:28.595842 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:28.698694 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:28.700712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:28.752130 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:28.792076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:28.796960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:10:28.799455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:28.847566 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:10:28.874851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:28.875032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:28.875168 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:28.908360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:28.908867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.009268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.009268 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:10:29.011403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.108837 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.108837 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.122875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:29.208950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.208950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:10:29.208950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.256436 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:29.296691 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.297353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.377858 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:29.400358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.404895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.433794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:29.434172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:29.445206 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:10:29.445455 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Claim successful on node np0000003830
Jun 27 04:10:29.516410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.516410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.624996 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.631263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.719432 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.719867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.828676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.833721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:29.921689 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:29.947157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:29.948588 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:30.061419 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:30.063036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:30.151677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:30.152281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:30.216983 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:30.264205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:30.268923 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:30.270722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:30.316772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:30.318136 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=49387MB free_disk=73.4586296081543GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:10:30.319366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:30.723994 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:31.239380 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:31.254889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:10:31.277783 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:31.278467 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:31.286036 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:31.328052 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:10:31.328648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:10:31.337386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:10:31.339584 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe97:a8ba', 'fe80::1c14:85ff:fe33:e2b2', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fe4d:5128', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fed0:ca33'] 
Jun 27 04:10:31.339874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:10:31.341137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:10:31.341137 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:31.784397 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:32.295476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.861s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:32.297413 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:10:32.300509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.978s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:32.508309 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Starting finish_migration {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12810}}
Jun 27 04:10:32.509746 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:10:32.509955 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Creating image(s)
Jun 27 04:10:32.510867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:32.612403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:32.613002 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:10:32.613328 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:32.698555 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:32.699152 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Cannot resize image /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:10:32.810598 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:10:32.818143 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:10:32.818143 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:32.818143 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:32.920131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:32.920621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:32.937334 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b427e506578a4121bf0d008321dacac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7adc2502eb6e45c19f6b8646b60669f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:10:33.202344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:10:33.202523 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Ensure instance console log exists: /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:10:33.202768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:33.202932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:33.203100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:33.205893 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Start _get_guest_xml network_info=[{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '55461988-8dd7-4076-9105-8604a5e8d905', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '6d020229-688f-487c-8458-d1f3cd69257b', 'attached_at': '2026-06-27T04:10:31.000000', 'detached_at': '', 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'multiattach': True, 'serial': 'a574ef50-0fb3-446f-997f-d6a7e94a232e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:10:33.209583 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:33.210938 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='6d020229-688f-487c-8458-d1f3cd69257b'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533433.2105458) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:10:33.212640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:10:33.213165 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:10:33.214211 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:10:33.214415 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:10:33.215712 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:10:33.216096 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:10:33.216297 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:10:33.216393 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:10:33.216551 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:10:33.216623 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:10:33.216720 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:10:33.216882 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:10:33.216984 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:10:33.217064 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:10:33.217187 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:10:33.217308 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:10:33.227900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:33.317664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:33.318284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:33.318590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:33.319161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:33.319781 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:10:33.320161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:33.320356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:33.320933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:33.321476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:10:33.328901 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:10:33.332820 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Applying migration context for instance 6d020229-688f-487c-8458-d1f3cd69257b as it has an incoming, in-progress migration 0795f6e0-39b1-40c5-ad79-78a9fbde7b1d. Migration status is post-migrating {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 27 04:10:33.335090 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating resource usage from migration 0795f6e0-39b1-40c5-ad79-78a9fbde7b1d
Jun 27 04:10:33.340138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:33.345288 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:33.345828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:33.346283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:33.346578 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:33.346805 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:33.364131 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:33.375620 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:33.384878 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:33.392770 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:33.403597 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.403699 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.403833 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.403915 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404048 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f5611e50-86aa-420c-9f94-e13d8f80f4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404276 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 075f803b-49f2-4084-9d8a-10d59d1c62eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404408 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 5a289016-ec72-454c-aec8-e92b65727e16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404588 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 30950d61-f1cd-4a81-ae4e-cce3af742f8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404668 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Migration 0795f6e0-39b1-40c5-ad79-78a9fbde7b1d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 27 04:10:33.404727 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d020229-688f-487c-8458-d1f3cd69257b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.404838 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance fa5fe299-857b-41f5-8069-c3324c227036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:10:33.405309 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:10:33.405309 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2944MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:10:30 up 33 min,  2 users,  load average: 13.03, 9.74, 5.07\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '10', 'num_os_type_None': '11', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '5', 'io_workload': '1', 'num_task_resize_finish': '1', 'num_proj_469d72ff5a3640dbb2193b8a91deeac0': '1', 'num_proj_7adc2502eb6e45c19f6b8646b60669f5': '3', 'num_vm_rescued': '1', 'num_proj_72fed82034484f13a228c535b175c167': '1', 'num_proj_f8f8cbfe84ce4a48938255e422c7159b': '1', 'num_vm_building': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.408194 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.408547 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:33.408797 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:33.408797 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:33.409365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('13', '0', '0', 0) found on session 53 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:33.409552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:33.422271 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:33.424739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.076s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:33.424739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:33.424739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('14', '0', '0', 0) found on session 54 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:33.424739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:33.426140 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:33.433903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 53 and hctl ('13', '0', '0', 0) yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:33.434046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:33.442919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 54 and hctl ('14', '0', '0', 0) yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:33.445302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:33.542139 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Successfully created port: deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:10:33.840230 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:10:34.114317 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:34.114605 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:34.124768 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:34.159467 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Successfully updated port: deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:10:34.219321 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:34.219519 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing instance network info cache due to event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:34.219973 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:34.220350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:34.220350 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:34.259824 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:34.348650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:10:34.432448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:34.505797 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:34.617927 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:34.661112 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:34.724413 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:34.843838 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:10:34.853930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:10:34.856471 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:10:34.857184 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Creating image(s)
Jun 27 04:10:34.857333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:34.857426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:34.857828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:34.858439 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:34.861465 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:34.862927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:34.959620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:34.960405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:34.960598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:34.961047 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:34.963414 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:34.963780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:35.037924 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:35.065187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:35.065672 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:35.134539 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:10:35.134539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.839s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:35.135124 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:10:35.138768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk 1073741824" returned: 0 in 0.072s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:35.139381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:35.139842 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:35.240655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:35.240655 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:10:35.240878 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:35.347388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:35.348211 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Cannot resize image /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:10:35.349301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:10:35.349301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Ensure instance console log exists: /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:10:35.352739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:35.354383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:35.354383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:35.542420 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dff2ec8f-5530-49c3-aa7f-15521ca6aa27 req-3ccfde98-9b44-4479-a9f0-98030a993900 service nova] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:35.542861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:35.543888 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:35.594604 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005607589998817275 future=<Future at 0x7ec518447980 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:35.594764 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:35.594842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.033592452999983 future=<Future at 0x7ec5181ffbf0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:35.594958 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.0334959110000455 future=<Future at 0x7ec5181ffbf0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:35.706625 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:35.706888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:35.707164 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Attaching volume 7e939eb8-73aa-4e96-b26f-735bf9284807 to /dev/vdb
Jun 27 04:10:35.767061 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:35.779243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:10:35.801835 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:35.840570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:10:35.840886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:10:35.850810 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:10:35.852430 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe97:a8ba', 'fe80::1c14:85ff:fe33:e2b2', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fe4d:5128', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fed0:ca33'] 
Jun 27 04:10:35.852586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:10:35.852724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:10:35.852986 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:35.853289 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating existing volume attachment record: b1034e7d-6bee-492d-b9fe-f94ada9d434d {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:10:36.137369 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:10:36.329069 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:36.424723 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:10:36.425137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:36.425419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:36.511281 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:36.811087 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.014088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:37.014708 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance network_info: |[{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:10:37.017348 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Start _get_guest_xml network_info=[{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:10:37.020230 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:37.022238 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-38590157', uuid='fa5fe299-857b-41f5-8069-c3324c227036'), owner=OwnerMeta(userid='b427e506578a4121bf0d008321dacac9', username='tempest-ServerRescueNegativeTestJSON-1862600164-project-member', projectid='7adc2502eb6e45c19f6b8646b60669f5', projectname='tempest-ServerRescueNegativeTestJSON-1862600164'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533437.0217283) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:10:37.023770 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:10:37.024364 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:10:37.025482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:10:37.025843 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:10:37.027235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:10:37.027893 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:10:37.028232 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:10:37.028440 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:10:37.028692 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:10:37.028909 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:10:37.029118 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:10:37.029419 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:10:37.029658 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:10:37.029913 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:10:37.032521 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:10:37.032521 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:10:37.049900 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-38590157',display_name='tempest-ServerRescueNegativeTestJSON-server-38590157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-38590157',id=32,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVGe0pGmGKgFXE9CC8E3bKafwbkIsigNdihQC7wDDX3aLiQbljECwrPYQGqO7sU2O0wvzDMD7EFZKp4MagbWU0WMEfHR7Mvjb3FFZ4Boc3BZvnEVJPjqpdW6k8/tjeUw==',key_name='tempest-keypair-1499974602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-oo0mrwne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b427e506578a4121bf0d008321dacac9',uuid=fa5fe299-857b-41f5-8069-c3324c227036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:10:37.050403 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:37.051373 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:37.052511 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'pci_devices' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:37.134449 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:37.134840 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:37.135129 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:37.135432 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:37.135663 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:10:37.136031 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:10:37.136366 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.69 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <uuid>fa5fe299-857b-41f5-8069-c3324c227036</uuid>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <name>instance-00000020</name>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-38590157</nova:name>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:10:37</nova:creationTime>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:user uuid="b427e506578a4121bf0d008321dacac9">tempest-ServerRescueNegativeTestJSON-1862600164-project-member</nova:user>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:project uuid="7adc2502eb6e45c19f6b8646b60669f5">tempest-ServerRescueNegativeTestJSON-1862600164</nova:project>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         <nova:port uuid="deeb79be-2aa4-4e3c-aa75-7ea49bf99feb">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <entry name="serial">fa5fe299-857b-41f5-8069-c3324c227036</entry>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <entry name="uuid">fa5fe299-857b-41f5-8069-c3324c227036</entry>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:f9:ad:bc"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <target dev="tapdeeb79be-2a"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/console.log" append="off"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Preparing to wait for external event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:37.557598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:37.562940 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-38590157',display_name='tempest-ServerRescueNegativeTestJSON-server-38590157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-38590157',id=32,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVGe0pGmGKgFXE9CC8E3bKafwbkIsigNdihQC7wDDX3aLiQbljECwrPYQGqO7sU2O0wvzDMD7EFZKp4MagbWU0WMEfHR7Mvjb3FFZ4Boc3BZvnEVJPjqpdW6k8/tjeUw==',key_name='tempest-keypair-1499974602',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-oo0mrwne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b427e506578a4121bf0d008321dacac9',uuid=fa5fe299-857b-41f5-8069-c3324c227036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:10:37.562940 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:37.562940 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:37.562940 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:10:37.562940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.562940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:37.563357 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:10:37.564506 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.564734 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fe519f0-0ce6-5927-bb81-c68c418da5d1', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:37.565725 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.566646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:37.567004 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.569460 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.569651 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeeb79be-2a, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:37.569977 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdeeb79be-2a, col_values=(('qos', UUID('5ad6b4d9-7087-4a80-a194-abacec2d77e3')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:37.570136 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdeeb79be-2a, col_values=(('external_ids', {'iface-id': 'deeb79be-2aa4-4e3c-aa75-7ea49bf99feb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ad:bc', 'vm-uuid': 'fa5fe299-857b-41f5-8069-c3324c227036'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:37.571005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.572371 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:37.579168 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:37.580697 np0000003830 nova-compute[98984]: INFO os_vif [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a')
Jun 27 04:10:39.097362 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:39.097813 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:39.097813 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:f9:ad:bc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:39.098185 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Using config drive
Jun 27 04:10:39.262329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:39.608827 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:39.628964 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00045954999995956314 future=<Future at 0x7ec5181ffbf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:39.629107 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:39.629728 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Emitting event <LifecycleEvent: 1782533424.6283877, 6d020229-688f-487c-8458-d1f3cd69257b => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:39.630463 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Stopped (Lifecycle Event)
Jun 27 04:10:39.785469 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Creating config drive at /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config
Jun 27 04:10:39.789256 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4x8kfh97 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:39.843563 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4x8kfh97" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:40.133578 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:40.136233 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:40.311917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:40.312197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:40.319646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:40.361581 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:40.449350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:40.496048 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:40.497225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:40.642822 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eb3c94ef-d433-451b-9232-d37abfb0cbec tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:10:40.815256 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:10:41.297254 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533441.2968624, fa5fe299-857b-41f5-8069-c3324c227036 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:41.297801 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Started (Lifecycle Event)
Jun 27 04:10:41.370754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:41.371619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:41.374795 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:10:41.393863 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Claim successful on node np0000003830
Jun 27 04:10:41.401201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 330000000d9190441 for multipath device dm-13 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:10:41.401592 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.081s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:41.401767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (8081ms) {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:41.401962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d9190441', 'path': '/dev/dm-13', 'multipath_id': '330000000d9190441'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:10:41.404897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.977s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:41.404897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:10:41.415957 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:41.416637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:41.417169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:41.417475 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:41.417903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:41.418195 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:41.429805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:10:41.429805 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:41.431875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:10:41.431875 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807] added
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:41.443520 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:41.443901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:10:41.443901 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:10:41.444002 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807] added
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:41.451341 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:41.451654 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:10:41.451868 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:10:41.452400 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:10:41.800206 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:41.802430 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533441.8021612, fa5fe299-857b-41f5-8069-c3324c227036 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:41.802603 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Paused (Lifecycle Event)
Jun 27 04:10:41.909188 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=26,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:42Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-kpbrjr46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=6d020229-688f-487c-8458-d1f3cd69257b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:10:41.909617 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:41.910353 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <uuid>6d020229-688f-487c-8458-d1f3cd69257b</uuid>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <name>instance-0000001a</name>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <memory>262144</memory>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:name>multiattach-server-1</nova:name>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:10:33</nova:creationTime>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.micro" id="84">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:memory>256</nova:memory>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         <nova:port uuid="dad80f04-574e-4c16-a005-e27d4fd01f73">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <entry name="serial">6d020229-688f-487c-8458-d1f3cd69257b</entry>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <entry name="uuid">6d020229-688f-487c-8458-d1f3cd69257b</entry>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk.config"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-13"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <shareable/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:04:7e:18"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <target dev="tapdad80f04-57"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/console.log" append="off"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:10:41.912385 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:10:41.914689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=26,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:08:42Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-kpbrjr46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=6d020229-688f-487c-8458-d1f3cd69257b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:10:41.914689 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "vif_mac": "fa:16:3e:04:7e:18"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:41.914689 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:41.914689 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:10:41.915250 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.915299 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:41.915663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:10:41.916821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.916965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3013968a-5d90-5cbf-aa0c-2a1efde84a3a', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:41.917861 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.918488 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:41.920335 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.924255 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.924542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdad80f04-57, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:41.924926 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdad80f04-57, col_values=(('qos', UUID('00782ecf-4f87-4f82-aa0d-1734fd29bdde')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:41.925092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdad80f04-57, col_values=(('external_ids', {'iface-id': 'dad80f04-574e-4c16-a005-e27d4fd01f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:7e:18', 'vm-uuid': '6d020229-688f-487c-8458-d1f3cd69257b'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:41.926925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.928428 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:41.936834 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:41.937735 np0000003830 nova-compute[98984]: INFO os_vif [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57')
Jun 27 04:10:42.046963 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b388334b-ba22-492d-be1c-20e2111038f1 req-c7c8b608-10c9-4404-ae38-c47f07a56cc1 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:42.047735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b388334b-ba22-492d-be1c-20e2111038f1 req-c7c8b608-10c9-4404-ae38-c47f07a56cc1 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:42.047960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b388334b-ba22-492d-be1c-20e2111038f1 req-c7c8b608-10c9-4404-ae38-c47f07a56cc1 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:42.048206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b388334b-ba22-492d-be1c-20e2111038f1 req-c7c8b608-10c9-4404-ae38-c47f07a56cc1 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:42.048509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b388334b-ba22-492d-be1c-20e2111038f1 req-c7c8b608-10c9-4404-ae38-c47f07a56cc1 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Processing event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:10:42.049450 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:10:42.056309 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:10:42.056309 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance spawned successfully.
Jun 27 04:10:42.056309 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:10:42.305298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:42.307092 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533442.306822, fa5fe299-857b-41f5-8069-c3324c227036 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:42.307283 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Resumed (Lifecycle Event)
Jun 27 04:10:42.445026 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:42.452512 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:42.459179 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:42.468440 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.474677 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.483513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.494375 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.500102 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.500428 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:42.530611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260]
Jun 27 04:10:42.530611 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:42.530611 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.546112 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.552574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260]
Jun 27 04:10:42.552574 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:42.552574 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.563597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:42.563597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:42.563597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:42.563597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:42.563597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:42.564340 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:42.569442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.570647 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:42.571324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:42.572208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:42.573656 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('7', '-', '-', 0) found on session 63 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:42.573794 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.585972 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:42.586727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:42.587516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('8', '-', '-', 0) found on session 64 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:42.587663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:42.598174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 63 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:42.598174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:42.616421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 64 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:42.616421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:42.810041 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:42.812482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:43.074993 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Took 8.22 seconds to spawn the instance on the hypervisor.
Jun 27 04:10:43.074993 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:43.161468 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:43.161759 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:43.317304 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:10:43.419348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:10:43.470411 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:43.470641 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:43.470701 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:43.470824 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:04:7e:18, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:43.471365 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Using config drive
Jun 27 04:10:43.584785 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Took 14.23 seconds to build instance.
Jun 27 04:10:43.665849 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:43.835860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.007832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.060282 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.060282 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.092097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5d9fc5ed-35da-478d-93e8-c6869973f95b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.752s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:44.140325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.150586 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4608fcd2-6a49-4994-ba93-0cb0d807712c req-e1aa5d97-99ee-4bbc-8a11-86ef6aee465e service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:44.150586 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4608fcd2-6a49-4994-ba93-0cb0d807712c req-e1aa5d97-99ee-4bbc-8a11-86ef6aee465e service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:44.150749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4608fcd2-6a49-4994-ba93-0cb0d807712c req-e1aa5d97-99ee-4bbc-8a11-86ef6aee465e service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:44.150749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4608fcd2-6a49-4994-ba93-0cb0d807712c req-e1aa5d97-99ee-4bbc-8a11-86ef6aee465e service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:44.151146 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4608fcd2-6a49-4994-ba93-0cb0d807712c req-e1aa5d97-99ee-4bbc-8a11-86ef6aee465e service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:44.151146 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4608fcd2-6a49-4994-ba93-0cb0d807712c req-e1aa5d97-99ee-4bbc-8a11-86ef6aee465e service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state active and task_state None.
Jun 27 04:10:44.181837 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.810s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:44.181837 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:10:44.192760 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.263147 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:44.392836 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-89b91745-1202-4cb1-83e0-8ec10dce0df3 req-bb100943-dd0d-4582-8ff9-945045f93b0f service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:44.392836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-89b91745-1202-4cb1-83e0-8ec10dce0df3 req-bb100943-dd0d-4582-8ff9-945045f93b0f service nova] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:44.392836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-89b91745-1202-4cb1-83e0-8ec10dce0df3 req-bb100943-dd0d-4582-8ff9-945045f93b0f service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:44.392836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-89b91745-1202-4cb1-83e0-8ec10dce0df3 req-bb100943-dd0d-4582-8ff9-945045f93b0f service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:44.392836 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-89b91745-1202-4cb1-83e0-8ec10dce0df3 req-bb100943-dd0d-4582-8ff9-945045f93b0f service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] No waiting events found dispatching network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:44.392836 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-89b91745-1202-4cb1-83e0-8ec10dce0df3 req-bb100943-dd0d-4582-8ff9-945045f93b0f service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received unexpected event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 for instance with vm_state active and task_state resize_finish.
Jun 27 04:10:44.436863 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found WWN 33000000021e5921c for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:10:44.437122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:44.437294 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== connect_volume: return (8011ms) {'type': 'block', 'scsi_wwn': '33000000021e5921c', 'path': '/dev/dm-0', 'multipath_id': '33000000021e5921c'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:44.437450 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021e5921c', 'path': '/dev/dm-0', 'multipath_id': '33000000021e5921c'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:10:44.444008 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:44.691412 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:10:44.691806 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:10:44.692161 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:44.692518 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:44.801941 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6787c0723ee4e7097d500e19c4cba02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1b9b8f3bfc490dbd68a422dabbe3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:10:44.947233 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Attempting to attach volume 7e939eb8-73aa-4e96-b26f-735bf9284807 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]:   <alias name="ua-7e939eb8-73aa-4e96-b26f-735bf9284807"/>
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]:   <serial>7e939eb8-73aa-4e96-b26f-735bf9284807</serial>
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:10:44.948716 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:10:45.079527 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533445.0786355, 6d020229-688f-487c-8458-d1f3cd69257b => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:45.079527 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Resumed (Lifecycle Event)
Jun 27 04:10:45.080775 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:10:45.086836 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance running successfully.
Jun 27 04:10:45.089585 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Failed to set time: agent not configured {{(pid=98984) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 27 04:10:45.089836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1123a6a-f2b1-4b73-b13b-54300185d98a tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] finish_migration finished successfully. {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12905}}
Jun 27 04:10:45.192250 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:10:45.254221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:45.255193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:45.452271 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Successfully created port: 5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:10:45.582473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:45.584959 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:45.700036 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:10:45.787871 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'flavor' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:46.088852 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:10:46.089231 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533446.0889432, 6d020229-688f-487c-8458-d1f3cd69257b => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:46.089328 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Started (Lifecycle Event)
Jun 27 04:10:46.096411 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Successfully updated port: 5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:10:46.237636 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:46.237845 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing instance network info cache due to event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:46.238040 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:46.238110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:46.238333 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:46.465612 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b5e97e40-fab6-4f86-87dd-8135a6a2afcb req-27aaa160-ed66-417e-ad72-a88949136ec8 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:46.466703 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b5e97e40-fab6-4f86-87dd-8135a6a2afcb req-27aaa160-ed66-417e-ad72-a88949136ec8 service nova] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:46.466888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b5e97e40-fab6-4f86-87dd-8135a6a2afcb req-27aaa160-ed66-417e-ad72-a88949136ec8 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:46.467038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b5e97e40-fab6-4f86-87dd-8135a6a2afcb req-27aaa160-ed66-417e-ad72-a88949136ec8 service nova] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:46.467182 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b5e97e40-fab6-4f86-87dd-8135a6a2afcb req-27aaa160-ed66-417e-ad72-a88949136ec8 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] No waiting events found dispatching network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:46.467384 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-b5e97e40-fab6-4f86-87dd-8135a6a2afcb req-27aaa160-ed66-417e-ad72-a88949136ec8 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received unexpected event network-vif-plugged-dad80f04-574e-4c16-a005-e27d4fd01f73 for instance with vm_state resized and task_state None.
Jun 27 04:10:46.592651 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:46.595296 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:46.599405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:46.599636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:46.599811 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:46.630699 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:46.630815 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:46.630918 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:46.631071 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:fd:3a:c2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:46.708956 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:10:46.710045 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:10:46.710312 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Creating image(s)
Jun 27 04:10:46.710792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:46.710989 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:46.711479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:46.712049 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:46.714723 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:46.715908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:46.746957 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:46.767310 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:46.810792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:46.811211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:46.811779 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:46.812282 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:46.815030 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:10:46.816326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:46.915388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:46.918213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:46.947515 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:47.002265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk 1073741824" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:47.006525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:47.006525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:47.099270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:47.100183 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:10:47.100592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:47.199310 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:47.199764 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Cannot resize image /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:10:47.200067 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:10:47.200244 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Ensure instance console log exists: /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:10:47.200509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:47.200717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:47.200847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:47.209767 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:47.244112 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:10:47.417131 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updated VIF entry in instance network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:47.417482 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:47.460298 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:47.664129 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:47.665602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:47.665856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:47.666198 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Going to confirm migration 3 {{(pid=98984) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
Jun 27 04:10:47.906717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:47.906908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:47.907334 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attaching volume 5baba415-cddd-4b29-a3d7-be8db80f081a to /dev/vdb
Jun 27 04:10:47.921334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:47.921712 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-changed-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:47.921789 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Refreshing instance network info cache due to event network-changed-5a31a876-771a-4133-85ce-0ca67fa2d4af. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:47.921957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:47.963060 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:47.978070 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:10:48.003056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:48.051092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:10:48.051439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:10:48.060717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:10:48.066725 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe97:a8ba', 'fe80::1c14:85ff:fe33:e2b2', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fe4d:5128', 'fe80::f08b:efff:fea4:45fa', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fef9:adbc', 'fe80::fc16:3eff:fe04:7e18'] 
Jun 27 04:10:48.067033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:10:48.067168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:10:48.067470 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:48.067829 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating existing volume attachment record: 575f5dbb-fb84-4ee7-a49f-9a67d994aacd {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:10:48.168191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:48.168802 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance network_info: |[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:10:48.174166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:48.176260 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Refreshing network info cache for port 5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:48.177895 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start _get_guest_xml network_info=[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:10:48.179013 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:48.187430 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:48.189017 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-118420821', uuid='a41c0a78-a4b0-4a62-b391-e0eef4bd2329'), owner=OwnerMeta(userid='e6787c0723ee4e7097d500e19c4cba02', username='tempest-ServerActionsTestOtherB-2075548864-project-member', projectid='7e1b9b8f3bfc490dbd68a422dabbe3c6', projectname='tempest-ServerActionsTestOtherB-2075548864'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533448.188534) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:10:48.194979 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:10:48.197966 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:10:48.200513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:10:48.200868 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:10:48.205391 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:10:48.205391 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:10:48.208415 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:10:48.208415 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:10:48.208773 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:10:48.208970 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:10:48.209171 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:10:48.209463 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:10:48.209906 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:10:48.210082 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:10:48.210738 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:10:48.211353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-203b04d9-a0be-40e8-a3e3-7d9ec6e8188d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.504s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:48.212648 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:10:48.242650 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:10:48.243106 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:48.243856 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:48.245908 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'pci_devices' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:48.403526 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:48.464397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:48.464660 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:48.464885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:48.465026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:48.465123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:48.469543 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Terminating instance
Jun 27 04:10:48.524305 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:48.525039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:48.525334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:48.526621 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:48.526621 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'info_cache' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:48.649257 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:10:48.650776 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5baba415-cddd-4b29-a3d7-be8db80f081a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:48.651568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:48.652482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:48.652698 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5baba415-cddd-4b29-a3d7-be8db80f081a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:10:48.669235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:48.670596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:48.670805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:48.671124 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:48.671931 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:48.672107 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:48.681549 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:48.688697 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:10:48.688697 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:48.697211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:10:48.697211 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a] added
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:48.707688 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:48.708058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:10:48.708229 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:10:48.708556 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a] added
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:48.712967 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:48.713292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:10:48.713292 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:10:48.713382 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <uuid>a41c0a78-a4b0-4a62-b391-e0eef4bd2329</uuid>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <name>instance-00000021</name>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherB-server-118420821</nova:name>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:10:48</nova:creationTime>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:user uuid="e6787c0723ee4e7097d500e19c4cba02">tempest-ServerActionsTestOtherB-2075548864-project-member</nova:user>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:project uuid="7e1b9b8f3bfc490dbd68a422dabbe3c6">tempest-ServerActionsTestOtherB-2075548864</nova:project>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         <nova:port uuid="5a31a876-771a-4133-85ce-0ca67fa2d4af">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <entry name="serial">a41c0a78-a4b0-4a62-b391-e0eef4bd2329</entry>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <entry name="uuid">a41c0a78-a4b0-4a62-b391-e0eef4bd2329</entry>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:bc:36:85"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <target dev="tap5a31a876-77"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/console.log" append="off"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:10:48.749793 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Preparing to wait for external event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:48.751797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:48.753166 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:10:48.753166 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:48.753731 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:48.753731 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:10:48.757165 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:48.757603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:48.758638 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:10:48.760372 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98984) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 27 04:10:48.760905 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:48.761865 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:48.762287 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '010a60ca-ce21-5cf9-a9c1-331a2f9453cc', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:48.764247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:48.764887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:48.767384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:48.767669 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a31a876-77, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:48.768153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a31a876-77, col_values=(('qos', UUID('edb8e22e-4a94-4ac5-8e2b-e5e43deb6b7b')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:48.768363 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a31a876-77, col_values=(('external_ids', {'iface-id': '5a31a876-771a-4133-85ce-0ca67fa2d4af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:36:85', 'vm-uuid': 'a41c0a78-a4b0-4a62-b391-e0eef4bd2329'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:48.772018 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:48.777613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:48.778866 np0000003830 nova-compute[98984]: INFO os_vif [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77')
Jun 27 04:10:48.973646 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:10:49.017807 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.028599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.053838 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.077423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.109658 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.204561 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:49.271010 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.366280 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999562246000096 future=<Future at 0x7ec5382c2f60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:49.371073 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.994238957000107 future=<Future at 0x7ec5382c2f60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:49.373040 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.992164229000082 future=<Future at 0x7ec5382c2f60 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:49.374367 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Instance destroyed successfully.
Jun 27 04:10:49.377300 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lazy-loading 'resources' on Instance uuid 30950d61-f1cd-4a81-ae4e-cce3af742f8e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:49.435984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-428f87a7-3ee6-4a89-8baf-7777f348ac05 req-e97294dc-edef-4f2b-bd42-00f809babad1 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:49.436288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-428f87a7-3ee6-4a89-8baf-7777f348ac05 req-e97294dc-edef-4f2b-bd42-00f809babad1 service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:49.436571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-428f87a7-3ee6-4a89-8baf-7777f348ac05 req-e97294dc-edef-4f2b-bd42-00f809babad1 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:49.436798 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-428f87a7-3ee6-4a89-8baf-7777f348ac05 req-e97294dc-edef-4f2b-bd42-00f809babad1 service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:49.436965 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-428f87a7-3ee6-4a89-8baf-7777f348ac05 req-e97294dc-edef-4f2b-bd42-00f809babad1 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] No waiting events found dispatching network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:49.449092 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-428f87a7-3ee6-4a89-8baf-7777f348ac05 req-e97294dc-edef-4f2b-bd42-00f809babad1 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:49.449092 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updated VIF entry in instance network info cache for port 5a31a876-771a-4133-85ce-0ca67fa2d4af. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:49.449092 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:49.540917 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:49.709303 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:49.714035 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:49.725616 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:49.739709 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.749533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.760063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.771784 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.772221 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.782014 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.782338 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:49.832757 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.838242 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.856350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.40.100,3260]
Jun 27 04:10:49.856350 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:49.856350 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.865419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.870032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.50.100,3260]
Jun 27 04:10:49.870032 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:49.870032 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.872657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.878381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.884706 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1132427580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumeshelvetestjson-server-1132427580',id=27,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVt9g2d513AIYOYb6LiuPwYG6oX3C2oII3ItZ1PJ/n4MUe6a9MCUTqu9xNI2D3kplYH65gknH7G2IWBZOJr0bvELLDtyzp1751z25UlKgeFCB7JOkLCEZ2zV42L7VVOJg==',key_name='tempest-keypair-46950425',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:10Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='469d72ff5a3640dbb2193b8a91deeac0',ramdisk_id='',reservation_id='r-lmts48ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1443827218',owner_user_name='tempest-AttachVolumeShelveTestJSON-1443827218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a996571fb63c4c6e993f1fa02549a086',uuid=30950d61-f1cd-4a81-ae4e-cce3af742f8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:49.886230 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converting VIF {"id": "50c70b8e-7688-43e8-a450-c35d577448e4", "address": "fa:16:3e:4d:51:28", "network": {"id": "044278ed-d247-46c2-a928-e8b49f6ae480", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1830948394-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "469d72ff5a3640dbb2193b8a91deeac0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c70b8e-76", "ovs_interfaceid": "50c70b8e-7688-43e8-a450-c35d577448e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:49.887424 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:49.887814 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:49.889259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:49.892378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.892378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c70b8e-76, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:49.893650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.894301 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:49.900833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:49.903298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] HCTL ('9', '-', '-', 0) found on session 65 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:49.903298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.916033 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] HCTL ('10', '-', '-', 0) found on session 66 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 65 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5baba415-cddd-4b29-a3d7-be8db80f081a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-95676cc3-7223-40bd-9669-3af1dd8715a6 req-f64d9d76-bd34-4418-973d-57eb0067fa99 service nova] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b02a745b-3a78-4a28-bf22-4a64af9e49c9) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 66 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:49.972021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5baba415-cddd-4b29-a3d7-be8db80f081a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:49.994464 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:49.999000 np0000003830 nova-compute[98984]: INFO os_vif [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:51:28,bridge_name='br-int',has_traffic_filtering=True,id=50c70b8e-7688-43e8-a450-c35d577448e4,network=Network(044278ed-d247-46c2-a928-e8b49f6ae480),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c70b8e-76')
Jun 27 04:10:49.999244 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Deleting instance files /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e_del
Jun 27 04:10:50.006969 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Deletion of /opt/stack/data/nova/instances/30950d61-f1cd-4a81-ae4e-cce3af742f8e_del complete
Jun 27 04:10:50.156149 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999697679999827 future=<Future at 0x7ec53afcbe30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:10:50.160838 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance destroyed successfully.
Jun 27 04:10:50.161370 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'numa_topology' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:50.179662 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:50.326511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:50.326511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:50.326511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No VIF found with MAC fa:16:3e:bc:36:85, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:50.326511 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Using config drive
Jun 27 04:10:50.424475 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:50.517222 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Took 1.54 seconds to destroy the instance on the hypervisor.
Jun 27 04:10:50.518184 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:10:50.518424 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:10:50.518626 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:10:50.518915 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:50.637783 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:50.666813 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:50.667074 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:50.674294 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:10:50.808332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:50.829283 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:50.926658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:50.927038 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'migration_context' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:51.034537 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Creating config drive at /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config
Jun 27 04:10:51.048815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn1gjtj7s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:51.113062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn1gjtj7s" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:51.180788 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8a6bc9c4-ec56-423a-a771-eca558bee2af tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.430s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:51.300554 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-62a5d920-cacf-41a6-bb77-6f2d1d9d0f03 req-9ea9ed2b-6cf6-458c-bfe5-f9920320e274 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-deleted-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:51.300794 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-62a5d920-cacf-41a6-bb77-6f2d1d9d0f03 req-9ea9ed2b-6cf6-458c-bfe5-f9920320e274 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Neutron deleted interface 50c70b8e-7688-43e8-a450-c35d577448e4; detaching it from the instance and deleting it from the info cache
Jun 27 04:10:51.303826 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-62a5d920-cacf-41a6-bb77-6f2d1d9d0f03 req-9ea9ed2b-6cf6-458c-bfe5-f9920320e274 service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Detach interface failed, port_id=50c70b8e-7688-43e8-a450-c35d577448e4, reason: Instance 30950d61-f1cd-4a81-ae4e-cce3af742f8e could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:10:51.432631 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Object Instance<6d020229-688f-487c-8458-d1f3cd69257b> lazy-loaded attributes: info_cache,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:51.436920 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:51.437349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:51.521100 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cca41f2f-7735-4e10-aba0-f9a10de15b66 req-34a86fb1-f535-43e8-8e17-ff172ba0eeaa service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:51.521100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cca41f2f-7735-4e10-aba0-f9a10de15b66 req-34a86fb1-f535-43e8-8e17-ff172ba0eeaa service nova] Acquiring lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:51.521100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cca41f2f-7735-4e10-aba0-f9a10de15b66 req-34a86fb1-f535-43e8-8e17-ff172ba0eeaa service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:51.521100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cca41f2f-7735-4e10-aba0-f9a10de15b66 req-34a86fb1-f535-43e8-8e17-ff172ba0eeaa service nova] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:51.521100 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cca41f2f-7735-4e10-aba0-f9a10de15b66 req-34a86fb1-f535-43e8-8e17-ff172ba0eeaa service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] No waiting events found dispatching network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:51.521100 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cca41f2f-7735-4e10-aba0-f9a10de15b66 req-34a86fb1-f535-43e8-8e17-ff172ba0eeaa service nova] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Received event network-vif-unplugged-50c70b8e-7688-43e8-a450-c35d577448e4 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:10:51.534247 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f3094fb2-42a8-48c4-9db6-dbeabb612d05 req-d89214ee-7008-4c0b-afd8-92f0bb3a66bc service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:51.537206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f3094fb2-42a8-48c4-9db6-dbeabb612d05 req-d89214ee-7008-4c0b-afd8-92f0bb3a66bc service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:51.537534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f3094fb2-42a8-48c4-9db6-dbeabb612d05 req-d89214ee-7008-4c0b-afd8-92f0bb3a66bc service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:51.543957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f3094fb2-42a8-48c4-9db6-dbeabb612d05 req-d89214ee-7008-4c0b-afd8-92f0bb3a66bc service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:51.544141 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f3094fb2-42a8-48c4-9db6-dbeabb612d05 req-d89214ee-7008-4c0b-afd8-92f0bb3a66bc service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:51.544233 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f3094fb2-42a8-48c4-9db6-dbeabb612d05 req-d89214ee-7008-4c0b-afd8-92f0bb3a66bc service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:10:51.695953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found WWN 33000000009e93474 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:10:51.715335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:51.715335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '33000000009e93474', 'path': '/dev/dm-1', 'multipath_id': '33000000009e93474'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:51.715335 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000009e93474', 'path': '/dev/dm-1', 'multipath_id': '33000000009e93474'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:10:51.723635 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:51.738639 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:51.748449 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'flavor' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:51.777871 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:51.902705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:52.051972 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:52.225443 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:52.231670 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Took 1.71 seconds to deallocate network for instance.
Jun 27 04:10:52.235142 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:52.244340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:52.254844 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attempting to attach volume 5baba415-cddd-4b29-a3d7-be8db80f081a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]:   <alias name="ua-5baba415-cddd-4b29-a3d7-be8db80f081a"/>
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]:   <serial>5baba415-cddd-4b29-a3d7-be8db80f081a</serial>
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:10:52.258958 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:10:52.281961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:52.558539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:52.558828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquired lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:52.558916 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:10:52.559074 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'info_cache' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:52.759863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:52.923759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:52.924365 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:53.035213 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533453.034851, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:53.035394 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Started (Lifecycle Event)
Jun 27 04:10:53.064008 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:53.375382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:53.375651 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:53.375877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:53.376079 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:53.376299 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Processing event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:10:53.377124 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:53.377313 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:53.377577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:53.377819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:53.377951 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:53.378100 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-63216cac-8fef-45ea-b257-4b3b45b6c862 req-0690159c-d2cf-4dcc-b0ce-f1046d0fb0d5 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state building and task_state spawning.
Jun 27 04:10:53.378352 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:10:53.385032 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:10:53.388663 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance spawned successfully.
Jun 27 04:10:53.388990 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:10:53.429776 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:53.538473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:53.542222 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:53.568725 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:53.611384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44a24335-0765-4527-9e49-bf3d19f9a753 req-900f5792-42a7-4324-9ea7-1048da5bcfa3 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:53.611384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44a24335-0765-4527-9e49-bf3d19f9a753 req-900f5792-42a7-4324-9ea7-1048da5bcfa3 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:53.612742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44a24335-0765-4527-9e49-bf3d19f9a753 req-900f5792-42a7-4324-9ea7-1048da5bcfa3 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:53.613152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44a24335-0765-4527-9e49-bf3d19f9a753 req-900f5792-42a7-4324-9ea7-1048da5bcfa3 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:53.613681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44a24335-0765-4527-9e49-bf3d19f9a753 req-900f5792-42a7-4324-9ea7-1048da5bcfa3 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:10:53.614348 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-44a24335-0765-4527-9e49-bf3d19f9a753 req-900f5792-42a7-4324-9ea7-1048da5bcfa3 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:10:53.899370 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:53.899732 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:53.900201 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:53.900584 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:53.900987 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:53.901355 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:10:53.978513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:53.978513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:53.979738 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:10:53.979738 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No VIF found with MAC fa:16:3e:97:a8:ba, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:10:54.023279 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:54.045419 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:10:54.045762 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533454.045525, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:54.045945 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Paused (Lifecycle Event)
Jun 27 04:10:54.204348 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating instance_info_cache with network_info: [{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:54.269517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:54.408741 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Took 7.70 seconds to spawn the instance on the hypervisor.
Jun 27 04:10:54.408917 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:54.449141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.012s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:54.453233 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.690s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:54.553021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:54.555272 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533454.5550315, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:10:54.555400 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Resumed (Lifecycle Event)
Jun 27 04:10:54.710097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Releasing lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:54.835674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:54.836104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:54.924930 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Took 13.60 seconds to build instance.
Jun 27 04:10:54.958285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:55.061403 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:10:55.067435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:10:55.153085 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocation for migration 0795f6e0-39b1-40c5-ad79-78a9fbde7b1d
Jun 27 04:10:55.235700 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:55.235985 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:55.338262 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:10:55.427061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.115s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:55.589628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5afa1c74-a0fe-4c7d-8f63-b343c9b31a8b tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.682s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:55.659031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6cd9eed6-e0d2-450a-ad88-0aa0f9c1df1f tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.993s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:55.731159 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance destroyed successfully.
Jun 27 04:10:55.731159 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'numa_topology' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:55.739117 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:55.926725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:56.232779 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:56.233233 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'resources' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:56.253605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.804s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:56.256852 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.327s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:56.262581 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:10:56.262793 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Claim successful on node np0000003830
Jun 27 04:10:56.323445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:56.323765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:56.329158 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Deleted allocations for instance 30950d61-f1cd-4a81-ae4e-cce3af742f8e
Jun 27 04:10:56.670507 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-changed-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:56.670649 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing instance network info cache due to event network-changed-5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:56.670750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] Acquiring lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:56.670866 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] Acquired lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:56.671016 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Refreshing network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:56.735392 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:56.736663 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:10:56.736663 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:10:56.737139 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:10:56.740215 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:10:56.740215 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:56.740215 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeef0b1e2-12, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:56.747856 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:56.748986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:56.750235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:56.752381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:56.752381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a45a01e0-56ff-457f-9ce8-faaad427179e) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:10:56.752870 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:56.753517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:10:56.755485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:56.758418 np0000003830 nova-compute[98984]: INFO os_vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12')
Jun 27 04:10:56.760255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:10:56.760709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:56.760961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:56.761397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:56.761913 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:10:56.762146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:56.799063 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', '66')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:10:56.800108 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '63')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:56.801061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '64')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:10:56.802900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53813b4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:10:56.804242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:10:56.804242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flush multipath device 33000000021e5921c {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:10:56.833415 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'flavor' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:56.848161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:56.911696 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:10:56.966396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:10:56.966639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:10:56.968514 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:10:56.982377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:10:56.982762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:10:56.995629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.031837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260]
Jun 27 04:10:57.031837 np0000003830 nova-compute[98984]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:57.031837 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.056050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.071079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.111299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260]
Jun 27 04:10:57.111299 np0000003830 nova-compute[98984]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:57.111299 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.133856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.134116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:57.134241 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== disconnect_volume: return (373ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:57.134473 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:10:57.145270 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start _get_guest_xml network_info=[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'b1034e7d-6bee-492d-b9fe-f94ada9d434d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '075f803b-49f2-4084-9d8a-10d59d1c62eb', 'attached_at': '', 'detached_at': '', 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'serial': '7e939eb8-73aa-4e96-b26f-735bf9284807'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:10:57.148784 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:10:57.150330 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1106153631', uuid='075f803b-49f2-4084-9d8a-10d59d1c62eb'), owner=OwnerMeta(userid='216588ecf8894ad5aeb6914196a090db', username='tempest-AttachVolumeTestJSON-559471176-project-member', projectid='72fed82034484f13a228c535b175c167', projectname='tempest-AttachVolumeTestJSON-559471176'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533457.1497328) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:10:57.153190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:10:57.153190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:10:57.154977 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:10:57.155333 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:10:57.156847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:10:57.157275 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:10:57.157589 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:10:57.157811 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:10:57.158050 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:10:57.158242 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:10:57.158445 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:10:57.158784 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:10:57.158990 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:10:57.159186 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:10:57.159397 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:10:57.159618 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:10:57.159891 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'vcpu_model' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:10:57.173426 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:57.346642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a260bf77-f4a6-4709-b4f9-7f50c590bf1d tempest-AttachVolumeShelveTestJSON-1443827218 tempest-AttachVolumeShelveTestJSON-1443827218-project-member] Lock "30950d61-f1cd-4a81-ae4e-cce3af742f8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.882s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:57.413070 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-changed-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:57.413659 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Refreshing instance network info cache due to event network-changed-5a31a876-771a-4133-85ce-0ca67fa2d4af. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:57.413963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:57.414098 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:57.414263 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Refreshing network info cache for port 5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:57.610050 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:57.665188 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:10:57.693647 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:57.788832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:10:57.791018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:57.791316 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:57.792334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:57.792877 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:10:57.793453 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:57.793680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:57.794749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:57.796170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:10:57.809798 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:57.812177 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:57.812391 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:57.813052 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:57.818283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:10:57.821059 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updated VIF entry in instance network info cache for port 5621924f-9e14-46a7-bd15-6952d449805b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:57.821623 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:57.822054 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [{"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:57.824337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:10:57.824337 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.833538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:10:57.833538 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807] added
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:10:57.846806 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:10:57.847386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.524s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807] added
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:10:57.848988 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:57.849219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:10:57.850315 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:10:57.850994 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:10:57.917022 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:58.102675 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:10:58.102964 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:10:58.325797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a1018db6-ac05-4ec1-ba9c-bcd31b9f5ab2 req-a2f498a8-da1a-4aeb-b3a4-c4b946d6fcf1 service nova] Releasing lock "refresh_cache-e52a57a3-19dd-482d-bd3a-20e3a5230c4e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:58.369319 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:58.546617 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updated VIF entry in instance network info cache for port 5a31a876-771a-4133-85ce-0ca67fa2d4af. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:58.546894 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:10:58.606228 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:10:58.728438 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:10:58.728874 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing instance network info cache due to event network-changed-dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:10:58.729067 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] Acquiring lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:10:58.729152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] Acquired lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:10:58.729266 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Refreshing network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:10:58.846942 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:10:58.853511 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:58.862184 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:10:58.870380 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.876415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.883012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.897889 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.898308 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.903635 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.903974 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:58.934336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:10:58.934629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:10:58.937549 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attaching volume c70c370c-30c7-46c0-972e-0eb37ba966d3 to /dev/vdc
Jun 27 04:10:58.949814 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260]
Jun 27 04:10:58.949814 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260] successful.
Jun 27 04:10:58.949814 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.960620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260]
Jun 27 04:10:58.960620 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260] successful.
Jun 27 04:10:58.960620 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.966185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.976034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:58.988014 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:58.988469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:58.988953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:58.990012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('7', '-', '-', 0) found on session 67 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:58.990178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:59.001109 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:10:59.001456 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:10:59.001811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:10:59.001811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:10:59.002873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('8', '-', '-', 0) found on session 68 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:10:59.003006 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:10:59.016010 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:59.016010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 67 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:59.016010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:10:59.023786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 68 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:10:59.025600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:10:59.049058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-35ce5025-97b1-4eeb-b754-e82a3da11f65 req-27690b5b-ada9-4af6-a654-2957dc97f0de service nova] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:10:59.053642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:10:59.106492 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:10:59.106965 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:10:59.118649 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.865s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:10:59.119307 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:10:59.125787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:10:59.127111 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:fe97:a8ba', 'fe80::1c14:85ff:fe33:e2b2', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fef9:adbc', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:febc:3685', 'fe80::1c7a:4ff:fe26:3a4a'] 
Jun 27 04:10:59.127312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:10:59.127611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:10:59.127827 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:10:59.128092 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating existing volume attachment record: aeab669a-0f30-4485-a1c4-59569204a751 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:10:59.232983 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:59.272920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:10:59.607659 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:59.635365 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:10:59.635564 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:10:59.636151 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:59.638682 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:10:59.701962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:10:59.701962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c70c370c-30c7-46c0-972e-0eb37ba966d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:10:59.701962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:10:59.739598 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cf90b3e43344e76aa1e04e16824517a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1121cceb6eae4ccb920a6e3123169bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:10:59.777384 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updated VIF entry in instance network info cache for port dad80f04-574e-4c16-a005-e27d4fd01f73. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:10:59.777384 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [{"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:00.021884 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 68 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:00.022101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:00.141045 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:11:00.268366 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Successfully created port: 7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:11:00.278596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45aea2ec-c4b6-41b9-97a9-8d7849ba5bd2 req-983f16c5-e0ce-470c-b67b-86eddcdc8e2a service nova] Releasing lock "refresh_cache-6d020229-688f-487c-8458-d1f3cd69257b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:00.647231 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:11:00.838851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found WWN 33000000021e5921c for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:11:00.839300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:00.839535 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '33000000021e5921c', 'path': '/dev/dm-0', 'multipath_id': '33000000021e5921c'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:00.840367 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.139s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:00.840749 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021e5921c', 'path': '/dev/dm-0', 'multipath_id': '33000000021e5921c'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:11:00.840983 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c70c370c-30c7-46c0-972e-0eb37ba966d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:11:00.856127 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:00.857004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:00.857645 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:00.857962 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:00.858444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:00.858684 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:00.874955 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:00.874955 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:00.882157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:00.882157 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3] added
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:00.890684 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:00.890927 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:00.891160 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:00.891366 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:00.895911 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Successfully updated port: 7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3] added
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:00.903614 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:00.904933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:00.905372 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0464(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:00.905486 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:00.969442 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-changed-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:00.969943 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Refreshing instance network info cache due to event network-changed-7a6ba8ee-644a-4584-995a-5306252ef6b9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:00.970119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] Acquiring lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:00.970242 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] Acquired lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:00.970419 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Refreshing network info cache for port 7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:01.350211 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:11:01.350450 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:01.351008 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:01.351652 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'pci_devices' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:01.405475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:01.473027 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:01.563529 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:11:01.656529 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:11:01.656529 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:11:01.656529 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Creating image(s)
Jun 27 04:11:01.657754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "/opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:01.658152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "/opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:01.658864 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "/opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:01.659664 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:01.664164 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:01.665738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:01.757363 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:01.759522 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:01.779704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:01.783753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:01.783753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:01.783753 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:01.785987 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:01.786483 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:01.857158 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <uuid>075f803b-49f2-4084-9d8a-10d59d1c62eb</uuid>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <name>instance-0000001e</name>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeTestJSON-server-1106153631</nova:name>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:10:57</nova:creationTime>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:user uuid="216588ecf8894ad5aeb6914196a090db">tempest-AttachVolumeTestJSON-559471176-project-member</nova:user>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:project uuid="72fed82034484f13a228c535b175c167">tempest-AttachVolumeTestJSON-559471176</nova:project>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         <nova:port uuid="eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <entry name="serial">075f803b-49f2-4084-9d8a-10d59d1c62eb</entry>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <entry name="uuid">075f803b-49f2-4084-9d8a-10d59d1c62eb</entry>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <alias name="ua-7e939eb8-73aa-4e96-b26f-735bf9284807"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <serial>7e939eb8-73aa-4e96-b26f-735bf9284807</serial>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fd:3a:c2"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <target dev="tapeef0b1e2-12"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/console.log" append="off"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:11:01.868854 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:11:01.873958 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:01.895438 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:01.900625 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:01.904527 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:01.919511 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:01.925153 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:01.933178 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:01.944014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:01.950054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:01.966951 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk 1073741824" returned: 0 in 0.065s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:01.967671 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:01.968242 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:01.987672 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:01.988910 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:01.990047 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:01.990909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.017851 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:02.065136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.50.100,3260]
Jun 27 04:11:02.065136 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:02.065136 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:02.086663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:02.089470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.121s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:02.092518 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:11:02.092518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:02.110828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:02.111825 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:11:02.113204 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'trusted_certs' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:02.116957 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.40.100,3260]
Jun 27 04:11:02.116957 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:02.116957 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.117875 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.118412 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:02.119023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.261s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:02.120679 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:02.122685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] HCTL ('15', '-', '-', 0) found on session 69 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:02.122869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:02.134863 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:02.149398 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 69 and hctl ['15', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.157646 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:02.158028 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:02.158437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.301s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:02.158670 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:02.160548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] HCTL ('16', '-', '-', 0) found on session 70 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:02.161967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:02.182475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 70 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:02.182475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c70c370c-30c7-46c0-972e-0eb37ba966d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:02.204089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:02.206152 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Cannot resize image /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:11:02.206152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:11:02.206152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Ensure instance console log exists: /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:11:02.206152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:02.206152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:02.206152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:02.265162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bfd2f2ae-4f76-4a54-8f5c-c61fdb156f06 req-09904713-b112-48e8-a26a-fa53ce9fd297 service nova] Releasing lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:02.265162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquired lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:02.265162 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:11:02.621794 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:02.622252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:02.740582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.117s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:02.745509 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:11:02.745509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:02.838577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:02.844307 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Cannot resize image /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:11:02.844528 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'migration_context' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:02.874074 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:11:02.917159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.073150 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:03.149839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Searching for a device in session 69 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:03.150150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c70c370c-30c7-46c0-972e-0eb37ba966d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:03.286639 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Updating instance_info_cache with network_info: [{"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:03.348722 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:03.349796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:11:03.350069 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:03.350599 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:03.351146 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:11:03.351374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.351598 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:03.351799 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:11:03.352682 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.352907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7daec925-7a62-5e1b-8d4e-a09dd2bb2453', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:03.353486 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.354108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:03.355321 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.359981 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.359981 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeef0b1e2-12, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:03.360410 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeef0b1e2-12, col_values=(('qos', UUID('4eb00637-5a90-47d3-b2dc-73aa1019ba2f')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:03.360660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeef0b1e2-12, col_values=(('external_ids', {'iface-id': 'eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:3a:c2', 'vm-uuid': '075f803b-49f2-4084-9d8a-10d59d1c62eb'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:03.362399 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.363476 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:03.368887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.370074 np0000003830 nova-compute[98984]: INFO os_vif [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12')
Jun 27 04:11:03.792156 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Releasing lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:03.792156 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Instance network_info: |[{"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:11:03.792156 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Start _get_guest_xml network_info=[{"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:11:03.796957 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:11:03.797992 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-651828240', uuid='371a4e1b-1860-46a0-85e5-3f505c4797b3'), owner=OwnerMeta(userid='1cf90b3e43344e76aa1e04e16824517a', username='tempest-VolumesBackupsTest-1314634333-project-member', projectid='1121cceb6eae4ccb920a6e3123169bf9', projectname='tempest-VolumesBackupsTest-1314634333'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533463.7974594) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:11:03.799945 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:11:03.800559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:11:03.801855 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:11:03.802126 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:11:03.803214 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:11:03.803559 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:11:03.803685 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:11:03.803795 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:11:03.803914 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:11:03.803993 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:11:03.804079 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:11:03.804215 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:11:03.804308 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:11:03.804433 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:11:03.804618 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:11:03.804786 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:11:03.818703 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-651828240',display_name='tempest-VolumesBackupsTest-instance-651828240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesbackupstest-instance-651828240',id=34,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV5czgXzDE5iHYo+G3hIharLq05dmgzJFMzgU2/To5wq/65j2/YkFuujjlAIIg4Y9FMn8O9MzZ4+AKu6wgDyrK/0HRXvT3s8pWxj9Bocd8c9jOOicT8xbNqiyx2AB96KQ==',key_name='tempest-keypair-1420135909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1121cceb6eae4ccb920a6e3123169bf9',ramdisk_id='',reservation_id='r-vh0o42fo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1314634333',owner_user_name='tempest-VolumesBackupsTest-1314634333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cf90b3e43344e76aa1e04e16824517a',uuid=371a4e1b-1860-46a0-85e5-3f505c4797b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:11:03.818940 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converting VIF {"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:03.819482 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:03.820278 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'pci_devices' on Instance uuid 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:03.858769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.890389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found WWN 3300000000deb3cb0 for multipath device dm-5 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:11:03.890389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:03.890389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== connect_volume: return (4189ms) {'type': 'block', 'scsi_wwn': '3300000000deb3cb0', 'path': '/dev/dm-5', 'multipath_id': '3300000000deb3cb0'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:03.890389 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000deb3cb0', 'path': '/dev/dm-5', 'multipath_id': '3300000000deb3cb0'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:11:03.895387 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'flavor' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:03.896618 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.899390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:03.997798 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.155340 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f0e32094-8989-4a3b-8e34-2cdb657c59e5 req-7bdbab33-fc1d-41b7-8597-c27d733dcf36 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:04.155415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f0e32094-8989-4a3b-8e34-2cdb657c59e5 req-7bdbab33-fc1d-41b7-8597-c27d733dcf36 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:04.155872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f0e32094-8989-4a3b-8e34-2cdb657c59e5 req-7bdbab33-fc1d-41b7-8597-c27d733dcf36 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:04.156148 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f0e32094-8989-4a3b-8e34-2cdb657c59e5 req-7bdbab33-fc1d-41b7-8597-c27d733dcf36 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:04.156240 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f0e32094-8989-4a3b-8e34-2cdb657c59e5 req-7bdbab33-fc1d-41b7-8597-c27d733dcf36 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:04.156378 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f0e32094-8989-4a3b-8e34-2cdb657c59e5 req-7bdbab33-fc1d-41b7-8597-c27d733dcf36 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:11:04.238263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.241267 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.244397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.270329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <uuid>371a4e1b-1860-46a0-85e5-3f505c4797b3</uuid>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <name>instance-00000022</name>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesBackupsTest-instance-651828240</nova:name>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:11:03</nova:creationTime>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:user uuid="1cf90b3e43344e76aa1e04e16824517a">tempest-VolumesBackupsTest-1314634333-project-member</nova:user>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:project uuid="1121cceb6eae4ccb920a6e3123169bf9">tempest-VolumesBackupsTest-1314634333</nova:project>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         <nova:port uuid="7a6ba8ee-644a-4584-995a-5306252ef6b9">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <entry name="serial">371a4e1b-1860-46a0-85e5-3f505c4797b3</entry>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <entry name="uuid">371a4e1b-1860-46a0-85e5-3f505c4797b3</entry>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.config"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:15:fc:91"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <target dev="tap7a6ba8ee-64"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/console.log" append="off"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Preparing to wait for external event network-vif-plugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:11:04.324904 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-651828240',display_name='tempest-VolumesBackupsTest-instance-651828240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesbackupstest-instance-651828240',id=34,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV5czgXzDE5iHYo+G3hIharLq05dmgzJFMzgU2/To5wq/65j2/YkFuujjlAIIg4Y9FMn8O9MzZ4+AKu6wgDyrK/0HRXvT3s8pWxj9Bocd8c9jOOicT8xbNqiyx2AB96KQ==',key_name='tempest-keypair-1420135909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1121cceb6eae4ccb920a6e3123169bf9',ramdisk_id='',reservation_id='r-vh0o42fo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1314634333',owner_user_name='tempest-VolumesBackupsTest-1314634333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cf90b3e43344e76aa1e04e16824517a',uuid=371a4e1b-1860-46a0-85e5-3f505c4797b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converting VIF {"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.329378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7045036b-9cd5-5356-b567-ae8d90bb8327', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:04.334435 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.335463 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:04.338391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.338391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a6ba8ee-64, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:04.340736 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a6ba8ee-64, col_values=(('qos', UUID('9db91631-f5ef-4290-8439-4eae0a4adf1d')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:04.341932 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a6ba8ee-64, col_values=(('external_ids', {'iface-id': '7a6ba8ee-644a-4584-995a-5306252ef6b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:fc:91', 'vm-uuid': '371a4e1b-1860-46a0-85e5-3f505c4797b3'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:04.343766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.345099 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:04.349944 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:04.351281 np0000003830 nova-compute[98984]: INFO os_vif [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64')
Jun 27 04:11:04.365768 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005428029999166029 future=<Future at 0x7ec5382c2f60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:04.365929 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:04.366140 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.789723173999846 future=<Future at 0x7ec53afcbe30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:04.367842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.7895900729999994 future=<Future at 0x7ec53afcbe30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:04.367842 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] Emitting event <LifecycleEvent: 1782533449.365094, 30950d61-f1cd-4a81-ae4e-cce3af742f8e => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:04.367842 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] VM Stopped (Lifecycle Event)
Jun 27 04:11:04.400576 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attempting to attach volume c70c370c-30c7-46c0-972e-0eb37ba966d3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]:   <alias name="ua-c70c370c-30c7-46c0-972e-0eb37ba966d3"/>
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]:   <serial>c70c370c-30c7-46c0-972e-0eb37ba966d3</serial>
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:04.403024 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:11:04.829380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 075f803b-49f2-4084-9d8a-10d59d1c62eb due to new event <LifecycleEvent: 1782533464.828939, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:11:04.829984 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533464.828939, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:04.829984 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Resumed (Lifecycle Event)
Jun 27 04:11:04.831661 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:11:04.834988 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance rebooted successfully.
Jun 27 04:11:04.871730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] [instance: 30950d61-f1cd-4a81-ae4e-cce3af742f8e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:05.156246 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003818889999820385 future=<Future at 0x7ec53afcbe30 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:05.156401 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:05.333987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:05.337023 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:05.840935 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 27 04:11:05.843053 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533465.8427532, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:05.843223 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Started (Lifecycle Event)
Jun 27 04:11:05.873856 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:05.874066 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:05.874237 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No VIF found with MAC fa:16:3e:15:fc:91, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:05.874747 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Using config drive
Jun 27 04:11:06.099949 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.100084 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.100084 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.101172 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.101172 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] No VIF found with MAC fa:16:3e:97:a8:ba, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:06.222903 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b45780de-9127-4713-a828-978dc73c8003 req-4f15b2ba-393f-44f9-a306-9e6e75100864 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:06.223137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b45780de-9127-4713-a828-978dc73c8003 req-4f15b2ba-393f-44f9-a306-9e6e75100864 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:06.223330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b45780de-9127-4713-a828-978dc73c8003 req-4f15b2ba-393f-44f9-a306-9e6e75100864 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:06.223464 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b45780de-9127-4713-a828-978dc73c8003 req-4f15b2ba-393f-44f9-a306-9e6e75100864 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:06.223546 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b45780de-9127-4713-a828-978dc73c8003 req-4f15b2ba-393f-44f9-a306-9e6e75100864 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:06.223701 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-b45780de-9127-4713-a828-978dc73c8003 req-4f15b2ba-393f-44f9-a306-9e6e75100864 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:11:06.345806 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:06.348138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.348344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.348480 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:06.348625 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:fd:3a:c2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:06.348943 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:06.350574 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-507819b6-a9be-4164-8bfd-825c7b81fea7 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:06.386149 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:06.503107 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Creating config drive at /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.config
Jun 27 04:11:06.506958 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptl4kqagd {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:06.555094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptl4kqagd" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:06.851716 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 27 04:11:07.039141 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:07.076849 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:07.165534 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:07.351553 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7bb5f551-d7c3-4e1a-adb5-063c6ed6b6c9 req-763f6bd7-b17f-4f32-aac6-7346a61f6f3f service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-plugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:07.351677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7bb5f551-d7c3-4e1a-adb5-063c6ed6b6c9 req-763f6bd7-b17f-4f32-aac6-7346a61f6f3f service nova] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:07.351816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7bb5f551-d7c3-4e1a-adb5-063c6ed6b6c9 req-763f6bd7-b17f-4f32-aac6-7346a61f6f3f service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:07.351981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7bb5f551-d7c3-4e1a-adb5-063c6ed6b6c9 req-763f6bd7-b17f-4f32-aac6-7346a61f6f3f service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:07.352290 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7bb5f551-d7c3-4e1a-adb5-063c6ed6b6c9 req-763f6bd7-b17f-4f32-aac6-7346a61f6f3f service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Processing event network-vif-plugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:11:07.467465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:07.472161 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:07.499149 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:07.678532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a35b42a9-9eae-4598-9093-4b36e8ef4fbc tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.744s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:07.948583 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533467.948037, 371a4e1b-1860-46a0-85e5-3f505c4797b3 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:07.949946 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:11:07.951479 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] VM Started (Lifecycle Event)
Jun 27 04:11:07.953510 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:11:07.957155 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Instance spawned successfully.
Jun 27 04:11:07.957607 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:11:08.453689 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:08.456181 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:08.466133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:08.466133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:08.466514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:08.466783 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:08.467139 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:08.467448 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:08.957578 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:11:08.959880 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533468.958296, 371a4e1b-1860-46a0-85e5-3f505c4797b3 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:08.959880 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] VM Paused (Lifecycle Event)
Jun 27 04:11:08.974068 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Took 7.32 seconds to spawn the instance on the hypervisor.
Jun 27 04:11:08.974068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:09.279091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:09.346823 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:09.444484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b7774b60-8261-458e-9195-3a44b800e34f req-5ac91049-6eff-448b-bc91-c1e731bdf075 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-plugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:09.444802 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b7774b60-8261-458e-9195-3a44b800e34f req-5ac91049-6eff-448b-bc91-c1e731bdf075 service nova] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:09.444976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b7774b60-8261-458e-9195-3a44b800e34f req-5ac91049-6eff-448b-bc91-c1e731bdf075 service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:09.445262 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b7774b60-8261-458e-9195-3a44b800e34f req-5ac91049-6eff-448b-bc91-c1e731bdf075 service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:09.445262 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b7774b60-8261-458e-9195-3a44b800e34f req-5ac91049-6eff-448b-bc91-c1e731bdf075 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] No waiting events found dispatching network-vif-plugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:09.445262 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-b7774b60-8261-458e-9195-3a44b800e34f req-5ac91049-6eff-448b-bc91-c1e731bdf075 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received unexpected event network-vif-plugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 for instance with vm_state active and task_state None.
Jun 27 04:11:09.461902 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:09.465095 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533469.4636376, 371a4e1b-1860-46a0-85e5-3f505c4797b3 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:09.465095 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] VM Resumed (Lifecycle Event)
Jun 27 04:11:09.489272 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Took 13.64 seconds to build instance.
Jun 27 04:11:09.969262 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:09.979136 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:09.992037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.156s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:11.743551 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-changed-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:11.744011 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Refreshing instance network info cache due to event network-changed-7a6ba8ee-644a-4584-995a-5306252ef6b9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:11.744211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] Acquiring lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:11.744898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] Acquired lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:11.744898 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Refreshing network info cache for port 7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:12.247152 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:12.675425 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:12.870421 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Updated VIF entry in instance network info cache for port 7a6ba8ee-644a-4584-995a-5306252ef6b9. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:11:12.870972 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Updating instance_info_cache with network_info: [{"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:13.373790 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-369ea867-f786-46b8-8af1-07cc94c1268f req-31c86b18-5151-4da4-98e3-46be14bd01a6 service nova] Releasing lock "refresh_cache-371a4e1b-1860-46a0-85e5-3f505c4797b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:14.108606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:14.109121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:14.282432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:14.348829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:14.611467 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Detaching volume 5baba415-cddd-4b29-a3d7-be8db80f081a
Jun 27 04:11:14.651161 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attempting to driver detach volume 5baba415-cddd-4b29-a3d7-be8db80f081a from mountpoint /dev/vdb
Jun 27 04:11:14.654702 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found disk vdb by alias ua-5baba415-cddd-4b29-a3d7-be8db80f081a {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:14.655952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found disk vdb by alias ua-5baba415-cddd-4b29-a3d7-be8db80f081a {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:14.656100 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Attempting to detach device vdb from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:   <alias name="ua-5baba415-cddd-4b29-a3d7-be8db80f081a"/>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:   <serial>5baba415-cddd-4b29-a3d7-be8db80f081a</serial>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:14.656355 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:14.681156 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Successfully detached device vdb from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the persistent domain config.
Jun 27 04:11:14.681303 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] (1/8): Attempting to detach device vdb with device alias ua-5baba415-cddd-4b29-a3d7-be8db80f081a from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:   <alias name="ua-5baba415-cddd-4b29-a3d7-be8db80f081a"/>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:   <serial>5baba415-cddd-4b29-a3d7-be8db80f081a</serial>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:14.681655 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:15.405064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533475.404691, 5a289016-ec72-454c-aec8-e92b65727e16 => ua-5baba415-cddd-4b29-a3d7-be8db80f081a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:11:15.407891 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5baba415-cddd-4b29-a3d7-be8db80f081a for instance 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:11:15.410246 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Successfully detached device vdb from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the live domain config.
Jun 27 04:11:15.411385 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:15.411790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5baba415-cddd-4b29-a3d7-be8db80f081a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:15.411977 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:15.412531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:15.412920 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5baba415-cddd-4b29-a3d7-be8db80f081a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:15.413107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:15.454357 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '70')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:15.455389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', '65')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:15.456566 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a', '66')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:15.457835 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518191ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:15.458146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:15.458476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Flush multipath device 33000000009e93474 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:15.492160 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:15.544605 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:15.591069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:15.591302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:15.592641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:15.604903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:15.605216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:15.616546 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:15.650627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.40.100,3260]
Jun 27 04:11:15.650627 np0000003830 nova-compute[98984]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:15.650627 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:15.675161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:15.688378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:15.722736 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.50.100,3260]
Jun 27 04:11:15.722736 np0000003830 nova-compute[98984]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-5baba415-cddd-4b29-a3d7-be8db80f081a, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:15.722736 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:15.743266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:15.743467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:15.743647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== disconnect_volume: return (331ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:15.743741 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:16.311734 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'flavor' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:16.972435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:16.973990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:17.320181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b97308f9-0af9-43af-9518-4137efd08518 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.210s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:17.475792 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Detaching volume a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:11:17.530184 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Attempting to driver detach volume a574ef50-0fb3-446f-997f-d6a7e94a232e from mountpoint /dev/vdb
Jun 27 04:11:17.535541 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:17.537364 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:17.537544 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Attempting to detach device vdb from instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-13"/>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:17.537856 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:17.554548 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e from the persistent domain config.
Jun 27 04:11:17.555541 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] (1/8): Attempting to detach device vdb with device alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e from instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-13"/>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:17.556150 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:18.265940 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533478.265474, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => ua-a574ef50-0fb3-446f-997f-d6a7e94a232e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:11:18.266553 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e for instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:11:18.270774 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e from the live domain config.
Jun 27 04:11:18.826159 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Detected multiple connections on this host for volume: a574ef50-0fb3-446f-997f-d6a7e94a232e, skipping target disconnect.
Jun 27 04:11:19.285388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:19.349747 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:19.394009 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:20.359847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:20.360373 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:20.401071 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8148d96b-8a61-46f1-b2d1-4b0f32602162 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.428s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:20.863490 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Detaching volume a574ef50-0fb3-446f-997f-d6a7e94a232e
Jun 27 04:11:20.920903 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Attempting to driver detach volume a574ef50-0fb3-446f-997f-d6a7e94a232e from mountpoint /dev/vdb
Jun 27 04:11:20.929004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:20.931208 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found disk vdb by alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:20.931383 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Attempting to detach device vdb from instance 6d020229-688f-487c-8458-d1f3cd69257b from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-13"/>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:20.931783 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:20.940758 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance 6d020229-688f-487c-8458-d1f3cd69257b from the persistent domain config.
Jun 27 04:11:20.940898 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] (1/8): Attempting to detach device vdb with device alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e from instance 6d020229-688f-487c-8458-d1f3cd69257b from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <alias name="ua-a574ef50-0fb3-446f-997f-d6a7e94a232e"/>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-13"/>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <serial>a574ef50-0fb3-446f-997f-d6a7e94a232e</serial>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:20.941578 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:21.281834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:21.282177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:21.786799 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'flavor' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:21.830559 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:21.830695 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=98984) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 27 04:11:22.332864 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:22.793831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:23.663101 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:23.663395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:23.900912 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:23.901469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:23.901469 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Attaching volume 7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 to /dev/vdb
Jun 27 04:11:23.943017 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:23.955397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:11:23.975844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:24.027396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:11:24.027713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:11:24.037566 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:11:24.039650 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:fe97:a8ba', 'fe80::1c14:85ff:fe33:e2b2', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fef9:adbc', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:febc:3685', 'fe80::1c7a:4ff:fe26:3a4a', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe15:fc91', 'fe80::490:a7ff:fe4e:392b'] 
Jun 27 04:11:24.039650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:11:24.039650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:11:24.039996 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:24.040312 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating existing volume attachment record: 9855e86e-6ff6-4d61-90ff-731d5b7b0f4c {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:11:24.166544 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Detaching volume c70c370c-30c7-46c0-972e-0eb37ba966d3
Jun 27 04:11:24.212373 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Attempting to driver detach volume c70c370c-30c7-46c0-972e-0eb37ba966d3 from mountpoint /dev/vdc
Jun 27 04:11:24.223344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found disk vdc by alias ua-c70c370c-30c7-46c0-972e-0eb37ba966d3 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:24.227201 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Found disk vdc by alias ua-c70c370c-30c7-46c0-972e-0eb37ba966d3 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:24.227378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Attempting to detach device vdc from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:   <alias name="ua-c70c370c-30c7-46c0-972e-0eb37ba966d3"/>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:   <serial>c70c370c-30c7-46c0-972e-0eb37ba966d3</serial>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:24.227750 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:24.239939 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Successfully detached device vdc from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the persistent domain config.
Jun 27 04:11:24.240253 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] (1/8): Attempting to detach device vdc with device alias ua-c70c370c-30c7-46c0-972e-0eb37ba966d3 from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:   <alias name="ua-c70c370c-30c7-46c0-972e-0eb37ba966d3"/>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:   <serial>c70c370c-30c7-46c0-972e-0eb37ba966d3</serial>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:24.240568 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:24.258729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533484.2582147, 6d020229-688f-487c-8458-d1f3cd69257b => ua-a574ef50-0fb3-446f-997f-d6a7e94a232e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:11:24.260748 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a574ef50-0fb3-446f-997f-d6a7e94a232e for instance 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:11:24.263913 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully detached device vdb from instance 6d020229-688f-487c-8458-d1f3cd69257b from the live domain config.
Jun 27 04:11:24.295266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:24.295666 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:24.295786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:24.296234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:24.296658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a574ef50-0fb3-446f-997f-d6a7e94a232e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:24.296840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:24.303045 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:24.329671 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:24.330161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '70')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:24.330582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '53')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:24.333056 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e', '54')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:24.333056 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538367880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:24.333307 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:24.333644 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flush multipath device 330000000d9190441 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:24.352770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:24.371981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:24.424311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:24.472943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:24.473090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:24.474469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:24.486931 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:24.487125 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:24.498803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.534312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.40.100,3260]
Jun 27 04:11:24.534312 np0000003830 nova-compute[98984]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:24.534312 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.556283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.572543 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.611930 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:11:24.612331 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:24.612533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:24.612958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.50.100,3260]
Jun 27 04:11:24.612958 np0000003830 nova-compute[98984]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-a574ef50-0fb3-446f-997f-d6a7e94a232e, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:24.612958 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.632197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.632585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:24.632770 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== disconnect_volume: return (337ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:24.632946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:24.634845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.022s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:24.635087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:11:24.649168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:24.650677 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:24.651106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:24.651240 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:24.651585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:24.651794 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:24.666705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:24.666705 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.675365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:24.675365 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8] added
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:24.681582 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.682148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:24.682148 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:24.682148 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8] added
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:24.687704 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:24.688061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:24.688061 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:24.688223 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:24.851141 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533484.850792, 5a289016-ec72-454c-aec8-e92b65727e16 => ua-c70c370c-30c7-46c0-972e-0eb37ba966d3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:11:24.852583 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-c70c370c-30c7-46c0-972e-0eb37ba966d3 for instance 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:11:24.855643 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Successfully detached device vdc from instance 5a289016-ec72-454c-aec8-e92b65727e16 from the live domain config.
Jun 27 04:11:24.856690 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:24.857024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c70c370c-30c7-46c0-972e-0eb37ba966d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:24.857168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:25.200369 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'flavor' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:25.332696 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:25.333348 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:25.682622 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:25.689756 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:25.699874 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:25.713886 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.733194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.733194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.738558 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.739071 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.746708 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.747172 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:25.794148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.50.100,3260]
Jun 27 04:11:25.794148 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:25.794148 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.809924 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.813737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.40.100,3260]
Jun 27 04:11:25.813737 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:25.813737 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.827085 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.827540 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:25.827725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:25.827905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:25.828357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:25.829835 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] HCTL ('9', '-', '-', 0) found on session 71 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:25.829919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.847038 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:25.847344 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:25.860907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:25.860907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:25.860907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching for a device in session 71 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:25.860907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:25.860907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] HCTL ('10', '-', '-', 0) found on session 72 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:25.860907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:25.894046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching for a device in session 72 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:25.894046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:26.215130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e244966-8377-41df-bf9b-2a38ae00de28 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.855s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:26.651972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:11:26.827087 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:26.827578 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:26.830181 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:26.830516 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:27.669157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Found WWN 330000000d9975722 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:11:27.669753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:27.669753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] <== connect_volume: return (3057ms) {'type': 'block', 'scsi_wwn': '330000000d9975722', 'path': '/dev/dm-1', 'multipath_id': '330000000d9975722'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:27.669898 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d9975722', 'path': '/dev/dm-1', 'multipath_id': '330000000d9975722'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:11:27.670304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.813s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:27.670827 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c70c370c-30c7-46c0-972e-0eb37ba966d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:27.670993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:27.674550 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'flavor' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:27.702153 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '69'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:27.702749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '70')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:27.703946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3', '69')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:27.705435 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5180b7920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'): ({'sdj'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:27.705680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Removing multipathed devices sdk, sdj {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:27.705986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Flush multipath device 3300000000deb3cb0 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:27.745147 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:27.797951 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:27.830221 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:27.838421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:27.838669 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:27.840017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:27.852961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:27.853132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:27.868943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:27.909864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.40.100,3260]
Jun 27 04:11:27.909864 np0000003830 nova-compute[98984]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:27.909864 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:27.933610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:27.945740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:27.992394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.50.100,3260]
Jun 27 04:11:27.992394 np0000003830 nova-compute[98984]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-c70c370c-30c7-46c0-972e-0eb37ba966d3, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:27.992394 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:28.013636 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:28.013924 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:28.014061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== disconnect_volume: return (3156ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:28.014160 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:28.178604 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Attempting to attach volume 7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]:   <alias name="ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8"/>
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]:   <serial>7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8</serial>
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:28.182956 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:11:28.334468 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:28.334740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:28.334881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:28.335056 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:11:28.588116 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'flavor' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:29.303889 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:29.353336 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:29.409159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:29.431689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:29.432516 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:29.498884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:29.503545 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:29.595175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-aadfd688-7efe-4936-ac9e-f36aeb51692d tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.931s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:29.599373 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:29.605571 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:11:29.607589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:29.712570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:29.713037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:29.812182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:29.812450 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:11:29.816445 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:11:29.818290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:29.894587 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:29.897889 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:29.900523 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:29.900523 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:f9:ad:bc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:29.910564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:29.911135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:29.937383 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:11:30.028574 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.031594 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:11:30.037189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.138003 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.138687 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.246650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.251579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.354064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.354732 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.463008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.468422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.529208 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:30.529596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:30.535565 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:11:30.535832 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Claim successful on node np0000003830
Jun 27 04:11:30.572808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.573466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.626379 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:30.626379 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing instance network info cache due to event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:30.626379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] Acquiring lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:30.626379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] Acquired lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:30.626379 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:30.663894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.669560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.770082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.773698 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:30.881039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:30.887085 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.000631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.004513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.113755 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:31.120310 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.128642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.244090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.244819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.376582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.377095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.423929 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:31.424143 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing instance network info cache due to event network-changed-d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:31.424512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] Acquiring lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:31.482619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.483140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.513690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efc3f73c-b625-4842-96e5-fda9da7ddbef tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.612s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:31.591676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.601035 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.720506 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:31.725260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.725441 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.835027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.840807 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:11:31.842687 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:31.899852 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:31.900317 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=48253MB free_disk=73.37510681152344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:11:31.900553 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:31.971797 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updated VIF entry in instance network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:11:31.972280 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:32.036063 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Rescuing
Jun 27 04:11:32.036367 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:32.036511 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:32.036704 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:11:32.043023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:32.043211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:32.043429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:32.043610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:32.043741 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:32.046606 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Terminating instance
Jun 27 04:11:32.476758 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c8ad65d1-af2f-448d-9648-0ad8b3997455 req-bc83a81e-996e-44db-a5d7-bcc843b4cd9e service nova] Releasing lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:32.477340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] Acquired lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:32.477443 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Refreshing network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:32.480068 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:11:32.480403 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:11:32.539855 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:32.552702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:11:32.585056 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.587968 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.621093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.621093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.666444 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.823819 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ec0042e-29e0-4daa-a46a-76c352a09460 req-b335966b-f9b8-4f82-9d5a-901d67171e20 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-unplugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:32.823819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ec0042e-29e0-4daa-a46a-76c352a09460 req-b335966b-f9b8-4f82-9d5a-901d67171e20 service nova] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:32.824560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ec0042e-29e0-4daa-a46a-76c352a09460 req-b335966b-f9b8-4f82-9d5a-901d67171e20 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:32.824560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ec0042e-29e0-4daa-a46a-76c352a09460 req-b335966b-f9b8-4f82-9d5a-901d67171e20 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:32.824560 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ec0042e-29e0-4daa-a46a-76c352a09460 req-b335966b-f9b8-4f82-9d5a-901d67171e20 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] No waiting events found dispatching network-vif-unplugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:32.824560 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ec0042e-29e0-4daa-a46a-76c352a09460 req-b335966b-f9b8-4f82-9d5a-901d67171e20 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-unplugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:11:32.872889 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.883039 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:32.902005 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999496546000046 future=<Future at 0x7ec5180d2ae0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:32.903998 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.997547563999888 future=<Future at 0x7ec5180d2ae0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:32.903998 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.997322321999945 future=<Future at 0x7ec5180d2ae0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:32.918401 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Instance destroyed successfully.
Jun 27 04:11:32.919773 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lazy-loading 'resources' on Instance uuid 5a289016-ec72-454c-aec8-e92b65727e16 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:32.980869 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:32.988169 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:32.992921 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:11:33.189935 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:33.384181 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:33.422409 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-141774026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testinstanceswithcindervolumes-server-141774026',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRn1mQCDv4XoqU/h+IFCbbSSuBLTGJCJL7Ib2TqC+BBDt/R/vtfwLy57/1UEDA1XrqwgHNKBTtbovTsoEHAt0fHCDKKc0q/cqFgxMChq5D2hQ1FgB0SruTJf1YrWFBoDw==',key_name='tempest-TestInstancesWithCinderVolumes-37772236',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:02Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8f8cbfe84ce4a48938255e422c7159b',ramdisk_id='',reservation_id='r-w9mhez4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-76740034',owner_user_name='tempest-TestInstancesWithCinderVolumes-76740034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:03Z,user_data=None,user_id='f5936c57c39c4c6d8da18fb52cc1b214',uuid=5a289016-ec72-454c-aec8-e92b65727e16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:11:33.422696 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Converting VIF {"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:33.423265 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:33.423600 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:11:33.424761 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:33.424938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd070e5cd-59, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:33.426160 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:33.426995 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:33.427483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:33.428432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:33.428637 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4206168-7369-43aa-90a4-aba4fa322633) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:33.429332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:33.429731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:33.430635 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:33.432600 np0000003830 nova-compute[98984]: INFO os_vif [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:a8:ba,bridge_name='br-int',has_traffic_filtering=True,id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0,network=Network(c2f31827-6f64-490f-8371-366dbdd15a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd070e5cd-59')
Jun 27 04:11:33.433963 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:33.434384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:33.434564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:33.434966 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:33.435373 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd56c54f1-0697-4663-b94a-eb058da0b44f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:33.435554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:33.470893 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:33.471432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:33.471793 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '61')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:33.472665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f', '62')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:33.476874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53af11a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:33.477335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:33.477602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Flush multipath device 3300000008322aa1f {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:33.504736 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.975s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:33.505180 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:11:33.508315 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.608s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:33.535560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:33.569207 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updated VIF entry in instance network info cache for port d070e5cd-599a-4462-a0e7-1480f6bcb3c0. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:11:33.569424 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [{"id": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "address": "fa:16:3e:97:a8:ba", "network": {"id": "c2f31827-6f64-490f-8371-366dbdd15a09", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-635217011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f8f8cbfe84ce4a48938255e422c7159b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd070e5cd-59", "ovs_interfaceid": "d070e5cd-599a-4462-a0e7-1480f6bcb3c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:33.581448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:33.632858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:33.633066 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:33.634919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:33.649582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:33.649865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:33.662589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:33.692515 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:33.705472 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.40.100,3260]
Jun 27 04:11:33.705472 np0000003830 nova-compute[98984]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:33.705472 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:33.723560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:33.736938 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:33.772841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.50.100,3260]
Jun 27 04:11:33.772841 np0000003830 nova-compute[98984]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-d56c54f1-0697-4663-b94a-eb058da0b44f, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:33.772841 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:33.794413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:33.794739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:33.794918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] <== disconnect_volume: return (360ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:33.795090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:33.795886 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Deleting instance files /opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16_del
Jun 27 04:11:33.802272 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Deletion of /opt/stack/data/nova/instances/5a289016-ec72-454c-aec8-e92b65727e16_del complete
Jun 27 04:11:34.016975 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:11:34.022953 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:11:34.023299 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:34.023724 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:34.072180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f4d6d26b-0ef0-4850-b366-fd963ee24de8 req-6e03d03f-f0e8-48d6-b685-a9ed444178c7 service nova] Releasing lock "refresh_cache-5a289016-ec72-454c-aec8-e92b65727e16" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:34.123125 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7132d5dcadb043838976141746b8a26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a05730e4d204004b6dbe4c1389b8397', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:11:34.309751 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:34.313953 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Took 1.76 seconds to destroy the instance on the hypervisor.
Jun 27 04:11:34.314823 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:11:34.315171 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:11:34.315302 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:11:34.315514 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:34.406190 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:34.525036 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:11:34.604252 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.604482 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.605143 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.605294 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.605733 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.605867 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f5611e50-86aa-420c-9f94-e13d8f80f4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.605928 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 075f803b-49f2-4084-9d8a-10d59d1c62eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 5a289016-ec72-454c-aec8-e92b65727e16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d020229-688f-487c-8458-d1f3cd69257b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance fa5fe299-857b-41f5-8069-c3324c227036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a41c0a78-a4b0-4a62-b391-e0eef4bd2329 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 13 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:11:34.607188 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=3136MB phys_disk=95GB used_disk=10GB total_vcpus=16 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:11:31 up 34 min,  2 users,  load average: 9.25, 9.32, 5.22\n', 'num_instances': '13', 'num_vm_active': '11', 'num_task_None': '11', 'num_os_type_None': '13', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '6', 'io_workload': '2', 'num_proj_7adc2502eb6e45c19f6b8646b60669f5': '3', 'num_vm_rescued': '1', 'num_proj_72fed82034484f13a228c535b175c167': '1', 'num_task_deleting': '1', 'num_proj_f8f8cbfe84ce4a48938255e422c7159b': '1', 'num_task_rescuing': '1', 'num_proj_7e1b9b8f3bfc490dbd68a422dabbe3c6': '1', 'num_proj_1121cceb6eae4ccb920a6e3123169bf9': '1', 'num_vm_building': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:11:34.621994 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Successfully created port: da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:11:34.727291 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-218add2c-aab7-4bb4-922b-6f738a2817fb req-fb934074-fdbb-45f5-9d59-3271a3918181 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-deleted-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:34.727951 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-218add2c-aab7-4bb4-922b-6f738a2817fb req-fb934074-fdbb-45f5-9d59-3271a3918181 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Neutron deleted interface d070e5cd-599a-4462-a0e7-1480f6bcb3c0; detaching it from the instance and deleting it from the info cache
Jun 27 04:11:34.729509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-218add2c-aab7-4bb4-922b-6f738a2817fb req-fb934074-fdbb-45f5-9d59-3271a3918181 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Detach interface failed, port_id=d070e5cd-599a-4462-a0e7-1480f6bcb3c0, reason: Instance 5a289016-ec72-454c-aec8-e92b65727e16 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:11:34.888166 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f42467d-f228-4d60-9afa-945789a38d75 req-23769287-984f-4137-bab4-00a90d35b256 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-unplugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:34.888786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f42467d-f228-4d60-9afa-945789a38d75 req-23769287-984f-4137-bab4-00a90d35b256 service nova] Acquiring lock "5a289016-ec72-454c-aec8-e92b65727e16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:34.888935 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f42467d-f228-4d60-9afa-945789a38d75 req-23769287-984f-4137-bab4-00a90d35b256 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:34.889069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f42467d-f228-4d60-9afa-945789a38d75 req-23769287-984f-4137-bab4-00a90d35b256 service nova] Lock "5a289016-ec72-454c-aec8-e92b65727e16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:34.889225 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f42467d-f228-4d60-9afa-945789a38d75 req-23769287-984f-4137-bab4-00a90d35b256 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] No waiting events found dispatching network-vif-unplugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:34.889354 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f42467d-f228-4d60-9afa-945789a38d75 req-23769287-984f-4137-bab4-00a90d35b256 service nova] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Received event network-vif-unplugged-d070e5cd-599a-4462-a0e7-1480f6bcb3c0 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:11:35.033209 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:11:35.174768 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:35.185364 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:11:35.185364 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:11:35.242297 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Successfully updated port: da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:11:35.291375 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-changed-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:35.291484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Refreshing instance network info cache due to event network-changed-da78a719-d395-411d-a464-aa93c98a28b2. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:35.291664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] Acquiring lock "refresh_cache-6ffa047a-8ea7-4865-bdcb-be9cac2796a1" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:35.291753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] Acquired lock "refresh_cache-6ffa047a-8ea7-4865-bdcb-be9cac2796a1" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:35.291916 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Refreshing network info cache for port da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:35.331094 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:35.335700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:35.360393 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:35.486350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:35.486479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:35.541514 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Booting with volume 4a333bc8-30de-4d86-ad03-7bc81ae58163 at /dev/vda
Jun 27 04:11:35.550917 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:35.561435 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:35.615288 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:35.631795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:11:35.661985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:35.691423 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Took 1.37 seconds to deallocate network for instance.
Jun 27 04:11:35.698793 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:11:35.702590 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999320808999983 future=<Future at 0x7ec53815d760 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:35.721610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:11:35.722684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:11:35.723893 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance destroyed successfully.
Jun 27 04:11:35.724950 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'numa_topology' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:35.733450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:11:35.735193 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:febc:3685', 'fe80::1c7a:4ff:fe26:3a4a', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe15:fc91', 'fe80::490:a7ff:fe4e:392b'] 
Jun 27 04:11:35.735327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:11:35.735445 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:11:35.735744 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:35.735986 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Updating existing volume attachment record: 0b413bad-c0cf-401a-98a5-c75aeb744f32 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:11:35.744750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "refresh_cache-6ffa047a-8ea7-4865-bdcb-be9cac2796a1" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:35.796524 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:35.871012 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:11:35.990799 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'flavor' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:36.025246 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:36.228422 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:11:36.228642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.720s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:36.228895 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:36.229057 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 27 04:11:36.235827 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Attempting rescue
Jun 27 04:11:36.236386 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98984) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}}
Jun 27 04:11:36.244425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:11:36.244609 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Creating image(s)
Jun 27 04:11:36.245268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:36.245541 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:36.246130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:36.246380 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:36.283017 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Took 0.58 seconds to detach 1 volumes for instance.
Jun 27 04:11:36.527250 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-166c0837-a652-45e6-9b88-55428ad452cd req-34f18bb7-b3de-44ee-9d6e-4781b988b711 service nova] Releasing lock "refresh_cache-6ffa047a-8ea7-4865-bdcb-be9cac2796a1" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:36.527801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquired lock "refresh_cache-6ffa047a-8ea7-4865-bdcb-be9cac2796a1" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:36.528066 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:11:36.730981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] There are 0 instances to clean {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 27 04:11:36.731338 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:36.750391 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:36.750965 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:36.754872 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:36.757834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:36.758167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:36.758445 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:36.766954 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:11:36.768707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:36.795890 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:36.798243 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:36.798488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:36.798721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:36.798895 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:36.799071 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state active and task_state rescuing.
Jun 27 04:11:36.799185 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:36.799308 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:36.799445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:36.800258 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:36.800258 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:36.800258 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-030ecb25-39da-4395-923c-206b2f0a60f6 req-4d0b7392-fbe1-4a76-afc1-da0b5a3e882b service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state active and task_state rescuing.
Jun 27 04:11:36.801706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:36.802013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:36.867818 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:36.868239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.rescue {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:36.924006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.rescue" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:36.924544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:36.924906 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'migration_context' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:36.998819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:37.126265 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:11:37.233109 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:37.334007 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:37.427218 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:37.427585 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:11:37.428175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Start _get_guest_xml network_info=[{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:f9:ad:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:11:37.428384 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'resources' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:37.506287 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Updating instance_info_cache with network_info: [{"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:37.615104 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:11:37.615325 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:11:37.906730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:11:37.907956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:11:37.908252 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Creating image(s)
Jun 27 04:11:37.908736 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:11:37.908885 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Ensure instance console log exists: /opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:11:37.909126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:37.909309 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:37.909478 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:37.932442 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:37.935827 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:11:37.935827 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-38590157', uuid='fa5fe299-857b-41f5-8069-c3324c227036'), owner=OwnerMeta(userid='b427e506578a4121bf0d008321dacac9', username='tempest-ServerRescueNegativeTestJSON-1862600164-project-member', projectid='7adc2502eb6e45c19f6b8646b60669f5', projectname='tempest-ServerRescueNegativeTestJSON-1862600164'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:f9:ad:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533497.9352074) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:11:37.936830 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:11:37.937288 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:11:37.938404 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:11:37.938669 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:11:37.939901 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:11:37.940431 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:11:37.940701 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:11:37.940862 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:11:37.941043 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:11:37.941229 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:11:37.941416 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:11:37.941661 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:11:37.941832 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:11:37.942021 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:11:37.942208 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:11:37.942412 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:11:37.942653 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:38.008932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Releasing lock "refresh_cache-6ffa047a-8ea7-4865-bdcb-be9cac2796a1" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:38.009298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Instance network_info: |[{"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:11:38.010133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Start _get_guest_xml network_info=[{"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '0b413bad-c0cf-401a-98a5-c75aeb744f32', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6ffa047a-8ea7-4865-bdcb-be9cac2796a1', 'attached_at': '', 'detached_at': '', 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'serial': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'multiattach': True}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:11:38.012211 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:11:38.013281 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-33204467', uuid='6ffa047a-8ea7-4865-bdcb-be9cac2796a1'), owner=OwnerMeta(userid='7132d5dcadb043838976141746b8a26a', username='tempest-AttachVolumeMultiAttachTest-870912138-project-member', projectid='5a05730e4d204004b6dbe4c1389b8397', projectname='tempest-AttachVolumeMultiAttachTest-870912138'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533498.0129702) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:11:38.014558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:11:38.014941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:11:38.016074 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:11:38.016324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:11:38.017308 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:11:38.017678 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:11:38.017851 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:11:38.017978 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:11:38.018173 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:11:38.018232 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:11:38.018354 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:11:38.018568 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:11:38.018707 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:11:38.018937 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:11:38.019097 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:11:38.019241 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:11:38.036924 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:11:38.037318 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:38.037551 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:38.038166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:38.038665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:11:38.098419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:38.098419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:38.098846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.049s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:38.099081 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:38.099706 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.049s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:38.099944 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:38.111014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:38.111014 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:38.113228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:38.113228 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:38.121181 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163] added
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:38.129622 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163] added
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:38.130878 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:38.131094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:38.131201 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:38.131376 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:38.231327 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:38.231506 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:38.232785 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Attaching volume d3addc83-672b-4534-833a-767e39b9a06e to /dev/vdb
Jun 27 04:11:38.232945 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:38.233331 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:38.233624 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:38.233989 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:38.234180 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:11:38.234294 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:11:38.234658 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 34.25 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:38.282664 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:38.296405 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:11:38.319456 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:38.371008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:11:38.371428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:11:38.379949 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:11:38.382551 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:febc:3685', 'fe80::1c7a:4ff:fe26:3a4a', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe15:fc91', 'fe80::490:a7ff:fe4e:392b'] 
Jun 27 04:11:38.382700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:11:38.382856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:11:38.383153 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:38.384976 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating existing volume attachment record: a78f27a1-63f7-46d0-be75-320b3d45848a {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:11:38.430434 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:38.449779 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:38.465747 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-38590157',display_name='tempest-ServerRescueNegativeTestJSON-server-38590157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-38590157',id=32,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVGe0pGmGKgFXE9CC8E3bKafwbkIsigNdihQC7wDDX3aLiQbljECwrPYQGqO7sU2O0wvzDMD7EFZKp4MagbWU0WMEfHR7Mvjb3FFZ4Boc3BZvnEVJPjqpdW6k8/tjeUw==',key_name='tempest-keypair-1499974602',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:43Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-oo0mrwne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b427e506578a4121bf0d008321dacac9',uuid=fa5fe299-857b-41f5-8069-c3324c227036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:f9:ad:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:11:38.466273 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "vif_mac": "fa:16:3e:f9:ad:bc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:38.467280 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:38.468243 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'pci_devices' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:38.631963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.830s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:38.738143 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Deleted allocations for instance 5a289016-ec72-454c-aec8-e92b65727e16
Jun 27 04:11:38.952013 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:11:38.952384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:38.952458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:38.970309 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <uuid>fa5fe299-857b-41f5-8069-c3324c227036</uuid>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <name>instance-00000020</name>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-38590157</nova:name>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:11:37</nova:creationTime>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:user uuid="b427e506578a4121bf0d008321dacac9">tempest-ServerRescueNegativeTestJSON-1862600164-project-member</nova:user>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:project uuid="7adc2502eb6e45c19f6b8646b60669f5">tempest-ServerRescueNegativeTestJSON-1862600164</nova:project>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         <nova:port uuid="deeb79be-2aa4-4e3c-aa75-7ea49bf99feb">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <entry name="serial">fa5fe299-857b-41f5-8069-c3324c227036</entry>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <entry name="uuid">fa5fe299-857b-41f5-8069-c3324c227036</entry>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.rescue"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config.rescue"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:f9:ad:bc"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <target dev="tapdeeb79be-2a"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/console.log" append="off"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:11:38.971471 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:11:38.974465 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance destroyed successfully.
Jun 27 04:11:39.130988 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:39.131861 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:39.141639 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:39.147200 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.154032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.160608 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.167805 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.168116 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.177138 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.177566 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:39.207021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.40.100,3260]
Jun 27 04:11:39.207021 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:39.207021 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.218631 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.232860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.50.100,3260]
Jun 27 04:11:39.232860 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:39.232860 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.237914 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.238220 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:39.238428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:39.238567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:39.239519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('11', '-', '-', 0) found on session 73 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:39.239635 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:39.245308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:39.258105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 73 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:39.258105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.264875 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:39.265118 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:39.265280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:39.265397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:39.266897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] HCTL ('12', '-', '-', 0) found on session 74 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:39.267054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:39.283632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Searching for a device in session 74 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:39.283632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:39.309363 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:39.747661 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a225241-2668-4823-849c-c99a716aa7f0 tempest-TestInstancesWithCinderVolumes-76740034 tempest-TestInstancesWithCinderVolumes-76740034-project-member] Lock "5a289016-ec72-454c-aec8-e92b65727e16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.704s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:40.052308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:11:40.502443 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:40.502581 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:40.502692 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:40.502797 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] No VIF found with MAC fa:16:3e:f9:ad:bc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:40.503292 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Using config drive
Jun 27 04:11:41.005980 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'ec2_ids' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:41.068936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Found WWN 33000000002f6eedf for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:11:41.068936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:41.068936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000002f6eedf', 'path': '/dev/dm-2', 'multipath_id': '33000000002f6eedf'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:41.068936 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000002f6eedf', 'path': '/dev/dm-2', 'multipath_id': '33000000002f6eedf'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:11:41.068936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.116s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:41.069519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:11:41.081679 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:41.086590 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:41.086987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:41.087205 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:41.087629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:41.087795 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:41.098850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:41.098850 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:41.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:41.104722 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e] added
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:41.111213 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:41.111420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:41.111548 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:41.111692 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e] added
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:41.117609 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:41.117821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:41.117906 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:41.118021 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:41.509554 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:41.509554 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'keypairs' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:41.573882 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-33204467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumemultiattachtest-server-33204467',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-6w2dw8tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:11:35Z,user_data=None,user_id='7132d5dcadb043838976141746b8a26a',uuid=6ffa047a-8ea7-4865-bdcb-be9cac2796a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:11:41.574073 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:41.574703 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:41.575287 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:42.011775 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:42.014960 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <uuid>6ffa047a-8ea7-4865-bdcb-be9cac2796a1</uuid>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <name>instance-00000023</name>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-33204467</nova:name>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:11:38</nova:creationTime>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:user uuid="7132d5dcadb043838976141746b8a26a">tempest-AttachVolumeMultiAttachTest-870912138-project-member</nova:user>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:project uuid="5a05730e4d204004b6dbe4c1389b8397">tempest-AttachVolumeMultiAttachTest-870912138</nova:project>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         <nova:port uuid="da78a719-d395-411d-a464-aa93c98a28b2">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <entry name="serial">6ffa047a-8ea7-4865-bdcb-be9cac2796a1</entry>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <entry name="uuid">6ffa047a-8ea7-4865-bdcb-be9cac2796a1</entry>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1/disk.config"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <alias name="ua-4a333bc8-30de-4d86-ad03-7bc81ae58163"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <serial>4a333bc8-30de-4d86-ad03-7bc81ae58163</serial>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <shareable/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:21:dc:4a"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <target dev="tapda78a719-d3"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1/console.log" append="off"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:11:42.079333 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Preparing to wait for external event network-vif-plugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-33204467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumemultiattachtest-server-33204467',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-6w2dw8tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:11:35Z,user_data=None,user_id='7132d5dcadb043838976141746b8a26a',uuid=6ffa047a-8ea7-4865-bdcb-be9cac2796a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:42.086451 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:11:42.087913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.088111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3e951ca-2eee-586a-bd16-5fdf9aa18fa8', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:42.093511 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.094374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:42.099733 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.102159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.102391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda78a719-d3, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:42.102791 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda78a719-d3, col_values=(('qos', UUID('7915d233-c029-4416-9a28-86701b61da13')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:42.102979 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda78a719-d3, col_values=(('external_ids', {'iface-id': 'da78a719-d395-411d-a464-aa93c98a28b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:dc:4a', 'vm-uuid': '6ffa047a-8ea7-4865-bdcb-be9cac2796a1'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:42.106804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.108537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:42.113921 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:42.118520 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:42.130893 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.140710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.167116 np0000003830 nova-compute[98984]: INFO os_vif [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3')
Jun 27 04:11:42.167116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.167116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.177881 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.178203 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.184440 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.184807 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:42.227601 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Creating config drive at /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config.rescue
Jun 27 04:11:42.229213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260]
Jun 27 04:11:42.229213 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:42.229213 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.233259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1hpaxogu {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:42.247180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.250166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260]
Jun 27 04:11:42.250166 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:42.250166 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.271237 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.271840 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:42.272831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:42.273097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:42.274844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] HCTL ('13', '-', '-', 0) found on session 75 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:42.275051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:42.298557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:42.301359 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 75 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:42.301583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:42.302024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1hpaxogu" returned: 0 in 0.069s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:42.303323 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] HCTL ('14', '-', '-', 0) found on session 76 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:42.303837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:42.324326 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 76 and hctl ['14', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:42.884554 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.925116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:42.929240 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:43.009003 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:43.058307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:43.065074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:43.133808 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07575c73-2ea7-40a5-8dda-32f367641284 req-aabd6116-a53f-4eee-b9be-5c7b3a0daea8 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:43.134349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07575c73-2ea7-40a5-8dda-32f367641284 req-aabd6116-a53f-4eee-b9be-5c7b3a0daea8 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:43.134349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07575c73-2ea7-40a5-8dda-32f367641284 req-aabd6116-a53f-4eee-b9be-5c7b3a0daea8 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:43.134349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07575c73-2ea7-40a5-8dda-32f367641284 req-aabd6116-a53f-4eee-b9be-5c7b3a0daea8 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:43.134699 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07575c73-2ea7-40a5-8dda-32f367641284 req-aabd6116-a53f-4eee-b9be-5c7b3a0daea8 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:43.134699 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-07575c73-2ea7-40a5-8dda-32f367641284 req-aabd6116-a53f-4eee-b9be-5c7b3a0daea8 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state active and task_state rescuing.
Jun 27 04:11:43.325004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 76 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:43.325235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:43.681418 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:43.681627 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:43.681680 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] No VIF found with MAC fa:16:3e:21:dc:4a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:43.682204 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Using config drive
Jun 27 04:11:43.985241 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:43.985600 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:44.103564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Found WWN 33000000014503705 for multipath device dm-5 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:11:44.103564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:44.103564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== connect_volume: return (5150ms) {'type': 'block', 'scsi_wwn': '33000000014503705', 'path': '/dev/dm-5', 'multipath_id': '33000000014503705'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:44.103564 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000014503705', 'path': '/dev/dm-5', 'multipath_id': '33000000014503705'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:11:44.106878 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'flavor' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:44.188682 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:44.192359 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:44.202672 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for fa5fe299-857b-41f5-8069-c3324c227036 due to new event <LifecycleEvent: 1782533504.2020624, fa5fe299-857b-41f5-8069-c3324c227036 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:11:44.203173 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533504.2020624, fa5fe299-857b-41f5-8069-c3324c227036 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:44.203173 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Resumed (Lifecycle Event)
Jun 27 04:11:44.206743 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-52d25338-92d3-4e60-b3f0-ec3bd6a6e7e2 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:44.312510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:44.360001 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Creating config drive at /opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1/disk.config
Jun 27 04:11:44.363722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz3luwq4w {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:44.438923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz3luwq4w" returned: 0 in 0.074s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:44.489428 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Detaching volume 7e939eb8-73aa-4e96-b26f-735bf9284807
Jun 27 04:11:44.559205 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Attempting to driver detach volume 7e939eb8-73aa-4e96-b26f-735bf9284807 from mountpoint /dev/vdb
Jun 27 04:11:44.571365 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found disk vdb by alias ua-7e939eb8-73aa-4e96-b26f-735bf9284807 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:44.573010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found disk vdb by alias ua-7e939eb8-73aa-4e96-b26f-735bf9284807 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:11:44.573259 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Attempting to detach device vdb from instance 075f803b-49f2-4084-9d8a-10d59d1c62eb from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:   <alias name="ua-7e939eb8-73aa-4e96-b26f-735bf9284807"/>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:   <serial>7e939eb8-73aa-4e96-b26f-735bf9284807</serial>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:44.573622 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:44.586565 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully detached device vdb from instance 075f803b-49f2-4084-9d8a-10d59d1c62eb from the persistent domain config.
Jun 27 04:11:44.586686 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] (1/8): Attempting to detach device vdb with device alias ua-7e939eb8-73aa-4e96-b26f-735bf9284807 from instance 075f803b-49f2-4084-9d8a-10d59d1c62eb from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:   <alias name="ua-7e939eb8-73aa-4e96-b26f-735bf9284807"/>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:   <serial>7e939eb8-73aa-4e96-b26f-735bf9284807</serial>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:44.587196 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:11:44.610805 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Attempting to attach volume d3addc83-672b-4534-833a-767e39b9a06e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]:   <alias name="ua-d3addc83-672b-4534-833a-767e39b9a06e"/>
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]:   <serial>d3addc83-672b-4534-833a-767e39b9a06e</serial>
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:44.612649 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:11:44.707936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:44.710575 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:45.080289 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:45.104842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:45.108712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:45.216088 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533505.2142403, fa5fe299-857b-41f5-8069-c3324c227036 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:45.216088 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Started (Lifecycle Event)
Jun 27 04:11:45.219782 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:45.227107 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c00b8176-8dec-4b61-bf5c-ddc489ab49a0 req-49513b6e-2b9f-4a5e-a51f-d2fd38bd08c8 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:45.227107 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c00b8176-8dec-4b61-bf5c-ddc489ab49a0 req-49513b6e-2b9f-4a5e-a51f-d2fd38bd08c8 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:45.227107 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c00b8176-8dec-4b61-bf5c-ddc489ab49a0 req-49513b6e-2b9f-4a5e-a51f-d2fd38bd08c8 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:45.227545 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c00b8176-8dec-4b61-bf5c-ddc489ab49a0 req-49513b6e-2b9f-4a5e-a51f-d2fd38bd08c8 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:45.228233 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c00b8176-8dec-4b61-bf5c-ddc489ab49a0 req-49513b6e-2b9f-4a5e-a51f-d2fd38bd08c8 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:45.228592 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c00b8176-8dec-4b61-bf5c-ddc489ab49a0 req-49513b6e-2b9f-4a5e-a51f-d2fd38bd08c8 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state rescued and task_state None.
Jun 27 04:11:45.310696 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:45.325603 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-97d26c25-34c4-4921-85d3-796f94361fd7 req-a3824d54-e71f-4a83-b1f7-b5f517588336 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-plugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:45.325833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-97d26c25-34c4-4921-85d3-796f94361fd7 req-a3824d54-e71f-4a83-b1f7-b5f517588336 service nova] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:45.326032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-97d26c25-34c4-4921-85d3-796f94361fd7 req-a3824d54-e71f-4a83-b1f7-b5f517588336 service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:45.326184 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-97d26c25-34c4-4921-85d3-796f94361fd7 req-a3824d54-e71f-4a83-b1f7-b5f517588336 service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:45.326315 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-97d26c25-34c4-4921-85d3-796f94361fd7 req-a3824d54-e71f-4a83-b1f7-b5f517588336 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Processing event network-vif-plugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:11:45.390765 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7e939eb8-73aa-4e96-b26f-735bf9284807 for instance 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:11:45.718932 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:45.726157 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:46.087676 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:46.231597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533506.2310789, 075f803b-49f2-4084-9d8a-10d59d1c62eb => ua-7e939eb8-73aa-4e96-b26f-735bf9284807> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:11:46.235216 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully detached device vdb from instance 075f803b-49f2-4084-9d8a-10d59d1c62eb from the live domain config.
Jun 27 04:11:46.236977 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:46.237516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:46.237792 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:46.238242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:46.238723 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e939eb8-73aa-4e96-b26f-735bf9284807', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:46.238901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:46.281786 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '76')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:46.282340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '67')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:46.283341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807', '68')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:46.284249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538422160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:46.284530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:46.284768 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flush multipath device 33000000021e5921c {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:46.294839 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533506.293897, 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:46.295083 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:11:46.295354 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] VM Started (Lifecycle Event)
Jun 27 04:11:46.303000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:11:46.313264 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Instance spawned successfully.
Jun 27 04:11:46.314917 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:11:46.327409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:46.391362 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:46.441849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:46.442019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:46.443174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:46.454972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:46.454972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:46.467443 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:46.495532 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:46.495675 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:46.496010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:46.496010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No VIF found with MAC fa:16:3e:bc:36:85, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:46.508850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260]
Jun 27 04:11:46.508850 np0000003830 nova-compute[98984]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:46.508850 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:46.542347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:46.551856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:46.586825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260]
Jun 27 04:11:46.586825 np0000003830 nova-compute[98984]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-7e939eb8-73aa-4e96-b26f-735bf9284807, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:46.586825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:46.608691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:46.608999 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:46.609214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== disconnect_volume: return (371ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:46.609387 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:46.799009 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:46.805908 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:46.814851 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Unrescuing
Jun 27 04:11:46.815035 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:46.815127 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:46.815290 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:11:46.831836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:46.831975 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:46.832192 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:46.832376 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:46.832693 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:46.832905 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:11:47.000867 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:11:47.105349 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:47.189102 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:47.310937 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:11:47.311538 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533507.3110282, 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:47.311538 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] VM Paused (Lifecycle Event)
Jun 27 04:11:47.318137 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:47.337749 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Took 9.43 seconds to spawn the instance on the hypervisor.
Jun 27 04:11:47.337813 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:47.419076 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5d782600-991b-4b93-8f4f-23a4104b6b61 req-e8d39b6e-8357-4520-8a41-c32932e7624d service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-plugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:47.419302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5d782600-991b-4b93-8f4f-23a4104b6b61 req-e8d39b6e-8357-4520-8a41-c32932e7624d service nova] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:47.419509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5d782600-991b-4b93-8f4f-23a4104b6b61 req-e8d39b6e-8357-4520-8a41-c32932e7624d service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:47.419635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5d782600-991b-4b93-8f4f-23a4104b6b61 req-e8d39b6e-8357-4520-8a41-c32932e7624d service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:47.419747 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5d782600-991b-4b93-8f4f-23a4104b6b61 req-e8d39b6e-8357-4520-8a41-c32932e7624d service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] No waiting events found dispatching network-vif-plugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:47.419855 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5d782600-991b-4b93-8f4f-23a4104b6b61 req-e8d39b6e-8357-4520-8a41-c32932e7624d service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received unexpected event network-vif-plugged-da78a719-d395-411d-a464-aa93c98a28b2 for instance with vm_state active and task_state None.
Jun 27 04:11:47.748900 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:47.814128 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:47.823349 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533507.8222485, 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:47.824217 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] VM Resumed (Lifecycle Event)
Jun 27 04:11:47.860403 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Took 17.42 seconds to build instance.
Jun 27 04:11:47.903989 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0027729190001082316 future=<Future at 0x7ec5180d2ae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:47.904544 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Emitting event <LifecycleEvent: 1782533492.901071, 5a289016-ec72-454c-aec8-e92b65727e16 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:47.904710 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:47.904993 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] VM Stopped (Lifecycle Event)
Jun 27 04:11:47.906099 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.795756308000364 future=<Future at 0x7ec53815d760 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:47.906299 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.795562104000055 future=<Future at 0x7ec53815d760 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:47.906351 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:47.950295 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:48.010736 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:48.011025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:48.083055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9bc58b40-9d5f-403c-99c0-d7cd86261f91 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.851s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:48.202195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4cef7831-729c-43e3-8ffe-7320bc099c84 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.217s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:48.329170 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:48.334261 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:48.337013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:48.337239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:48.337429 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:48.343105 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98984) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 27 04:11:48.343616 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:48.362591 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.930s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:48.409868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c19d7e45-b12f-4261-8e07-f26374cd0dcb tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 5a289016-ec72-454c-aec8-e92b65727e16] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:48.453317 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:48.453913 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'flavor' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:48.515570 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'flavor' on Instance uuid 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:48.518679 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:48.985777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:48.987432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.009783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.021629 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Ignoring supplied device name: /dev/vdb
Jun 27 04:11:49.218595 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.227767 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.316212 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.341969 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999672819000352 future=<Future at 0x7ec5180f3c20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:49.341969 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99875570300037 future=<Future at 0x7ec5180f3c20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:49.341969 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998555918999955 future=<Future at 0x7ec5180f3c20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:49.343339 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance destroyed successfully.
Jun 27 04:11:49.343932 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'numa_topology' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:49.391791 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.394913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.419720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.428409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.466749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:49.489566 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f856f7c2-4408-4c4b-ab42-d6360864f713 req-952dd5ed-f1a1-4e02-98e8-551dc091c121 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:49.489632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f856f7c2-4408-4c4b-ab42-d6360864f713 req-952dd5ed-f1a1-4e02-98e8-551dc091c121 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:49.489805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f856f7c2-4408-4c4b-ab42-d6360864f713 req-952dd5ed-f1a1-4e02-98e8-551dc091c121 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:49.491993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f856f7c2-4408-4c4b-ab42-d6360864f713 req-952dd5ed-f1a1-4e02-98e8-551dc091c121 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:49.493678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f856f7c2-4408-4c4b-ab42-d6360864f713 req-952dd5ed-f1a1-4e02-98e8-551dc091c121 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:49.493875 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f856f7c2-4408-4c4b-ab42-d6360864f713 req-952dd5ed-f1a1-4e02-98e8-551dc091c121 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:11:49.524822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:49.648193 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a34ab07-c934-4523-ad06-cde285364329 req-ecbf026c-c6ea-4101-b1c6-6dce465afe63 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:49.648669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a34ab07-c934-4523-ad06-cde285364329 req-ecbf026c-c6ea-4101-b1c6-6dce465afe63 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:49.648828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a34ab07-c934-4523-ad06-cde285364329 req-ecbf026c-c6ea-4101-b1c6-6dce465afe63 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:49.648935 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a34ab07-c934-4523-ad06-cde285364329 req-ecbf026c-c6ea-4101-b1c6-6dce465afe63 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:49.649063 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a34ab07-c934-4523-ad06-cde285364329 req-ecbf026c-c6ea-4101-b1c6-6dce465afe63 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:49.649165 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9a34ab07-c934-4523-ad06-cde285364329 req-ecbf026c-c6ea-4101-b1c6-6dce465afe63 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state active and task_state powering-off.
Jun 27 04:11:49.709400 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99972316200001 future=<Future at 0x7ec53844c4a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:49.711697 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance destroyed successfully.
Jun 27 04:11:49.712146 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'numa_topology' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:49.846962 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Object Instance<fa5fe299-857b-41f5-8069-c3324c227036> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:50.214672 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:50.214911 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:50.384698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:50.421102 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:50.527564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:50.622536 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:50.630835 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:50.643369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:50.643369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:50.643704 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Attaching volume dcc71466-a05a-4208-a2db-2891876b71ad to /dev/vdb
Jun 27 04:11:50.714111 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:50.730142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4edd4bdd-11e4-4f10-89ef-960d894c62fd tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.393s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:50.732301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:11:50.759739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:50.813470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:11:50.814149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:11:50.827947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:11:50.829535 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fe04:7e18', 'fe80::fc16:3eff:febc:3685', 'fe80::1c7a:4ff:fe26:3a4a', 'fe80::fc16:3eff:fe15:fc91', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe21:dc4a', 'fe80::fc16:3eff:fef9:adbc'] 
Jun 27 04:11:50.830109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:11:50.830305 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:11:50.830678 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:50.831834 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Updating existing volume attachment record: d21f222a-9f41-483a-954d-5d997cb27793 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:11:51.145961 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Stashing vm_state: active {{(pid=98984) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 27 04:11:51.405412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:11:51.405895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcc71466-a05a-4208-a2db-2891876b71ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:51.405986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:51.407790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:51.408059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcc71466-a05a-4208-a2db-2891876b71ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:11:51.424896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:51.425663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:51.426366 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:51.427369 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:51.428050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:51.428427 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:51.442925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:51.442925 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:51.450120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:11:51.450120 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad] added
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:51.458757 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:51.459106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:51.459374 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:51.459691 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad] added
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:11:51.463547 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:51.463778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:11:51.463912 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:11:51.464037 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:11:51.492643 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for fa5fe299-857b-41f5-8069-c3324c227036 due to new event <LifecycleEvent: 1782533511.4920104, fa5fe299-857b-41f5-8069-c3324c227036 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:11:51.492862 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533511.4920104, fa5fe299-857b-41f5-8069-c3324c227036 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:51.492990 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Resumed (Lifecycle Event)
Jun 27 04:11:51.496447 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-415c9f5c-4aa9-4dcb-aa05-e2a36a5667b9 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:51.546626 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:51.582943 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:51.583034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:51.583425 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:51.583969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:51.583969 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:51.583969 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:11:51.584150 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:51.585832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:51.585832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:51.586453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:51.588016 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:51.588016 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:11:51.588713 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:51.588864 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:51.590877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:51.591094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:51.591278 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:51.591433 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-86a73028-dbbd-4625-bf8e-8b7b537a183d req-6f13a266-ef7f-481f-a05f-f58a2acfb589 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received unexpected event network-vif-plugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with vm_state rescued and task_state unrescuing.
Jun 27 04:11:51.746785 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-56462c14-3d5e-45fc-a829-d52b5ed410fa req-6f0d9737-afa1-4d12-b221-f88170bdb44a service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:51.746785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-56462c14-3d5e-45fc-a829-d52b5ed410fa req-6f0d9737-afa1-4d12-b221-f88170bdb44a service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:51.746992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-56462c14-3d5e-45fc-a829-d52b5ed410fa req-6f0d9737-afa1-4d12-b221-f88170bdb44a service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:51.747222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-56462c14-3d5e-45fc-a829-d52b5ed410fa req-6f0d9737-afa1-4d12-b221-f88170bdb44a service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:51.747599 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-56462c14-3d5e-45fc-a829-d52b5ed410fa req-6f0d9737-afa1-4d12-b221-f88170bdb44a service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:51.747769 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-56462c14-3d5e-45fc-a829-d52b5ed410fa req-6f0d9737-afa1-4d12-b221-f88170bdb44a service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:11:51.927700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:51.928363 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:52.002892 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:52.006299 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:52.054044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:52.054726 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquired lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:52.054994 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:11:52.055223 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'info_cache' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:52.107421 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:52.436095 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:11:52.436573 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Claim successful on node np0000003830
Jun 27 04:11:52.460576 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:11:52.464874 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:52.482526 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:11:52.489310 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.499044 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.508074 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.511130 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533512.5098882, fa5fe299-857b-41f5-8069-c3324c227036 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:11:52.511130 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Started (Lifecycle Event)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.519860 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.520181 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.531204 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.532008 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:52.559301 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:52.572773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.50.100,3260]
Jun 27 04:11:52.572773 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:52.572773 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.582083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.596894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.40.100,3260]
Jun 27 04:11:52.596894 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:52.596894 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.605679 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:52.606043 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:52.606448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:52.607253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] HCTL ('7', '-', '-', 0) found on session 77 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:52.607384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:52.612258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:52.638384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching for a device in session 77 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:52.638384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dcc71466-a05a-4208-a2db-2891876b71ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:52.651628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:11:52.652595 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] HCTL ('8', '-', '-', 0) found on session 78 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:11:52.653102 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:11:52.675296 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching for a device in session 78 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:52.730350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:52.731142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:52.731142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:52.731142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:52.731418 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:52.740332 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Terminating instance
Jun 27 04:11:52.943801 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating resource usage from migration 436e0a48-4e96-4a79-9536-b28568263c63
Jun 27 04:11:53.011129 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Refreshing inventories for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 27 04:11:53.013390 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:11:53.019382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:11:53.030833 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:53.030974 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing instance network info cache due to event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:53.031155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:53.031282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:53.031415 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:53.062082 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:53.095449 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Updating ProviderTree inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 27 04:11:53.095687 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:11:53.161802 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Refreshing aggregate associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, aggregates: None {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 27 04:11:53.245045 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Refreshing trait associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, traits: HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_PPC64LE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NODE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 27 04:11:53.247340 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:11:53.286956 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:53.318111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:53.481739 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:53.494845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:53.533823 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:53.538363 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:53.564888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:53.587139 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:53.602802 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999557442999958 future=<Future at 0x7ec538308710 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:53.604690 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Instance destroyed successfully.
Jun 27 04:11:53.605232 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'resources' on Instance uuid 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:53.674873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching for a device in session 78 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:11:53.675019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcc71466-a05a-4208-a2db-2891876b71ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:11:53.773633 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating instance_info_cache with network_info: [{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:53.836616 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2418bf83-1171-4280-b69c-8f6c084f8d8a req-3cff08d2-bae6-4914-abf8-15a08771c63d service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-unplugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:53.836616 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2418bf83-1171-4280-b69c-8f6c084f8d8a req-3cff08d2-bae6-4914-abf8-15a08771c63d service nova] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:53.837083 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2418bf83-1171-4280-b69c-8f6c084f8d8a req-3cff08d2-bae6-4914-abf8-15a08771c63d service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:53.837083 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2418bf83-1171-4280-b69c-8f6c084f8d8a req-3cff08d2-bae6-4914-abf8-15a08771c63d service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:53.837600 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2418bf83-1171-4280-b69c-8f6c084f8d8a req-3cff08d2-bae6-4914-abf8-15a08771c63d service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] No waiting events found dispatching network-vif-unplugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:53.837600 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2418bf83-1171-4280-b69c-8f6c084f8d8a req-3cff08d2-bae6-4914-abf8-15a08771c63d service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-unplugged-da78a719-d395-411d-a464-aa93c98a28b2 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:11:54.025985 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.108768 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-33204467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumemultiattachtest-server-33204467',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:11:47Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-6w2dw8tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:11:47Z,user_data=None,user_id='7132d5dcadb043838976141746b8a26a',uuid=6ffa047a-8ea7-4865-bdcb-be9cac2796a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:11:54.108984 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "da78a719-d395-411d-a464-aa93c98a28b2", "address": "fa:16:3e:21:dc:4a", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda78a719-d3", "ovs_interfaceid": "da78a719-d395-411d-a464-aa93c98a28b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:54.109837 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:54.110137 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:11:54.111646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.111833 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda78a719-d3, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:54.113205 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.115113 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:54.127817 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:54.129542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.136423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.136758 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7915d233-c029-4416-9a28-86701b61da13) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:54.138816 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.140577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:54.147023 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.149266 np0000003830 nova-compute[98984]: INFO os_vif [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:dc:4a,bridge_name='br-int',has_traffic_filtering=True,id=da78a719-d395-411d-a464-aa93c98a28b2,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda78a719-d3')
Jun 27 04:11:54.199399 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:11:54.199797 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:11:54.203764 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:54.204059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:54.204245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:54.278039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Releasing lock "refresh_cache-075f803b-49f2-4084-9d8a-10d59d1c62eb" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:54.300436 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.316122 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:54.429414 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updated VIF entry in instance network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:11:54.430023 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:54.446487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Found WWN 3300000004d9b13a0 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:11:54.446951 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:54.447176 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000004d9b13a0', 'path': '/dev/dm-0', 'multipath_id': '3300000004d9b13a0'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:54.447335 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d9b13a0', 'path': '/dev/dm-0', 'multipath_id': '3300000004d9b13a0'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:11:54.448209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.244s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:54.448964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a333bc8-30de-4d86-ad03-7bc81ae58163', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:54.449680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:54.451863 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'flavor' on Instance uuid 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:54.483366 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163 (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '78')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:54.484074 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', '73')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:54.485114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163', '74')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:54.486039 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870e3e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:54.486253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:54.486467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flush multipath device 33000000002f6eedf {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:54.570312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:54.627581 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:54.690367 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:54.690636 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:54.691834 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:54.703537 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:11:54.709242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:54.711789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:54.729192 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:54.772560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.40.100,3260]
Jun 27 04:11:54.772560 np0000003830 nova-compute[98984]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:54.772560 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:54.792528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:54.804976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:54.852762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.50.100,3260]
Jun 27 04:11:54.852762 np0000003830 nova-compute[98984]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-4a333bc8-30de-4d86-ad03-7bc81ae58163, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:54.852762 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:54.872388 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:54.872730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:54.872912 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== disconnect_volume: return (668ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:54.873082 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:54.873441 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Deleting instance files /opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1_del
Jun 27 04:11:54.874121 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Deletion of /opt/stack/data/nova/instances/6ffa047a-8ea7-4865-bdcb-be9cac2796a1_del complete
Jun 27 04:11:54.932807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3def1c3-982d-48d3-8b88-49100b7d143f req-c7c66ab1-cc42-48ee-9b0f-973bf3511d9a service nova] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:54.955266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Attempting to attach volume dcc71466-a05a-4208-a2db-2891876b71ad with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]:   <alias name="ua-dcc71466-a05a-4208-a2db-2891876b71ad"/>
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]:   <serial>dcc71466-a05a-4208-a2db-2891876b71ad</serial>
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:11:54.957187 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:11:55.110806 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:55.111066 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing instance network info cache due to event network-changed-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:11:55.111291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] Acquiring lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:55.111578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] Acquired lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:55.111711 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Refreshing network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:11:55.213422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.285s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:55.213695 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Migrating
Jun 27 04:11:55.213809 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:11:55.305011 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance destroyed successfully.
Jun 27 04:11:55.305011 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'numa_topology' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:55.383736 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Took 2.13 seconds to destroy the instance on the hypervisor.
Jun 27 04:11:55.384488 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:11:55.385312 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:11:55.385427 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:11:55.385739 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:55.476574 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:55.614659 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:55.735957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:11:55.736245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:11:55.736299 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:11:55.808053 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:55.808369 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'resources' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:55.930808 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-unplugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:55.931333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] Acquiring lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:55.933144 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:55.933144 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:55.933144 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] No waiting events found dispatching network-vif-unplugged-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:55.933144 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-unplugged-da78a719-d395-411d-a464-aa93c98a28b2 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:11:55.933144 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Received event network-vif-deleted-da78a719-d395-411d-a464-aa93c98a28b2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:55.933144 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Neutron deleted interface da78a719-d395-411d-a464-aa93c98a28b2; detaching it from the instance and deleting it from the info cache
Jun 27 04:11:55.935821 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cb34900-0bd1-4393-8eec-a8c0058a9bc5 req-f9bbef32-9155-4bc9-9fee-a98cf0736f44 service nova] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Detach interface failed, port_id=da78a719-d395-411d-a464-aa93c98a28b2, reason: Instance 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:11:56.055742 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:56.239143 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:56.257654 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updated VIF entry in instance network info cache for port deeb79be-2aa4-4e3c-aa75-7ea49bf99feb. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:11:56.257911 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [{"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:56.297949 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:56.310633 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:56.311457 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:11:56.311779 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:56.312394 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:56.312686 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:11:56.314409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:56.314963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeef0b1e2-12, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:56.319935 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:56.323022 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:56.324276 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:56.324771 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4eb00637-5a90-47d3-b2dc-73aa1019ba2f) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:56.325639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:56.326418 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:56.327487 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:56.329346 np0000003830 nova-compute[98984]: INFO os_vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12')
Jun 27 04:11:56.338183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start _get_guest_xml network_info=[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:11:56.343767 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:11:56.345798 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1106153631', uuid='075f803b-49f2-4084-9d8a-10d59d1c62eb'), owner=OwnerMeta(userid='216588ecf8894ad5aeb6914196a090db', username='tempest-AttachVolumeTestJSON-559471176-project-member', projectid='72fed82034484f13a228c535b175c167', projectname='tempest-AttachVolumeTestJSON-559471176'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533516.345409) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:11:56.347047 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:11:56.347351 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:11:56.348093 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:11:56.351897 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:11:56.356347 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:11:56.356772 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:11:56.357071 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:11:56.357215 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:11:56.357377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:11:56.357987 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:11:56.358168 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:11:56.358402 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:11:56.358654 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:11:56.358846 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:11:56.359305 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:11:56.359774 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:11:56.359980 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'vcpu_model' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:56.500437 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:56.661340 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:56.661798 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:56.661798 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:11:56.661798 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No VIF found with MAC fa:16:3e:15:fc:91, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:11:56.694088 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:11:56.761224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d7edc65-2be1-4f4c-9623-3b7b94d8b0f8 req-7d8095d0-ef84-4cb9-8061-d604c77a3cc5 service nova] Releasing lock "refresh_cache-fa5fe299-857b-41f5-8069-c3324c227036" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:56.802046 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Took 1.42 seconds to deallocate network for instance.
Jun 27 04:11:56.864705 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:56.880218 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:11:56.891264 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:11:56.891537 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:56.892086 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:56.892706 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'pci_devices' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:57.270973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:57.383104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:11:57.395521 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:57.397528 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Took 0.59 seconds to detach 1 volumes for instance.
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <uuid>075f803b-49f2-4084-9d8a-10d59d1c62eb</uuid>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <name>instance-0000001e</name>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeTestJSON-server-1106153631</nova:name>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:11:56</nova:creationTime>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:user uuid="216588ecf8894ad5aeb6914196a090db">tempest-AttachVolumeTestJSON-559471176-project-member</nova:user>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:project uuid="72fed82034484f13a228c535b175c167">tempest-AttachVolumeTestJSON-559471176</nova:project>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         <nova:port uuid="eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <entry name="serial">075f803b-49f2-4084-9d8a-10d59d1c62eb</entry>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <entry name="uuid">075f803b-49f2-4084-9d8a-10d59d1c62eb</entry>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk.config"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fd:3a:c2"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <target dev="tapeef0b1e2-12"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/console.log" append="off"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:11:57.399083 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:11:57.401532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:57.512963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:57.514133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:57.624866 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:57.625619 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'trusted_certs' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:57.934283 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:57.934832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:58.130834 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:58.130834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:58.235107 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:58.235908 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:11:58.236927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:58.277159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1d96220f-d8e7-47b0-aea7-6a3866c13339 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.633s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:58.356111 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:58.356484 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Cannot resize image /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:11:58.356760 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'migration_context' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:11:58.791380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:11:58.791700 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:11:58.859771 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Object Instance<075f803b-49f2-4084-9d8a-10d59d1c62eb> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:11:58.860981 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:11:58.861266 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:58.862213 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:58.862656 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:11:58.863146 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.863588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:58.863966 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:11:58.866276 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.866455 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7daec925-7a62-5e1b-8d4e-a09dd2bb2453', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:58.867830 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.868081 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:58.868375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.870586 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.870844 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeef0b1e2-12, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:58.871154 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeef0b1e2-12, col_values=(('qos', UUID('62db05e4-9f60-4757-a1c5-ecf74f952fbb')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:58.871325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeef0b1e2-12, col_values=(('external_ids', {'iface-id': 'eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:3a:c2', 'vm-uuid': '075f803b-49f2-4084-9d8a-10d59d1c62eb'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:58.872361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.873736 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:58.878713 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.879811 np0000003830 nova-compute[98984]: INFO os_vif [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12')
Jun 27 04:11:58.899601 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Starting migrate_disk_and_power_off {{(pid=98984) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12623}}
Jun 27 04:11:58.939427 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.944012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.962762 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:58.981259 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.008435 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.294659 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:11:59.318767 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.328348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-010f4575-16c5-4576-834e-9bd72c4a969c req-ecd0d185-e161-4844-aea1-632aad3a44a8 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:11:59.328727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-010f4575-16c5-4576-834e-9bd72c4a969c req-ecd0d185-e161-4844-aea1-632aad3a44a8 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:11:59.329023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-010f4575-16c5-4576-834e-9bd72c4a969c req-ecd0d185-e161-4844-aea1-632aad3a44a8 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:11:59.329245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-010f4575-16c5-4576-834e-9bd72c4a969c req-ecd0d185-e161-4844-aea1-632aad3a44a8 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:59.329525 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-010f4575-16c5-4576-834e-9bd72c4a969c req-ecd0d185-e161-4844-aea1-632aad3a44a8 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:11:59.329773 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-010f4575-16c5-4576-834e-9bd72c4a969c req-ecd0d185-e161-4844-aea1-632aad3a44a8 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state active and task_state resize_migrating.
Jun 27 04:11:59.400870 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999545409999882 future=<Future at 0x7ec51810c1a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:11:59.408882 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance destroyed successfully.
Jun 27 04:11:59.413461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:54Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:11:59.413461 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:11:59.413461 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:11:59.413461 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:11:59.417839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.417839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a31a876-77, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:59.419369 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.420765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:59.426416 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.440799 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.440799 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edb8e22e-4a94-4ac5-8e2b-e5e43deb6b7b) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:11:59.440799 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.441962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:11:59.451752 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.454080 np0000003830 nova-compute[98984]: INFO os_vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77')
Jun 27 04:11:59.455896 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:11:59.456297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:11:59.456442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:11:59.456906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:11:59.457250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:11:59.457446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:59.488998 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:11:59.489273 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:11:59.489526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '78')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:11:59.489675 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '75')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:59.491174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '76')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:11:59.499034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181d22a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'): ({'sdi'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:11:59.499034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:11:59.499034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flush multipath device 33000000014503705 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:11:59.541454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:59.562559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.610653 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.610653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:11:59.616279 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.652228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:11:59.652228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:11:59.653822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:11:59.685375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:11:59.685375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:11:59.697224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:59.734018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260]
Jun 27 04:11:59.734018 np0000003830 nova-compute[98984]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:11:59.734018 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:59.740350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:11:59.762253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:59.773848 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:59.805513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.871s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:11:59.830459 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260]
Jun 27 04:11:59.830459 np0000003830 nova-compute[98984]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:11:59.830459 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:59.849969 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:11:59.850209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:11:59.850370 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== disconnect_volume: return (393ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:11:59.850479 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:11:59.855172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:11:59.901193 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocations for instance 6ffa047a-8ea7-4865-bdcb-be9cac2796a1
Jun 27 04:11:59.955100 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:11:59.957772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:00.063661 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:00.065022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:12:00.065685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_resize/disk /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:00.082255 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:00.092250 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:00.108972 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:00.237005 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "cp -r /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_resize/disk /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk" returned: 0 in 0.171s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:00.237510 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_resize/disk.config /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:00.291638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "cp -r /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_resize/disk.config /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:00.292323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_resize/disk.info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:00.342448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "cp -r /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_resize/disk.info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" returned: 0 in 0.050s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:00.890241 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:00.919257 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:12:00.920618 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 075f803b-49f2-4084-9d8a-10d59d1c62eb due to new event <LifecycleEvent: 1782533520.9200299, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:12:00.920811 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533520.9200299, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:00.920811 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Resumed (Lifecycle Event)
Jun 27 04:12:00.927417 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6017590-9d07-48a9-b53f-b0261019d523 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6ffa047a-8ea7-4865-bdcb-be9cac2796a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.194s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:00.935046 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance rebooted successfully.
Jun 27 04:12:01.416397 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d7300381-9c25-4f65-8f7c-582df69612e6 req-d132f895-a662-4a55-b5a4-de9517ee10c2 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:01.416855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d7300381-9c25-4f65-8f7c-582df69612e6 req-d132f895-a662-4a55-b5a4-de9517ee10c2 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:01.417073 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d7300381-9c25-4f65-8f7c-582df69612e6 req-d132f895-a662-4a55-b5a4-de9517ee10c2 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:01.417351 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d7300381-9c25-4f65-8f7c-582df69612e6 req-d132f895-a662-4a55-b5a4-de9517ee10c2 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:01.417480 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d7300381-9c25-4f65-8f7c-582df69612e6 req-d132f895-a662-4a55-b5a4-de9517ee10c2 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:01.417765 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d7300381-9c25-4f65-8f7c-582df69612e6 req-d132f895-a662-4a55-b5a4-de9517ee10c2 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state active and task_state resize_migrating.
Jun 27 04:12:01.426958 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:01.435592 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:01.590959 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:01.591328 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:01.706115 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Port 5a31a876-771a-4133-85ce-0ca67fa2d4af binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:12:01.942118 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 27 04:12:01.942118 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533521.9400804, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:01.942118 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Started (Lifecycle Event)
Jun 27 04:12:02.229709 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:02.448276 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:02.448687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:02.448870 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:02.449082 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:fd:3a:c2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:12:02.449789 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-91339ec8-1315-486d-a29c-e4ba0651c58d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:02.450716 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:02.721237 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:12:02.743541 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:02.744431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:02.744431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:02.953337 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 27 04:12:03.504047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:03.750614 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:03.780787 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1fdc74a5-6987-4431-9c38-6287e37571bb req-3ead886a-8a71-46fd-bc7a-76572e265080 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:03.781600 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1fdc74a5-6987-4431-9c38-6287e37571bb req-3ead886a-8a71-46fd-bc7a-76572e265080 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:03.782778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1fdc74a5-6987-4431-9c38-6287e37571bb req-3ead886a-8a71-46fd-bc7a-76572e265080 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:03.782972 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1fdc74a5-6987-4431-9c38-6287e37571bb req-3ead886a-8a71-46fd-bc7a-76572e265080 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:03.783166 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1fdc74a5-6987-4431-9c38-6287e37571bb req-3ead886a-8a71-46fd-bc7a-76572e265080 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:03.783313 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-1fdc74a5-6987-4431-9c38-6287e37571bb req-3ead886a-8a71-46fd-bc7a-76572e265080 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state active and task_state None.
Jun 27 04:12:03.857761 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:03.857761 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:03.860056 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:12:04.331099 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:04.341122 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0007406099998661375 future=<Future at 0x7ec5180f3c20 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.343021 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.348736 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.36594193900009486 future=<Future at 0x7ec53844c4a0 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.348736 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.3658548260000316 future=<Future at 0x7ec53844c4a0 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.348736 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.348736 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.258286121999845 future=<Future at 0x7ec538308710 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.348736 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.258201543999803 future=<Future at 0x7ec538308710 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:04.365243 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:04.433521 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:04.539265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:04.539793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:04.539793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "6d020229-688f-487c-8458-d1f3cd69257b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:04.540087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:04.540245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:04.542441 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Terminating instance
Jun 27 04:12:04.789561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:04.884216 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:05.047102 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:05.089835 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.097026 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.127875 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:05.151053 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.299016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.305033 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.365271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.395670 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999696524000228 future=<Future at 0x7ec5183706b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:05.398214 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Instance destroyed successfully.
Jun 27 04:12:05.399074 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'resources' on Instance uuid 6d020229-688f-487c-8458-d1f3cd69257b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:05.622650 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:05.842288 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f93fb7fd-2dec-47e4-bf2b-de17c2b27a72 req-47c2575f-dc29-440e-bef1-b5ca0d907bfa service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:05.842288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f93fb7fd-2dec-47e4-bf2b-de17c2b27a72 req-47c2575f-dc29-440e-bef1-b5ca0d907bfa service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:05.842288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f93fb7fd-2dec-47e4-bf2b-de17c2b27a72 req-47c2575f-dc29-440e-bef1-b5ca0d907bfa service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:05.842769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f93fb7fd-2dec-47e4-bf2b-de17c2b27a72 req-47c2575f-dc29-440e-bef1-b5ca0d907bfa service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:05.842769 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f93fb7fd-2dec-47e4-bf2b-de17c2b27a72 req-47c2575f-dc29-440e-bef1-b5ca0d907bfa service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:05.842769 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f93fb7fd-2dec-47e4-bf2b-de17c2b27a72 req-47c2575f-dc29-440e-bef1-b5ca0d907bfa service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received unexpected event network-vif-plugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with vm_state active and task_state None.
Jun 27 04:12:05.902008 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:08:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=26,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:45Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-kpbrjr46',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=6d020229-688f-487c-8458-d1f3cd69257b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:05.902295 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "dad80f04-574e-4c16-a005-e27d4fd01f73", "address": "fa:16:3e:04:7e:18", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdad80f04-57", "ovs_interfaceid": "dad80f04-574e-4c16-a005-e27d4fd01f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:05.903304 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:05.904031 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:05.905512 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.905884 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdad80f04-57, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:05.909527 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:05.910528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:05.910528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00782ecf-4f87-4f82-aa0d-1734fd29bdde) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:05.912028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:05.913869 np0000003830 nova-compute[98984]: INFO os_vif [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7e:18,bridge_name='br-int',has_traffic_filtering=True,id=dad80f04-574e-4c16-a005-e27d4fd01f73,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdad80f04-57')
Jun 27 04:12:05.914117 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Deleting instance files /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_del
Jun 27 04:12:05.923815 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Deletion of /opt/stack/data/nova/instances/6d020229-688f-487c-8458-d1f3cd69257b_del complete
Jun 27 04:12:05.974856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:05.975012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:06.138827 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:06.150236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:12:06.172641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:06.220722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:12:06.221049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:12:06.232859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:12:06.235433 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::fc16:3eff:fe37:2f2e', 'fe80::fc16:3eff:fe56:2462', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fe15:fc91', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fef9:adbc', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c'] 
Jun 27 04:12:06.238002 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:12:06.238002 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:12:06.238002 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:06.435567 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:06.436616 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:06.436891 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:06.437026 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:06.437432 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:06.480818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:12:06.576947 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:07.059379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:07.059977 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:07.064707 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:12:07.064892 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Claim successful on node np0000003830
Jun 27 04:12:07.302066 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee7805a1-fda7-46d0-88ac-580a1140d910 req-cae20a71-5530-414b-935b-1a96cc3c6d28 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Received event network-vif-deleted-dad80f04-574e-4c16-a005-e27d4fd01f73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:07.302066 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-ee7805a1-fda7-46d0-88ac-580a1140d910 req-cae20a71-5530-414b-935b-1a96cc3c6d28 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Neutron deleted interface dad80f04-574e-4c16-a005-e27d4fd01f73; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:07.304157 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee7805a1-fda7-46d0-88ac-580a1140d910 req-cae20a71-5530-414b-935b-1a96cc3c6d28 service nova] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Detach interface failed, port_id=dad80f04-574e-4c16-a005-e27d4fd01f73, reason: Instance 6d020229-688f-487c-8458-d1f3cd69257b could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:07.410210 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Starting finish_migration {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12810}}
Jun 27 04:12:07.412959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:12:07.413199 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Creating image(s)
Jun 27 04:12:07.414668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:07.530136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:07.530568 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:12:07.531961 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:07.650300 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:07.650747 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Cannot resize image /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:12:07.736407 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:08.153997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:12:08.154583 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Ensure instance console log exists: /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:12:08.155347 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:08.155699 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:08.156203 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:08.160837 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start _get_guest_xml network_info=[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '9de7e4a3-217d-4642-bf82-2be1ce790db7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'a41c0a78-a4b0-4a62-b391-e0eef4bd2329', 'attached_at': '2026-06-27T04:12:06.000000', 'detached_at': '', 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'serial': 'd3addc83-672b-4534-833a-767e39b9a06e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:12:08.168662 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:12:08.171245 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-118420821', uuid='a41c0a78-a4b0-4a62-b391-e0eef4bd2329'), owner=OwnerMeta(userid='e6787c0723ee4e7097d500e19c4cba02', username='tempest-ServerActionsTestOtherB-2075548864-project-member', projectid='7e1b9b8f3bfc490dbd68a422dabbe3c6', projectname='tempest-ServerActionsTestOtherB-2075548864'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533528.1695967) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:12:08.178279 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:12:08.179014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:12:08.182034 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:12:08.182034 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:12:08.183560 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:12:08.184207 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:12:08.184395 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:12:08.184711 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:12:08.185125 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:12:08.185357 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:12:08.185529 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:12:08.185685 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:12:08.185878 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:12:08.186482 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:12:08.186739 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:12:08.186953 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:12:08.207188 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:08.242711 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Took 1.80 seconds to deallocate network for instance.
Jun 27 04:12:08.316585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:08.316805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:08.317577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:08.318374 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:08.318919 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:12:08.319416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:08.321533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:08.321533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:08.321879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:12:08.342103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:08.342576 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:08.343144 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:12:08.344552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:08.350023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:08.351011 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:12:08.356559 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:12:08.356559 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:08.373264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:12:08.373264 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e] added
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:08.379402 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:08.379709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:12:08.379916 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:12:08.380270 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e] added
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:12:08.387214 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:12:08.602402 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0006726450001224293 future=<Future at 0x7ec538308710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:08.602550 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:08.602728 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.797322796000117 future=<Future at 0x7ec51810c1a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:08.603261 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.796788207000191 future=<Future at 0x7ec51810c1a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:08.603686 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] Emitting event <LifecycleEvent: 1782533513.6015887, 6ffa047a-8ea7-4865-bdcb-be9cac2796a1 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:08.606956 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] VM Stopped (Lifecycle Event)
Jun 27 04:12:08.763103 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:08.867254 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:08.867694 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:09.078593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:09.078785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:09.111513 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b87969d8-016e-40bf-9521-fde9de2f8fd8 tempest-VolumesExtendAttachedTest-1697340961 tempest-VolumesExtendAttachedTest-1697340961-project-member] [instance: 6ffa047a-8ea7-4865-bdcb-be9cac2796a1] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:09.323582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:09.370941 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:09.383026 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:12:09.387562 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:12:09.395560 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:12:09.402700 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.409874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.417549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.428487 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.428929 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.434292 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:09.475266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260]
Jun 27 04:12:09.475266 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:09.475266 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.479907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260]
Jun 27 04:12:09.479907 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:09.479907 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.487580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.496968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.510879 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:09.511287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:09.511688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:12:09.512397 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] HCTL ('12', '-', '-', 0) found on session 80 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:12:09.512504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce544a5b-5ee1-4f78-a40f-590862632fa5 (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] HCTL ('13', '-', '-', 0) found on session 81 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:12:09.523270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:12:09.531094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 80 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:09.531257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:12:09.538571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 81 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:09.538898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:12:09.581331 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:12:09.880613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.821s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:09.881356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.118s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:09.881719 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:12:10.148349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:10.350252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:12:10.391677 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:12:10.401746 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:12:10.403796 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:10.404828 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:10.519619 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '254ca81292aa43cbb5ad840ef12d273c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba0dccc908d4cc8a9705a38fb9aedd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:12:10.788331 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:10.788331 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:10.904223 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:12:10.912198 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:11.096143 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Successfully created port: 04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:12:11.292540 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:11.371080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Found WWN 33000000014503705 for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:12:11.371729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:11.371729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '33000000014503705', 'path': '/dev/dm-2', 'multipath_id': '33000000014503705'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:11.372007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000014503705', 'path': '/dev/dm-2', 'multipath_id': '33000000014503705'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:12:11.408989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:12:11.801698 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Successfully updated port: 04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:12:11.803715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.922s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:11.805589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.657s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:11.812525 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:12:11.812525 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Claim successful on node np0000003830
Jun 27 04:12:11.851642 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-changed-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:11.851642 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Refreshing instance network info cache due to event network-changed-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:12:11.851642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] Acquiring lock "refresh_cache-e2cd5341-13e7-472d-90ce-b0887dc00f59" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:11.851642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] Acquired lock "refresh_cache-e2cd5341-13e7-472d-90ce-b0887dc00f59" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:11.851642 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Refreshing network info cache for port 04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:12:11.879271 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:54Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:12:11.879552 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:11.880270 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <uuid>a41c0a78-a4b0-4a62-b391-e0eef4bd2329</uuid>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <name>instance-00000021</name>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <memory>262144</memory>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherB-server-118420821</nova:name>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:12:08</nova:creationTime>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.micro" id="84">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:memory>256</nova:memory>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:user uuid="e6787c0723ee4e7097d500e19c4cba02">tempest-ServerActionsTestOtherB-2075548864-project-member</nova:user>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:project uuid="7e1b9b8f3bfc490dbd68a422dabbe3c6">tempest-ServerActionsTestOtherB-2075548864</nova:project>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         <nova:port uuid="5a31a876-771a-4133-85ce-0ca67fa2d4af">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <entry name="serial">a41c0a78-a4b0-4a62-b391-e0eef4bd2329</entry>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <entry name="uuid">a41c0a78-a4b0-4a62-b391-e0eef4bd2329</entry>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <alias name="ua-d3addc83-672b-4534-833a-767e39b9a06e"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <serial>d3addc83-672b-4534-833a-767e39b9a06e</serial>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:bc:36:85"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <target dev="tap5a31a876-77"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/console.log" append="off"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:12:11.882001 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:12:11.885608 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:54Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:12:11.885608 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1413962802-network", "vif_mac": "fa:16:3e:bc:36:85"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:11.885608 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:11.885608 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:12:11.885608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:11.885608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:11.886105 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:12:11.886244 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocations for instance 6d020229-688f-487c-8458-d1f3cd69257b
Jun 27 04:12:11.890627 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:11.890880 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '010a60ca-ce21-5cf9-a9c1-331a2f9453cc', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:11.893926 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:11.896556 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:11.899200 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:11.899963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a31a876-77, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:11.900332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a31a876-77, col_values=(('qos', UUID('c712c663-c39a-449f-b1e5-90fa5db1f07d')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:11.900516 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a31a876-77, col_values=(('external_ids', {'iface-id': '5a31a876-771a-4133-85ce-0ca67fa2d4af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:36:85', 'vm-uuid': 'a41c0a78-a4b0-4a62-b391-e0eef4bd2329'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:11.903337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:11.910188 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:11.911389 np0000003830 nova-compute[98984]: INFO os_vif [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77')
Jun 27 04:12:12.308675 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "refresh_cache-e2cd5341-13e7-472d-90ce-b0887dc00f59" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:12.359112 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:12.418536 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:12:12.419748 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:12:12.420043 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Creating image(s)
Jun 27 04:12:12.421275 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:12.421275 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "/opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:12.421603 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "/opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:12.423782 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:12.428346 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:12.430091 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:12.462161 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:12:12.487052 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:12.536897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:12.537437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:12.537891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:12.538892 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:12.545027 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:12.545375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:12.646780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:12.647395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:12.671816 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:12.703809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk 1073741824" returned: 0 in 0.056s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:12.704271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:12.704612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:12.811136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:12.811618 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:12:12.811868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:12.905708 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-76f2c6ea-1061-4530-9899-6a96ad20e8ea tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "6d020229-688f-487c-8458-d1f3cd69257b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.366s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:12.917018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:12.917402 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Cannot resize image /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:12:12.917648 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:12:12.917850 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Ensure instance console log exists: /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:12:12.918085 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:12.918238 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:12.918360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:12.997000 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] While synchronizing instance power states, found 12 instances in the database and 10 instances on the hypervisor.
Jun 27 04:12:12.997217 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid a243ff55-7b82-43af-a0b8-158eb4b8d030 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:12.998148 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:12.998598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:12.998765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:12.999241 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:12.999699 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:12.999868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.000241 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.000867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.001081 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.001382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.002015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.002237 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.005302 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.005686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.005809 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.006002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.006181 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.006346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid e2cd5341-13e7-472d-90ce-b0887dc00f59 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.006527 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:12:13.009429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.021647 np0000003830 nova-compute[98984]: WARNING nova.utils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7ec5381525c0> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
Jun 27 04:12:13.023155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.025867 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 13.34 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:12:13.174997 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1b97a3d9-ed82-47dc-9bac-175972c5e444 req-f29f8813-55f7-48f3-9307-f230bc082a28 service nova] Releasing lock "refresh_cache-e2cd5341-13e7-472d-90ce-b0887dc00f59" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:13.175579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquired lock "refresh_cache-e2cd5341-13e7-472d-90ce-b0887dc00f59" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:13.175810 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:12:13.288522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.454447 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:13.455182 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:13.455182 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:13.455182 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] No VIF found with MAC fa:16:3e:bc:36:85, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:12:13.455945 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Using config drive
Jun 27 04:12:13.522606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.522s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.523205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.523400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.524051 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.523s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.524878 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.526s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.525290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.525715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.526714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.526980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "fa5fe299-857b-41f5-8069-c3324c227036" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.530087 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 27 04:12:13.532286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.530s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.532598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.537007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.538076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.249s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.540540 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:12:13.545012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.545012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.527s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.545012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.009s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.545012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.545012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.545364 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:13.545631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:13.547619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:13.556069 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Terminating instance
Jun 27 04:12:13.568315 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:13.568847 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:13.768162 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:12:13.999646 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:14.015255 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.043158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.518s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.045816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:14.046663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.518s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.048121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "fa5fe299-857b-41f5-8069-c3324c227036" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.522s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.056904 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.059537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.064868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:14.066342 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.520s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.072425 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:14.100063 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.112635 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.129236 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.177164 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.335231 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Updating instance_info_cache with network_info: [{"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:14.341969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.354563 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bdf1c382-bcb4-432b-b3e9-5282ac5714bc req-040a63f6-6dad-4aaa-9abf-40a6a4f1fc39 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:14.354563 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bdf1c382-bcb4-432b-b3e9-5282ac5714bc req-040a63f6-6dad-4aaa-9abf-40a6a4f1fc39 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:14.354563 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bdf1c382-bcb4-432b-b3e9-5282ac5714bc req-040a63f6-6dad-4aaa-9abf-40a6a4f1fc39 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:14.354563 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bdf1c382-bcb4-432b-b3e9-5282ac5714bc req-040a63f6-6dad-4aaa-9abf-40a6a4f1fc39 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.354563 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bdf1c382-bcb4-432b-b3e9-5282ac5714bc req-040a63f6-6dad-4aaa-9abf-40a6a4f1fc39 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:14.358257 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-bdf1c382-bcb4-432b-b3e9-5282ac5714bc req-040a63f6-6dad-4aaa-9abf-40a6a4f1fc39 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state active and task_state resize_finish.
Jun 27 04:12:14.372720 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5974563f-d1ae-40ef-890b-71fe6fb5edf8 req-29337a89-2645-43f9-8c8b-14bc0160c620 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:14.375130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5974563f-d1ae-40ef-890b-71fe6fb5edf8 req-29337a89-2645-43f9-8c8b-14bc0160c620 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:14.375566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5974563f-d1ae-40ef-890b-71fe6fb5edf8 req-29337a89-2645-43f9-8c8b-14bc0160c620 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:14.376934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5974563f-d1ae-40ef-890b-71fe6fb5edf8 req-29337a89-2645-43f9-8c8b-14bc0160c620 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.377888 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5974563f-d1ae-40ef-890b-71fe6fb5edf8 req-29337a89-2645-43f9-8c8b-14bc0160c620 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:14.378115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5974563f-d1ae-40ef-890b-71fe6fb5edf8 req-29337a89-2645-43f9-8c8b-14bc0160c620 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:14.400641 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005048210000495601 future=<Future at 0x7ec51810c1a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:14.403290 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Emitting event <LifecycleEvent: 1782533519.3999352, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:14.404846 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:14.405149 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Stopped (Lifecycle Event)
Jun 27 04:12:14.407370 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.988319563999994 future=<Future at 0x7ec5183706b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:14.407370 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.987999768000009 future=<Future at 0x7ec5183706b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:14.408683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.421406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.448568 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999615782999626 future=<Future at 0x7ec5381d46e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:14.459748 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Instance destroyed successfully.
Jun 27 04:12:14.460740 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'resources' on Instance uuid e52a57a3-19dd-482d-bd3a-20e3a5230c4e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:14.535868 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.544571 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.547446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.582931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.777s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:14.582931 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:12:14.586660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.844020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Releasing lock "refresh_cache-e2cd5341-13e7-472d-90ce-b0887dc00f59" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:14.844289 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Instance network_info: |[{"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:12:14.846759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Start _get_guest_xml network_info=[{"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:12:14.849860 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:12:14.851638 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1964363238', uuid='e2cd5341-13e7-472d-90ce-b0887dc00f59'), owner=OwnerMeta(userid='254ca81292aa43cbb5ad840ef12d273c', username='tempest-VolumesActionsTest-902759485-project-member', projectid='5ba0dccc908d4cc8a9705a38fb9aedd9', projectname='tempest-VolumesActionsTest-902759485'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533534.8511193) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:12:14.852459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.854474 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:12:14.854962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:12:14.856832 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:12:14.856985 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:12:14.858087 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:12:14.858440 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:12:14.858602 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:12:14.858768 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:12:14.858913 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:12:14.859000 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:12:14.859117 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:12:14.859306 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:12:14.859392 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:12:14.859875 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:12:14.861083 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.862030 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:12:14.862540 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:12:14.876065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1964363238',display_name='tempest-VolumesActionsTest-instance-1964363238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-1964363238',id=36,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba0dccc908d4cc8a9705a38fb9aedd9',ramdisk_id='',reservation_id='r-6eeo1cfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-902759485',owner_user_name='tempest-VolumesActionsTest-902759485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:11Z,user_data=None,user_id='254ca81292aa43cbb5ad840ef12d273c',uuid=e2cd5341-13e7-472d-90ce-b0887dc00f59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:12:14.876296 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Converting VIF {"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:14.877047 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:14.877837 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lazy-loading 'pci_devices' on Instance uuid e2cd5341-13e7-472d-90ce-b0887dc00f59 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:14.908784 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:14.964595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=24,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:44Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-geh2au0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=e52a57a3-19dd-482d-bd3a-20e3a5230c4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:14.964595 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "5621924f-9e14-46a7-bd15-6952d449805b", "address": "fa:16:3e:56:24:62", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5621924f-9e", "ovs_interfaceid": "5621924f-9e14-46a7-bd15-6952d449805b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:14.966017 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:14.966475 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:14.967877 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.968159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5621924f-9e, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:14.972250 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.973414 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:14.976400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.976813 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdff8529-4ace-41f9-94f8-ba20644c4d40) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:14.979158 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:14.980236 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:14.984290 np0000003830 nova-compute[98984]: INFO os_vif [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:24:62,bridge_name='br-int',has_traffic_filtering=True,id=5621924f-9e14-46a7-bd15-6952d449805b,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5621924f-9e')
Jun 27 04:12:14.984290 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Deleting instance files /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_del
Jun 27 04:12:14.995267 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Deletion of /opt/stack/data/nova/instances/e52a57a3-19dd-482d-bd3a-20e3a5230c4e_del complete
Jun 27 04:12:15.093936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:12:15.093936 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:12:15.093936 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:15.093936 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:15.149156 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:12:15.150692 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533535.1501727, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:15.150849 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Resumed (Lifecycle Event)
Jun 27 04:12:15.158233 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance running successfully.
Jun 27 04:12:15.164371 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Failed to set time: agent not configured {{(pid=98984) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 27 04:12:15.164371 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d3177a8-afe8-48e0-a733-f06b1f583bc1 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] finish_migration finished successfully. {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12905}}
Jun 27 04:12:15.189536 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be52472c68cd47fe991efe4050788c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6a6b08a14849038c79ff273d34be3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <uuid>e2cd5341-13e7-472d-90ce-b0887dc00f59</uuid>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <name>instance-00000024</name>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesActionsTest-instance-1964363238</nova:name>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:12:14</nova:creationTime>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:user uuid="254ca81292aa43cbb5ad840ef12d273c">tempest-VolumesActionsTest-902759485-project-member</nova:user>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:project uuid="5ba0dccc908d4cc8a9705a38fb9aedd9">tempest-VolumesActionsTest-902759485</nova:project>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         <nova:port uuid="04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <entry name="serial">e2cd5341-13e7-472d-90ce-b0887dc00f59</entry>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <entry name="uuid">e2cd5341-13e7-472d-90ce-b0887dc00f59</entry>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.config"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d6:76:5a"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <target dev="tap04a9c562-b8"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/console.log" append="off"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:12:15.381479 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:12:15.384052 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Preparing to wait for external event network-vif-plugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:12:15.384052 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:15.384052 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:15.384052 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:15.384052 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1964363238',display_name='tempest-VolumesActionsTest-instance-1964363238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-1964363238',id=36,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba0dccc908d4cc8a9705a38fb9aedd9',ramdisk_id='',reservation_id='r-6eeo1cfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-902759485',owner_user_name='tempest-VolumesActionsTest-902759485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:11Z,user_data=None,user_id='254ca81292aa43cbb5ad840ef12d273c',uuid=e2cd5341-13e7-472d-90ce-b0887dc00f59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:12:15.384052 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Converting VIF {"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:15.384923 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:15.385321 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:12:15.385690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.385902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:15.386086 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:12:15.386969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.387116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e1a0923-0eee-5aa8-8d28-f41050ee030d', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:15.387991 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.388828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:15.389406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.391981 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.392230 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04a9c562-b8, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:15.392725 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04a9c562-b8, col_values=(('qos', UUID('e3c05873-b535-4b9f-ae88-e080e28d78af')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:15.392932 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04a9c562-b8, col_values=(('external_ids', {'iface-id': '04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:76:5a', 'vm-uuid': 'e2cd5341-13e7-472d-90ce-b0887dc00f59'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:15.393949 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.395633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:15.401579 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:15.402725 np0000003830 nova-compute[98984]: INFO os_vif [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8')
Jun 27 04:12:15.501425 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:15.502111 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:15.502520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:15.503070 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:15.503362 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:15.578295 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:15.596923 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:12:15.658173 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:15.661154 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:15.738529 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Successfully created port: e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:12:16.101294 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:12:16.163922 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:12:16.164095 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533536.163936, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:16.164248 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Started (Lifecycle Event)
Jun 27 04:12:16.411408 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Successfully updated port: e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:12:16.460293 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:16.469668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:16.469668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:16.469668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:16.469668 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:16.469668 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state resized and task_state None.
Jun 27 04:12:16.469668 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-deleted-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:16.470205 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Neutron deleted interface 5621924f-9e14-46a7-bd15-6952d449805b; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:16.475770 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-042c0871-88c4-4adc-a49f-72f536ad83d6 req-19092723-d6fd-4456-bbe3-b5b160201038 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Detach interface failed, port_id=5621924f-9e14-46a7-bd15-6952d449805b, reason: Instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:16.486879 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4ff62f9a-3b05-43f0-8495-ceef7b2e0bf1 req-dd3e0cd9-8c13-4882-a005-ee6aa1765013 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:16.487092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4ff62f9a-3b05-43f0-8495-ceef7b2e0bf1 req-dd3e0cd9-8c13-4882-a005-ee6aa1765013 service nova] Acquiring lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:16.487289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4ff62f9a-3b05-43f0-8495-ceef7b2e0bf1 req-dd3e0cd9-8c13-4882-a005-ee6aa1765013 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:16.487427 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4ff62f9a-3b05-43f0-8495-ceef7b2e0bf1 req-dd3e0cd9-8c13-4882-a005-ee6aa1765013 service nova] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:16.489733 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4ff62f9a-3b05-43f0-8495-ceef7b2e0bf1 req-dd3e0cd9-8c13-4882-a005-ee6aa1765013 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] No waiting events found dispatching network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:16.489934 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4ff62f9a-3b05-43f0-8495-ceef7b2e0bf1 req-dd3e0cd9-8c13-4882-a005-ee6aa1765013 service nova] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Received event network-vif-unplugged-5621924f-9e14-46a7-bd15-6952d449805b for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:16.516094 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:16.667149 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:16.669790 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:16.914520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:16.914520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:16.914520 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:12:16.923588 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:16.923729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:16.923845 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] No VIF found with MAC fa:16:3e:d6:76:5a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:12:16.924281 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Using config drive
Jun 27 04:12:17.018786 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Took 1.52 seconds to deallocate network for instance.
Jun 27 04:12:17.113435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:12:17.115136 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:12:17.116517 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Creating image(s)
Jun 27 04:12:17.116517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:17.116517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:17.116876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:17.117251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "e0d3e397c9cd9ff9c48f64a12e785c164b93769c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:17.117869 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "e0d3e397c9cd9ff9c48f64a12e785c164b93769c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:17.222082 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:17.405902 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:17.406241 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:17.406481 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:17.436574 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:17.519624 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Port 5a31a876-771a-4133-85ce-0ca67fa2d4af binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:12:17.520170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:17.520170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:17.520291 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:12:17.527638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:17.527638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:17.545183 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:12:17.650752 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Creating config drive at /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.config
Jun 27 04:12:17.653911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpev03ywfs {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:17.722034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpev03ywfs" returned: 0 in 0.068s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:17.838121 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:17.843977 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:17.844462 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:17.904648 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:17.949571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.part --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:17.949954 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] 0b794a1c-a528-4c36-a812-29377cdc843e was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:12:17.950608 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:12:17.953519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.part /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.027957 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:18.103473 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:18.171727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.part /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.converted" returned: 0 in 0.221s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.178592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.263217 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.284667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c.converted --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.284667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "e0d3e397c9cd9ff9c48f64a12e785c164b93769c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.166s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:18.285407 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:18.289184 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:18.290326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.326669 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.410530 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.412012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "e0d3e397c9cd9ff9c48f64a12e785c164b93769c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:18.412012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "e0d3e397c9cd9ff9c48f64a12e785c164b93769c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:18.412451 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:18.416326 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:18.416428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.449662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.524083 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9f89348f-09b5-4bd8-83b9-b05ec18d3474 req-126d4335-ca54-40e3-b1b0-727376f6412b service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-plugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:18.524953 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9f89348f-09b5-4bd8-83b9-b05ec18d3474 req-126d4335-ca54-40e3-b1b0-727376f6412b service nova] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:18.525340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9f89348f-09b5-4bd8-83b9-b05ec18d3474 req-126d4335-ca54-40e3-b1b0-727376f6412b service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:18.525539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9f89348f-09b5-4bd8-83b9-b05ec18d3474 req-126d4335-ca54-40e3-b1b0-727376f6412b service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:18.526868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9f89348f-09b5-4bd8-83b9-b05ec18d3474 req-126d4335-ca54-40e3-b1b0-727376f6412b service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Processing event network-vif-plugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:12:18.550216 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:18.559105 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing instance network info cache due to event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:12:18.559214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:18.560430 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:18.565138 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json" returned: 0 in 0.149s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.566159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c,backing_fmt=raw /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.610230 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:18.611674 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance network_info: |[{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:12:18.613362 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:18.613362 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:12:18.643338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c,backing_fmt=raw /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk 1073741824" returned: 0 in 0.077s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.643971 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "e0d3e397c9cd9ff9c48f64a12e785c164b93769c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:18.644809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.712347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.717384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.719429 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.746134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:18.757027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.758252 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:12:18.758587 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:18.791291 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:18.791939 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:18.860464 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:18.884170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:18.884625 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Cannot resize image /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:12:18.885031 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:12:18.885278 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Ensure instance console log exists: /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:12:18.886007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:18.886269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:18.886458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:18.888637 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Start _get_guest_xml network_info=[{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:12:06Z,direct_url=<?>,disk_format='qcow2',id=0b794a1c-a528-4c36-a812-29377cdc843e,min_disk=0,min_ram=0,name='tempest-scenario-img--253538835',owner='ef6a6b08a14849038c79ff273d34be3f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:12:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0b794a1c-a528-4c36-a812-29377cdc843e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:12:18.892300 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:12:18.896612 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0b794a1c-a528-4c36-a812-29377cdc843e', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1674285695', uuid='7a9c24d6-f85f-4fbf-9f00-33a8f029e43b'), owner=OwnerMeta(userid='be52472c68cd47fe991efe4050788c09', username='tempest-TestMinimumBasicScenario-1552363864-project-member', projectid='ef6a6b08a14849038c79ff273d34be3f', projectname='tempest-TestMinimumBasicScenario-1552363864'), image=ImageMeta(id='0b794a1c-a528-4c36-a812-29377cdc843e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533538.8960824) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:12:18.899036 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:12:18.899603 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:12:18.900705 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:12:18.901010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:12:18.902206 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:12:18.902788 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:12:06Z,direct_url=<?>,disk_format='qcow2',id=0b794a1c-a528-4c36-a812-29377cdc843e,min_disk=0,min_ram=0,name='tempest-scenario-img--253538835',owner='ef6a6b08a14849038c79ff273d34be3f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:12:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:12:18.902788 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:12:18.903924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:12:18.918352 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1674285695',display_name='tempest-TestMinimumBasicScenario-server-1674285695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1674285695',id=37,image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgum/gIYxMDwJRllTP2re+g6juLUdaKsjIBtLjj/vhSmgumtf+9sVssRINNmjajkhDItVllQdfCF1coq5cKGTOSRLuhpQXPQZcNhNfT45XvB+bz7Gr0woIXPVFo2yV4nA==',key_name='tempest-TestMinimumBasicScenario-921440636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-bwl80gc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:16Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=7a9c24d6-f85f-4fbf-9f00-33a8f029e43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:12:18.918577 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:18.919136 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:18.919833 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:19.120761 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:19.301258 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:19.355187 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.363329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <uuid>7a9c24d6-f85f-4fbf-9f00-33a8f029e43b</uuid>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <name>instance-00000025</name>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestMinimumBasicScenario-server-1674285695</nova:name>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:12:18</nova:creationTime>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:image uuid="0b794a1c-a528-4c36-a812-29377cdc843e">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:properties/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:user uuid="be52472c68cd47fe991efe4050788c09">tempest-TestMinimumBasicScenario-1552363864-project-member</nova:user>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:project uuid="ef6a6b08a14849038c79ff273d34be3f">tempest-TestMinimumBasicScenario-1552363864</nova:project>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="0b794a1c-a528-4c36-a812-29377cdc843e"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         <nova:port uuid="e16fd2c7-f6ff-473f-abbf-989f993f285c">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <entry name="serial">7a9c24d6-f85f-4fbf-9f00-33a8f029e43b</entry>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <entry name="uuid">7a9c24d6-f85f-4fbf-9f00-33a8f029e43b</entry>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:06:8c:f2"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <target dev="tape16fd2c7-f6"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/console.log" append="off"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Preparing to wait for external event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:12:19.424681 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:19.426870 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:19.426870 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:19.427994 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1674285695',display_name='tempest-TestMinimumBasicScenario-server-1674285695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1674285695',id=37,image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgum/gIYxMDwJRllTP2re+g6juLUdaKsjIBtLjj/vhSmgumtf+9sVssRINNmjajkhDItVllQdfCF1coq5cKGTOSRLuhpQXPQZcNhNfT45XvB+bz7Gr0woIXPVFo2yV4nA==',key_name='tempest-TestMinimumBasicScenario-921440636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-bwl80gc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:16Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=7a9c24d6-f85f-4fbf-9f00-33a8f029e43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:12:19.428159 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:19.428832 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:19.429150 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:12:19.429959 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.430178 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:19.430467 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:12:19.431933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.432402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6a81750-25b9-53db-a343-182e76af5695', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:19.435710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.436005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:19.438179 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.441043 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.441309 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape16fd2c7-f6, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:19.441869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape16fd2c7-f6, col_values=(('qos', UUID('e5f5afd8-9df1-413d-986c-56ba7e84eb12')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:19.442099 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape16fd2c7-f6, col_values=(('external_ids', {'iface-id': 'e16fd2c7-f6ff-473f-abbf-989f993f285c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:8c:f2', 'vm-uuid': '7a9c24d6-f85f-4fbf-9f00-33a8f029e43b'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:19.443557 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.445072 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:19.450987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:19.452685 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533539.4518285, e2cd5341-13e7-472d-90ce-b0887dc00f59 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:19.455814 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:12:19.455814 np0000003830 nova-compute[98984]: INFO os_vif [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6')
Jun 27 04:12:19.456306 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] VM Started (Lifecycle Event)
Jun 27 04:12:19.459811 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:12:19.472045 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Instance spawned successfully.
Jun 27 04:12:19.472425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:12:19.624185 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:19.813921 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.288s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:19.822783 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updated VIF entry in instance network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:12:19.823202 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:19.870392 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Creating tmpfile /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/tmpbhyxk47q to verify with other compute node that the instance is on the same shared storage. {{(pid=98984) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10570}}
Jun 27 04:12:19.871168 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:12:19.883162 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocations for instance e52a57a3-19dd-482d-bd3a-20e3a5230c4e
Jun 27 04:12:19.959856 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:19.963010 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:19.986267 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:19.986267 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:19.986626 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:19.986958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:19.987257 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:19.987588 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:20.326281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-32195d98-d00d-4a30-b8b4-fadc24df47e7 req-d4ce1e49-0d97-4ad6-9d8a-ee782d48e76e service nova] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:20.397528 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00212781999971412 future=<Future at 0x7ec5183706b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:20.399362 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:20.399584 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.048477814999842 future=<Future at 0x7ec5381d46e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:20.400022 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.048333043999719 future=<Future at 0x7ec5381d46e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:20.400098 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Emitting event <LifecycleEvent: 1782533525.3952317, 6d020229-688f-487c-8458-d1f3cd69257b => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:20.400335 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] VM Stopped (Lifecycle Event)
Jun 27 04:12:20.422015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:20.427453 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:20.454733 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:20.466305 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:20.467276 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:12:20.467707 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533540.4674587, e2cd5341-13e7-472d-90ce-b0887dc00f59 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:20.467842 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] VM Paused (Lifecycle Event)
Jun 27 04:12:20.494410 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Took 8.08 seconds to spawn the instance on the hypervisor.
Jun 27 04:12:20.499840 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:20.509909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:20.629809 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2656ce1b-e4f1-4af8-bd96-839cfce6c646 req-ad350ab6-bf95-48fb-9d5d-210445a2e1e9 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-plugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:20.630290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2656ce1b-e4f1-4af8-bd96-839cfce6c646 req-ad350ab6-bf95-48fb-9d5d-210445a2e1e9 service nova] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:20.630290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2656ce1b-e4f1-4af8-bd96-839cfce6c646 req-ad350ab6-bf95-48fb-9d5d-210445a2e1e9 service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:20.630290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2656ce1b-e4f1-4af8-bd96-839cfce6c646 req-ad350ab6-bf95-48fb-9d5d-210445a2e1e9 service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:20.630416 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2656ce1b-e4f1-4af8-bd96-839cfce6c646 req-ad350ab6-bf95-48fb-9d5d-210445a2e1e9 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] No waiting events found dispatching network-vif-plugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:20.630586 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2656ce1b-e4f1-4af8-bd96-839cfce6c646 req-ad350ab6-bf95-48fb-9d5d-210445a2e1e9 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received unexpected event network-vif-plugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 for instance with vm_state active and task_state None.
Jun 27 04:12:20.704845 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19e37359-7459-42c8-a01b-918e41989254 req-14e8cf87-afc3-4649-820b-953612900c6e service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:20.705058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19e37359-7459-42c8-a01b-918e41989254 req-14e8cf87-afc3-4649-820b-953612900c6e service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:20.705223 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19e37359-7459-42c8-a01b-918e41989254 req-14e8cf87-afc3-4649-820b-953612900c6e service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:20.705374 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19e37359-7459-42c8-a01b-918e41989254 req-14e8cf87-afc3-4649-820b-953612900c6e service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:20.705630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19e37359-7459-42c8-a01b-918e41989254 req-14e8cf87-afc3-4649-820b-953612900c6e service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:20.705630 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-19e37359-7459-42c8-a01b-918e41989254 req-14e8cf87-afc3-4649-820b-953612900c6e service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state resized and task_state resize_reverting.
Jun 27 04:12:20.723329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:20.723329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:20.765872 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance destroyed successfully.
Jun 27 04:12:20.767111 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'resources' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:20.893817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad16768a-8661-4786-a268-11b7e465bdb5 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "e52a57a3-19dd-482d-bd3a-20e3a5230c4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.356s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:20.903763 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 6d020229-688f-487c-8458-d1f3cd69257b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:20.970758 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:20.973327 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533540.9728084, e2cd5341-13e7-472d-90ce-b0887dc00f59 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:20.973327 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] VM Resumed (Lifecycle Event)
Jun 27 04:12:20.990767 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:20.990969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:20.991109 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No VIF found with MAC fa:16:3e:06:8c:f2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:12:20.991511 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Using config drive
Jun 27 04:12:21.024437 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Took 14.03 seconds to build instance.
Jun 27 04:12:21.228314 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Detaching volume dcc71466-a05a-4208-a2db-2891876b71ad
Jun 27 04:12:21.269911 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:12:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:21.270693 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:21.271268 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:21.272219 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Attempting to driver detach volume dcc71466-a05a-4208-a2db-2891876b71ad from mountpoint /dev/vdb
Jun 27 04:12:21.273227 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:21.274454 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:21.274588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a31a876-77, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:21.275560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:21.276247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:21.282402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:21.283285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:21.283424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c712c663-c39a-449f-b1e5-90fa5db1f07d) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:21.283963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:21.284440 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:21.285931 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Found disk vdb by alias ua-dcc71466-a05a-4208-a2db-2891876b71ad {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:12:21.288784 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Found disk vdb by alias ua-dcc71466-a05a-4208-a2db-2891876b71ad {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:12:21.288991 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Attempting to detach device vdb from instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:   <alias name="ua-dcc71466-a05a-4208-a2db-2891876b71ad"/>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:   <serial>dcc71466-a05a-4208-a2db-2891876b71ad</serial>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:12:21.289368 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:12:21.292311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:21.294849 np0000003830 nova-compute[98984]: INFO os_vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77')
Jun 27 04:12:21.297281 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:12:21.298428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:21.298428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:21.298428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:21.298767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:12:21.298911 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully detached device vdb from instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 from the persistent domain config.
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] (1/8): Attempting to detach device vdb with device alias ua-dcc71466-a05a-4208-a2db-2891876b71ad from instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:   <alias name="ua-dcc71466-a05a-4208-a2db-2891876b71ad"/>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:   <serial>dcc71466-a05a-4208-a2db-2891876b71ad</serial>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:12:21.302599 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:21.331688 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:21.332065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '81')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:12:21.332349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '80')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:21.333368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '81')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:21.334219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538413c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:12:21.334419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Removing multipathed devices sdh, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:12:21.335016 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flush multipath device 33000000014503705 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:12:21.371090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:21.425880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:21.473614 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:12:21.474155 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:12:21.475370 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:12:21.476482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:21.479328 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:21.488530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:12:21.488903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:12:21.497377 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:21.505910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:21.526654 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.551s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:21.527189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.982s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:21.527455 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:12:21.527786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:21.537981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260]
Jun 27 04:12:21.537981 np0000003830 nova-compute[98984]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:21.537981 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:21.559194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:21.572487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:21.623024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260]
Jun 27 04:12:21.623024 np0000003830 nova-compute[98984]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:21.623024 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:21.629478 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Creating config drive at /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config
Jun 27 04:12:21.633937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpex0fdg69 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:21.649538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:21.649538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:21.649538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== disconnect_volume: return (351ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:21.649538 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:12:21.696293 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpex0fdg69" returned: 0 in 0.063s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:21.915212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dcc71466-a05a-4208-a2db-2891876b71ad for instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:12:21.982969 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999545331999798 future=<Future at 0x7ec538305e50 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:21.983446 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533541.9829595, 371a4e1b-1860-46a0-85e5-3f505c4797b3 => ua-dcc71466-a05a-4208-a2db-2891876b71ad> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:12:21.987625 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully detached device vdb from instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 from the live domain config.
Jun 27 04:12:21.990548 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:12:21.990548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcc71466-a05a-4208-a2db-2891876b71ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:21.990548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:21.990548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:21.990881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcc71466-a05a-4208-a2db-2891876b71ad', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:12:21.991190 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad (non-flash)
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '78')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '78')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:22.017021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad', '77')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:22.017969 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53813b6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:12:22.018293 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:12:22.018615 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Flush multipath device 3300000004d9b13a0 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:12:22.064046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:22.112252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:22.171228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:12:22.171228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:12:22.171228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:12:22.182304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:12:22.182304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:12:22.193081 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:22.227905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.40.100,3260]
Jun 27 04:12:22.227905 np0000003830 nova-compute[98984]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:22.227905 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:22.245283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:22.248775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.260255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:22.280977 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.289097 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.300587 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.50.100,3260]
Jun 27 04:12:22.300587 np0000003830 nova-compute[98984]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-dcc71466-a05a-4208-a2db-2891876b71ad, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:22.300587 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:22.321219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:22.321219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:22.321219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] <== disconnect_volume: return (329ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:22.321219 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:12:22.394185 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.650790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.655305 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.677551 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:22.790483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:22.792138 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:22.792319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:22.793689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:22.794971 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:22.797221 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state resized and task_state resize_reverting.
Jun 27 04:12:22.798589 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:22.799226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:22.799389 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:22.799556 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:22.799721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Processing event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:12:22.799883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:22.800027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:22.800164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:22.800283 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:22.800399 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:22.800543 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-05e3edae-343c-4328-b782-c92df4ba5230 req-1b530189-2a36-4169-b211-8d34655b546e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received unexpected event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with vm_state building and task_state spawning.
Jun 27 04:12:22.831582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:22.831827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:22.906532 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'flavor' on Instance uuid 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:23.166159 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533543.1657803, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:23.166318 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] VM Started (Lifecycle Event)
Jun 27 04:12:23.168041 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:12:23.172836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:12:23.176972 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance spawned successfully.
Jun 27 04:12:23.177345 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:12:23.334011 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'migration_context' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:23.363517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:23.363795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:23.364195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:23.364195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:23.364397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:23.367221 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Terminating instance
Jun 27 04:12:23.669378 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:23.672028 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:23.687804 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:23.687955 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:23.688253 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:23.688620 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:23.688847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:23.689148 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:12:23.836256 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Object Instance<a41c0a78-a4b0-4a62-b391-e0eef4bd2329> lazy-loaded attributes: resources,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:12:23.873957 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:23.900765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:23.903237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:23.916282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6416987-0e5c-4369-87b2-5c691e2ab32b tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.194s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:23.921697 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:23.979922 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:23.980125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:23.980301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:23.980437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:23.980575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:23.983273 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Terminating instance
Jun 27 04:12:24.067439 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.071346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-24c3ebc3-077e-4be1-8249-09d89670456d req-c1fedab8-bc36-4096-a807-10bb399532fa service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-unplugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:24.071346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-24c3ebc3-077e-4be1-8249-09d89670456d req-c1fedab8-bc36-4096-a807-10bb399532fa service nova] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:24.071346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-24c3ebc3-077e-4be1-8249-09d89670456d req-c1fedab8-bc36-4096-a807-10bb399532fa service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:24.071346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-24c3ebc3-077e-4be1-8249-09d89670456d req-c1fedab8-bc36-4096-a807-10bb399532fa service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:24.071346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-24c3ebc3-077e-4be1-8249-09d89670456d req-c1fedab8-bc36-4096-a807-10bb399532fa service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] No waiting events found dispatching network-vif-unplugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:24.071346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-24c3ebc3-077e-4be1-8249-09d89670456d req-c1fedab8-bc36-4096-a807-10bb399532fa service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-unplugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:24.074052 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.174912 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:12:24.175189 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533544.1750019, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:24.175297 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] VM Paused (Lifecycle Event)
Jun 27 04:12:24.197595 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Took 7.08 seconds to spawn the instance on the hypervisor.
Jun 27 04:12:24.197595 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:24.234938 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Instance destroyed successfully.
Jun 27 04:12:24.238921 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'resources' on Instance uuid 1be2d4c5-613b-40a0-97f5-e9776d36a813 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:24.358485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.487971 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:24.525151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.525783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.551446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.556735 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.587975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.590380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.615615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:24.615955 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:24.680464 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:24.685220 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533544.6848822, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:24.685446 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] VM Resumed (Lifecycle Event)
Jun 27 04:12:24.717526 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Took 14.63 seconds to build instance.
Jun 27 04:12:24.744540 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:07:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-1',id=19,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:07:18Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-h0qre21m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:07:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=1be2d4c5-613b-40a0-97f5-e9776d36a813,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:24.744540 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "address": "fa:16:3e:37:2f:2e", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c75c4dc-87", "ovs_interfaceid": "2c75c4dc-87e1-4fc7-9a88-307115ff819c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:24.744540 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:24.745346 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:24.749377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.749876 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c75c4dc-87, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:24.754452 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:24.759123 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.761308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.761554 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40cb9534-ca9f-4c30-8d2d-29909d75449b) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:24.763124 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.763124 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:24.770022 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:24.772974 np0000003830 nova-compute[98984]: INFO os_vif [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:2f:2e,bridge_name='br-int',has_traffic_filtering=True,id=2c75c4dc-87e1-4fc7-9a88-307115ff819c,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c75c4dc-87')
Jun 27 04:12:24.773407 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Deleting instance files /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813_del
Jun 27 04:12:24.774638 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Deletion of /opt/stack/data/nova/instances/1be2d4c5-613b-40a0-97f5-e9776d36a813_del complete
Jun 27 04:12:24.855745 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Instance destroyed successfully.
Jun 27 04:12:24.856218 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'resources' on Instance uuid 371a4e1b-1860-46a0-85e5-3f505c4797b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:24.873660 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e1649b5d-eb17-4102-92e4-7cad61a278f0 req-5c2d118a-8643-4148-bd4d-9c9c46f0cf5f service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-unplugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:24.873956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e1649b5d-eb17-4102-92e4-7cad61a278f0 req-5c2d118a-8643-4148-bd4d-9c9c46f0cf5f service nova] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:24.874204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e1649b5d-eb17-4102-92e4-7cad61a278f0 req-5c2d118a-8643-4148-bd4d-9c9c46f0cf5f service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:24.874670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e1649b5d-eb17-4102-92e4-7cad61a278f0 req-5c2d118a-8643-4148-bd4d-9c9c46f0cf5f service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:24.874874 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e1649b5d-eb17-4102-92e4-7cad61a278f0 req-5c2d118a-8643-4148-bd4d-9c9c46f0cf5f service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] No waiting events found dispatching network-vif-unplugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:24.875562 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e1649b5d-eb17-4102-92e4-7cad61a278f0 req-5c2d118a-8643-4148-bd4d-9c9c46f0cf5f service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-unplugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:25.122032 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:25.191519 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:25.193604 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:25.219029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.140s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:25.219337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.174s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:25.281923 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:25.282764 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:25.282979 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:25.283105 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:25.283369 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:25.359553 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-651828240',display_name='tempest-VolumesBackupsTest-instance-651828240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesbackupstest-instance-651828240',id=34,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV5czgXzDE5iHYo+G3hIharLq05dmgzJFMzgU2/To5wq/65j2/YkFuujjlAIIg4Y9FMn8O9MzZ4+AKu6wgDyrK/0HRXvT3s8pWxj9Bocd8c9jOOicT8xbNqiyx2AB96KQ==',key_name='tempest-keypair-1420135909',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:11:08Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1121cceb6eae4ccb920a6e3123169bf9',ramdisk_id='',reservation_id='r-vh0o42fo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1314634333',owner_user_name='tempest-VolumesBackupsTest-1314634333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cf90b3e43344e76aa1e04e16824517a',uuid=371a4e1b-1860-46a0-85e5-3f505c4797b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:25.359804 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converting VIF {"id": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "address": "fa:16:3e:15:fc:91", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6ba8ee-64", "ovs_interfaceid": "7a6ba8ee-644a-4584-995a-5306252ef6b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:25.360363 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:25.360847 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:25.362244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:25.362448 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a6ba8ee-64, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:25.363581 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:25.364591 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:25.365262 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:25.366327 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:25.366511 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9db91631-f5ef-4290-8439-4eae0a4adf1d) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:25.367636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:25.367636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:25.367917 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:25.371121 np0000003830 nova-compute[98984]: INFO os_vif [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:91,bridge_name='br-int',has_traffic_filtering=True,id=7a6ba8ee-644a-4584-995a-5306252ef6b9,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6ba8ee-64')
Jun 27 04:12:25.371462 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Deleting instance files /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3_del
Jun 27 04:12:25.372365 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Deletion of /opt/stack/data/nova/instances/371a4e1b-1860-46a0-85e5-3f505c4797b3_del complete
Jun 27 04:12:25.400967 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:25.701527 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999725710000348 future=<Future at 0x7ec53840a450 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:25.701527 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999847245999717 future=<Future at 0x7ec5181fc560 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:25.729793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:25.780373 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6fc69af0-d9ca-4b4a-aefa-dcf540622493 req-5eaa9b53-9e3b-444e-aa92-9475e007f7f6 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-deleted-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:25.780507 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-6fc69af0-d9ca-4b4a-aefa-dcf540622493 req-5eaa9b53-9e3b-444e-aa92-9475e007f7f6 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Neutron deleted interface 2c75c4dc-87e1-4fc7-9a88-307115ff819c; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:25.782506 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6fc69af0-d9ca-4b4a-aefa-dcf540622493 req-5eaa9b53-9e3b-444e-aa92-9475e007f7f6 service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Detach interface failed, port_id=2c75c4dc-87e1-4fc7-9a88-307115ff819c, reason: Instance 1be2d4c5-613b-40a0-97f5-e9776d36a813 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:25.879187 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:25.879699 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:25.880002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:25.880079 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:25.880620 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:25.958305 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:26.138281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.306s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:26.138455 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:12:26.157653 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34e53a8f-38e3-465d-b2f7-8e5350074e4e req-c439e0dc-b31f-49d2-b0e9-c2affeb5a8ec service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-unplugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:26.159038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34e53a8f-38e3-465d-b2f7-8e5350074e4e req-c439e0dc-b31f-49d2-b0e9-c2affeb5a8ec service nova] Acquiring lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:26.159038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34e53a8f-38e3-465d-b2f7-8e5350074e4e req-c439e0dc-b31f-49d2-b0e9-c2affeb5a8ec service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:26.159038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34e53a8f-38e3-465d-b2f7-8e5350074e4e req-c439e0dc-b31f-49d2-b0e9-c2affeb5a8ec service nova] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:26.159038 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34e53a8f-38e3-465d-b2f7-8e5350074e4e req-c439e0dc-b31f-49d2-b0e9-c2affeb5a8ec service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] No waiting events found dispatching network-vif-unplugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:26.159038 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34e53a8f-38e3-465d-b2f7-8e5350074e4e req-c439e0dc-b31f-49d2-b0e9-c2affeb5a8ec service nova] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Received event network-vif-unplugged-2c75c4dc-87e1-4fc7-9a88-307115ff819c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:26.225879 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:26.370265 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:26.370640 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.46 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:12:26.657467 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0a8b2a74-7d73-4c40-b60d-6fa4cf45b0b9 req-4047e2d4-e2f8-4401-9790-62219c7e3159 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-deleted-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:26.657467 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-0a8b2a74-7d73-4c40-b60d-6fa4cf45b0b9 req-4047e2d4-e2f8-4401-9790-62219c7e3159 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Neutron deleted interface 7a6ba8ee-644a-4584-995a-5306252ef6b9; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:26.662141 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0a8b2a74-7d73-4c40-b60d-6fa4cf45b0b9 req-4047e2d4-e2f8-4401-9790-62219c7e3159 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Detach interface failed, port_id=7a6ba8ee-644a-4584-995a-5306252ef6b9, reason: Instance 371a4e1b-1860-46a0-85e5-3f505c4797b3 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:26.729521 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Took 1.44 seconds to deallocate network for instance.
Jun 27 04:12:26.830601 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:26.833927 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:12:26.933459 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-552190d9-a534-4591-9634-94b96322bbd2 req-7b68d095-e3c9-43d3-91d2-897a89efbf72 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-unplugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:26.934415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-552190d9-a534-4591-9634-94b96322bbd2 req-7b68d095-e3c9-43d3-91d2-897a89efbf72 service nova] Acquiring lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:26.934895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-552190d9-a534-4591-9634-94b96322bbd2 req-7b68d095-e3c9-43d3-91d2-897a89efbf72 service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:26.934895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-552190d9-a534-4591-9634-94b96322bbd2 req-7b68d095-e3c9-43d3-91d2-897a89efbf72 service nova] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:26.935000 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-552190d9-a534-4591-9634-94b96322bbd2 req-7b68d095-e3c9-43d3-91d2-897a89efbf72 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] No waiting events found dispatching network-vif-unplugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:26.935097 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-552190d9-a534-4591-9634-94b96322bbd2 req-7b68d095-e3c9-43d3-91d2-897a89efbf72 service nova] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Received event network-vif-unplugged-7a6ba8ee-644a-4584-995a-5306252ef6b9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:27.086485 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:27.152426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:27.152667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:27.152861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:27.152973 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:27.153128 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:27.155324 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Terminating instance
Jun 27 04:12:27.233229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:27.233382 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:27.588472 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Took 1.71 seconds to deallocate network for instance.
Jun 27 04:12:27.666866 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:27.690664 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:27.693409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:27.716886 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:27.722088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:27.753018 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:27.755972 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Swapping old allocation on dict_keys(['d6db2083-b24e-4fc9-8e4d-9a740cf9bf37']) held by migration 436e0a48-4e96-4a79-9536-b28568263c63 for instance
Jun 27 04:12:27.908132 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Overwriting current allocation {'allocations': {'d6db2083-b24e-4fc9-8e4d-9a740cf9bf37': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 52}}, 'project_id': '7e1b9b8f3bfc490dbd68a422dabbe3c6', 'user_id': 'e6787c0723ee4e7097d500e19c4cba02', 'consumer_generation': 1} on consumer a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
Jun 27 04:12:27.944063 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7da5949b-1da3-4917-aa97-db9f72ac36f7 req-73e524dd-b590-49a4-8781-013ea9d20e71 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-unplugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:27.944872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7da5949b-1da3-4917-aa97-db9f72ac36f7 req-73e524dd-b590-49a4-8781-013ea9d20e71 service nova] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:27.945081 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7da5949b-1da3-4917-aa97-db9f72ac36f7 req-73e524dd-b590-49a4-8781-013ea9d20e71 service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:27.945280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7da5949b-1da3-4917-aa97-db9f72ac36f7 req-73e524dd-b590-49a4-8781-013ea9d20e71 service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:27.945461 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7da5949b-1da3-4917-aa97-db9f72ac36f7 req-73e524dd-b590-49a4-8781-013ea9d20e71 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] No waiting events found dispatching network-vif-unplugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:27.945693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7da5949b-1da3-4917-aa97-db9f72ac36f7 req-73e524dd-b590-49a4-8781-013ea9d20e71 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-unplugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:27.993744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:27.993744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:27.995342 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.005847 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.023049 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999619169999733 future=<Future at 0x7ec518772180 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:28.023700 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:28.023967 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:28.025962 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Instance destroyed successfully.
Jun 27 04:12:28.026351 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lazy-loading 'resources' on Instance uuid e2cd5341-13e7-472d-90ce-b0887dc00f59 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:28.095640 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:28.132017 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:28.276627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:28.276796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquired lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:28.276963 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:12:28.498748 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:28.527942 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:28.533010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1964363238',display_name='tempest-VolumesActionsTest-instance-1964363238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-1964363238',id=36,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:20Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ba0dccc908d4cc8a9705a38fb9aedd9',ramdisk_id='',reservation_id='r-6eeo1cfb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-902759485',owner_user_name='tempest-VolumesActionsTest-902759485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:12:21Z,user_data=None,user_id='254ca81292aa43cbb5ad840ef12d273c',uuid=e2cd5341-13e7-472d-90ce-b0887dc00f59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:28.533289 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Converting VIF {"id": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "address": "fa:16:3e:d6:76:5a", "network": {"id": "d94d3029-45b5-4f07-980e-746d4e67df3f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1522708991-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5ba0dccc908d4cc8a9705a38fb9aedd9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap04a9c562-b8", "ovs_interfaceid": "04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:28.533995 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:28.534211 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:28.535480 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.536168 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04a9c562-b8, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:28.538804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.539592 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:28.539678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.540436 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.540593 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3c05873-b535-4b9f-ae88-e080e28d78af) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:28.541414 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.541953 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:28.542402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:28.544445 np0000003830 nova-compute[98984]: INFO os_vif [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:76:5a,bridge_name='br-int',has_traffic_filtering=True,id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0,network=Network(d94d3029-45b5-4f07-980e-746d4e67df3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04a9c562-b8')
Jun 27 04:12:28.544817 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Deleting instance files /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59_del
Jun 27 04:12:28.545506 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Deletion of /opt/stack/data/nova/instances/e2cd5341-13e7-472d-90ce-b0887dc00f59_del complete
Jun 27 04:12:28.779140 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:28.830267 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:28.830658 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:29.039851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.806s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:29.041582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.944s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:29.052555 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:29.053239 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:29.054753 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:29.057891 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:29.057891 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:29.171845 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:29.174438 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocations for instance 1be2d4c5-613b-40a0-97f5-e9776d36a813
Jun 27 04:12:29.210002 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:29.335267 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:29.361465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:29.416746 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:29.448682 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004833600000893057 future=<Future at 0x7ec5381d46e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:29.449006 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:29.449006 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=7.533449966999797 future=<Future at 0x7ec538305e50 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:29.449006 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=7.533324953999909 future=<Future at 0x7ec538305e50 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:29.451773 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Emitting event <LifecycleEvent: 1782533534.4479656, e52a57a3-19dd-482d-bd3a-20e3a5230c4e => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:29.451773 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] VM Stopped (Lifecycle Event)
Jun 27 04:12:29.505075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:29.783535 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:29.784096 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:29.919179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Releasing lock "refresh_cache-a41c0a78-a4b0-4a62-b391-e0eef4bd2329" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:29.919541 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:29.931033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:12:29.954803 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e52a57a3-19dd-482d-bd3a-20e3a5230c4e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:29.955950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:30.011174 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-unplugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:30.011592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:12:30.011753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] Acquiring lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:30.012035 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] No waiting events found dispatching network-vif-unplugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-unplugged-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Received event network-vif-deleted-04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Neutron deleted interface 04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:30.021834 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-03338b1a-aeb3-4ec5-8f2d-60038b69d309 req-4d587bf7-368a-4c0a-a5c3-e886597cb8d0 service nova] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Detach interface failed, port_id=04a9c562-b8ba-4a09-b2d1-c8b00f7d3fb0, reason: Instance e2cd5341-13e7-472d-90ce-b0887dc00f59 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:30.023065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:12:30.024826 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fef9:adbc', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe06:8cf2', 'fe80::80f0:94ff:feae:c312'] 
Jun 27 04:12:30.024826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:12:30.024826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:12:30.024826 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:30.102750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:30.102750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:30.117712 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:30.185258 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e93b81c7-f7ba-4858-bfff-4573ea354954 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "1be2d4c5-613b-40a0-97f5-e9776d36a813" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.821s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:30.287002 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:30.605149 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Detaching volume 7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8
Jun 27 04:12:30.619691 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Took 1.56 seconds to deallocate network for instance.
Jun 27 04:12:30.699016 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Attempting to driver detach volume 7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 from mountpoint /dev/vdb
Jun 27 04:12:30.706052 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Found disk vdb by alias ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:12:30.707591 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Found disk vdb by alias ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:12:30.707808 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Attempting to detach device vdb from instance fa5fe299-857b-41f5-8069-c3324c227036 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:   <alias name="ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8"/>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:   <serial>7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8</serial>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:12:30.708158 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:12:30.722590 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully detached device vdb from instance fa5fe299-857b-41f5-8069-c3324c227036 from the persistent domain config.
Jun 27 04:12:30.722782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] (1/8): Attempting to detach device vdb with device alias ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 from instance fa5fe299-857b-41f5-8069-c3324c227036 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:   <alias name="ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8"/>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:   <serial>7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8</serial>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:12:30.723220 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:12:30.794532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.754s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:30.798596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.462s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:30.799261 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:30.799261 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:12:30.897237 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:30.897588 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:30.897862 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Attaching volume 9f2b1cd9-65b3-43d8-8856-3b134d71049e to /dev/vdb
Jun 27 04:12:30.940270 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Deleted allocations for instance 371a4e1b-1860-46a0-85e5-3f505c4797b3
Jun 27 04:12:30.983955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:30.984165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:30.984392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:30.984594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:30.984877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:30.987219 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Terminating instance
Jun 27 04:12:30.991968 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:31.002997 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:12:31.024821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:31.069760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:12:31.070128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:12:31.077591 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:12:31.078909 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe29:7f60', 'fe80::20e0:c1ff:fe21:8fba', 'fe80::fc16:3eff:fe91:f128', 'fe80::a4e0:9dff:fec6:c43a', 'fe80::fc16:3eff:feb9:c999', 'fe80::fc16:3eff:fed0:ca33', 'fe80::fc16:3eff:fef9:adbc', 'fe80::fc16:3eff:fefd:3ac2', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe06:8cf2', 'fe80::80f0:94ff:feae:c312'] 
Jun 27 04:12:31.079034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:12:31.079119 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:12:31.079324 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:31.079578 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating existing volume attachment record: ac86cc7b-945b-4f30-9eac-bd6992c17e39 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:12:31.128544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:31.128808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:31.145852 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Starting finish_revert_migration {{(pid=98984) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12955}}
Jun 27 04:12:31.165829 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start _get_guest_xml network_info=[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '63cfd013-8dee-47d2-b81f-3b52bc9e68f9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'a41c0a78-a4b0-4a62-b391-e0eef4bd2329', 'attached_at': '2026-06-27T04:12:30.000000', 'detached_at': '', 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'serial': 'd3addc83-672b-4534-833a-767e39b9a06e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:12:31.169744 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:12:31.171407 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-118420821', uuid='a41c0a78-a4b0-4a62-b391-e0eef4bd2329'), owner=OwnerMeta(userid='e6787c0723ee4e7097d500e19c4cba02', username='tempest-ServerActionsTestOtherB-2075548864-project-member', projectid='7e1b9b8f3bfc490dbd68a422dabbe3c6', projectname='tempest-ServerActionsTestOtherB-2075548864'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533551.1709547) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:12:31.172950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:12:31.173394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:12:31.177348 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:12:31.177649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:12:31.178835 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:12:31.179272 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:12:31.179431 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:12:31.179589 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:12:31.179781 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:12:31.179918 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:12:31.180069 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:12:31.180336 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:12:31.180583 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:12:31.180715 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:12:31.180842 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:12:31.181028 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:12:31.181203 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'vcpu_model' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:31.351433 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533551.3509455, fa5fe299-857b-41f5-8069-c3324c227036 => ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:12:31.352797 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 for instance fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:12:31.355630 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully detached device vdb from instance fa5fe299-857b-41f5-8069-c3324c227036 from the live domain config.
Jun 27 04:12:31.356709 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:12:31.357118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:31.357272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:31.357734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:31.358360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:12:31.358573 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8 (non-flash)
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:12:31.384215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '72')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:31.384818 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8', '71')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:31.385572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518193c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'): ({'sdd'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:12:31.385828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:12:31.386087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Flush multipath device 330000000d9975722 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:12:31.424762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:31.477260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:31.490822 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:31.523650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:31.524100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:31.531126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:12:31.531126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:12:31.533961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:12:31.547452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:12:31.547452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:12:31.548903 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:31.561627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.592676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.40.100,3260]
Jun 27 04:12:31.592676 np0000003830 nova-compute[98984]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:31.592676 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.609392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.620989 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.657073 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.50.100,3260]
Jun 27 04:12:31.657073 np0000003830 nova-compute[98984]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-7d5d8b8d-e0f3-49e8-8d59-d94c0d29beb8, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:31.657073 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.659299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:12:31.659659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:31.659871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:31.670908 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.671167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:31.671312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] <== disconnect_volume: return (313ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:31.671456 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:12:31.673716 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.014s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:31.674167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:12:31.697197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:31.698842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:31.701272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:31.701272 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:12:31.701559 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:31.701817 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:12:31.702638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:31.719163 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:31.736803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:12:31.736803 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.740490 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:12:31.740490 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e] added
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:31.753092 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.755369 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:31.755939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:12:31.756483 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:31.759824 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0544(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:12:31.760140 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e] added
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:31.763249 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:31.763561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:12:31.763867 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0627(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:12:31.764106 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:12:31.810313 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:31.810879 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:31.811140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:31.811718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:31.812159 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:12:31.812695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:31.812894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:31.830969 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99965477700016 future=<Future at 0x7ec538305760 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:31.832518 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Instance destroyed successfully.
Jun 27 04:12:31.834981 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'resources' on Instance uuid c702a025-f366-4383-9aa7-4fe61cfb64b8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:31.887532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:31.954963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-df81e932-390e-422f-802b-3f57053c0798 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "371a4e1b-1860-46a0-85e5-3f505c4797b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.975s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:31.986631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:31.990515 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.092328 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.097053 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:12:32.102520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.121355 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-unplugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:32.122821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:32.123294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:32.123539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:32.123796 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] No waiting events found dispatching network-vif-unplugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:32.123961 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-unplugged-92555b08-0c16-4c81-b96f-0e1888a7a365 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:32.124061 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-unplugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:32.124188 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] Acquiring lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:32.124359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:32.124452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:32.124585 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] No waiting events found dispatching network-vif-unplugged-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:32.124712 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68240e82-3cd5-4840-b18c-8f4cdadb9bd6 req-80aa6125-7361-4893-a10a-54bfa7772236 service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-unplugged-92555b08-0c16-4c81-b96f-0e1888a7a365 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:32.212481 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.215712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.241341 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'flavor' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:32.264245 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:32.326925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.331800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.350840 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='multiattach-server-0',id=18,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoZdkEaMpQIWJpCkJzZmTHwtWv65J9nCnrqJPhtxEpcsaASbi849ROIwAbZRk3dJqjELXZXOrmIXEUFrf6Sj3iVIvebMjAHwrP6T8rkQTJaiDVWFqUsYYLGV7zZZFOsAA==',key_name='tempest-keypair-1688470539',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:57Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-584bxo0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7132d5dcadb043838976141746b8a26a',uuid=c702a025-f366-4383-9aa7-4fe61cfb64b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:32.351111 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "92555b08-0c16-4c81-b96f-0e1888a7a365", "address": "fa:16:3e:91:f1:28", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap92555b08-0c", "ovs_interfaceid": "92555b08-0c16-4c81-b96f-0e1888a7a365", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:32.352208 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:32.352570 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:32.357738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:32.358012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92555b08-0c, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:32.359940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:32.361397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:32.362187 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:32.362344 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6170106e-65b3-4873-acc7-51d8fd24a0e6) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:32.363309 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:32.363905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:32.364242 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:32.366088 np0000003830 nova-compute[98984]: INFO os_vif [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f1:28,bridge_name='br-int',has_traffic_filtering=True,id=92555b08-0c16-4c81-b96f-0e1888a7a365,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92555b08-0c')
Jun 27 04:12:32.366528 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Deleting instance files /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8_del
Jun 27 04:12:32.367396 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Deletion of /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8_del complete
Jun 27 04:12:32.439304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.442566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.554874 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.559057 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000012, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c702a025-f366-4383-9aa7-4fe61cfb64b8/disk
Jun 27 04:12:32.561296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.649584 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.653579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.739398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.743517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.762197 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:12:32.764789 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:12:32.773396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.644s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:12:32.778310 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:12:32.785922 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.795979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.802027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.810575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.810575 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.810575 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:32.811076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.811076 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.811076 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:32.818470 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.818470 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.818470 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:32.818764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.818764 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.818764 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:32.844131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.847626 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.864133 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Deleted allocations for instance e2cd5341-13e7-472d-90ce-b0887dc00f59
Jun 27 04:12:32.871360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260]
Jun 27 04:12:32.871360 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:32.871360 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.872145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260]
Jun 27 04:12:32.872145 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:32.872145 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.882323 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:32.883797 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:32.884110 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:32.884272 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:32.884920 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:32.888658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.892893 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:32.905529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.905529 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.905529 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.905529 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.905529 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:32.905866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.905866 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.905866 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.905866 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.905866 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:32.906265 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:32.906439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:12:32.907386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] HCTL ('8', '-', '-', 0) found on session 83 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:12:32.907585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:12:32.913105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.913105 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.913105 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.913105 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.913105 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:32.913371 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.913371 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:32.913371 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.913371 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:32.913371 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:32.913573 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:32.913811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:12:32.914460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] HCTL ('7', '-', '-', 0) found on session 82 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:12:32.914598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:12:32.929272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 83 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:32.929489 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:12:32.935946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 82 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:32.940605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk.rescue --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:32.944906 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:32.979126 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:33.039467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:33.048719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:33.166607 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:33.173524 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:12:33.173524 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:33.225820 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:33.229039 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=49870MB free_disk=73.3213882446289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:12:33.229039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:33.229039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:33.268685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0db53232-79f8-43f3-9474-2e3f07de3a95 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.166s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:33.319182 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c30b8fd-5800-4964-b85f-24cb19383068 req-7c0ba69d-3574-4a40-b0aa-b90e43fdd88e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Received event network-vif-deleted-92555b08-0c16-4c81-b96f-0e1888a7a365 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:33.319409 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-2c30b8fd-5800-4964-b85f-24cb19383068 req-7c0ba69d-3574-4a40-b0aa-b90e43fdd88e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Neutron deleted interface 92555b08-0c16-4c81-b96f-0e1888a7a365; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:33.321054 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c30b8fd-5800-4964-b85f-24cb19383068 req-7c0ba69d-3574-4a40-b0aa-b90e43fdd88e service nova] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Detach interface failed, port_id=92555b08-0c16-4c81-b96f-0e1888a7a365, reason: Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:33.471415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:33.471606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:33.471826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:33.471948 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:33.472039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:33.474463 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Terminating instance
Jun 27 04:12:33.774053 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:33.879619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-144882f0-0114-4768-a7f9-6dc3e4a55405 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Lock "e2cd5341-13e7-472d-90ce-b0887dc00f59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.727s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:33.935490 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 82 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:33.935684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:12:33.979371 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:34.000858 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.004167 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.028156 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.190542 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9e834440-a228-4f7b-89ac-d01a20315c80 req-2e6d25cd-3500-4be0-8ccd-fcaec60db8bf service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:34.191161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9e834440-a228-4f7b-89ac-d01a20315c80 req-2e6d25cd-3500-4be0-8ccd-fcaec60db8bf service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:34.191422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9e834440-a228-4f7b-89ac-d01a20315c80 req-2e6d25cd-3500-4be0-8ccd-fcaec60db8bf service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:34.191554 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9e834440-a228-4f7b-89ac-d01a20315c80 req-2e6d25cd-3500-4be0-8ccd-fcaec60db8bf service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:34.191694 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9e834440-a228-4f7b-89ac-d01a20315c80 req-2e6d25cd-3500-4be0-8ccd-fcaec60db8bf service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:34.191864 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9e834440-a228-4f7b-89ac-d01a20315c80 req-2e6d25cd-3500-4be0-8ccd-fcaec60db8bf service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:34.192540 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.199919 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.276375 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Took 1.39 seconds to deallocate network for instance.
Jun 27 04:12:34.299171 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.299260 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c702a025-f366-4383-9aa7-4fe61cfb64b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.299430 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.300137 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f5611e50-86aa-420c-9f94-e13d8f80f4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.300137 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 075f803b-49f2-4084-9d8a-10d59d1c62eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.300137 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance fa5fe299-857b-41f5-8069-c3324c227036 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.300137 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a41c0a78-a4b0-4a62-b391-e0eef4bd2329 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.300416 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:12:34.300416 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 8 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:12:34.300612 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=2048MB phys_disk=95GB used_disk=7GB total_vcpus=16 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:12:33 up 35 min,  2 users,  load average: 8.16, 9.04, 5.38\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '8', 'num_proj_5a05730e4d204004b6dbe4c1389b8397': '2', 'io_workload': '0', 'num_task_deleting': '2', 'num_proj_7adc2502eb6e45c19f6b8646b60669f5': '3', 'num_vm_rescued': '1', 'num_proj_72fed82034484f13a228c535b175c167': '1', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_7e1b9b8f3bfc490dbd68a422dabbe3c6': '1', 'num_proj_ef6a6b08a14849038c79ff273d34be3f': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:12:34.315338 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.327175 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.362952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.365529 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.997809721000067 future=<Future at 0x7ec5383c8050 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:34.366434 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Instance destroyed successfully.
Jun 27 04:12:34.370617 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'resources' on Instance uuid fa5fe299-857b-41f5-8069-c3324c227036 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:34.719006 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found WWN 3300000007fb87ae2 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:12:34.719336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:34.719634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== connect_volume: return (3059ms) {'type': 'block', 'scsi_wwn': '3300000007fb87ae2', 'path': '/dev/dm-0', 'multipath_id': '3300000007fb87ae2'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:34.720763 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007fb87ae2', 'path': '/dev/dm-0', 'multipath_id': '3300000007fb87ae2'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:12:34.720763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.907s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:34.720763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:12:34.722772 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:34.732674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:34.733991 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:34.734427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:34.734637 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:12:34.735188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:34.735462 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:12:34.747469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:12:34.747469 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:34.752659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:12:34.752659 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e] added
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:34.759846 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:34.760071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:12:34.760264 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:12:34.760470 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:12:34.763365 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:34.763698 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e] added
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:12:34.765970 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:34.766153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:12:34.766248 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:12:34.766359 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:12:34.785633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:34.874646 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-38590157',display_name='tempest-ServerRescueNegativeTestJSON-server-38590157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-38590157',id=32,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhVGe0pGmGKgFXE9CC8E3bKafwbkIsigNdihQC7wDDX3aLiQbljECwrPYQGqO7sU2O0wvzDMD7EFZKp4MagbWU0WMEfHR7Mvjb3FFZ4Boc3BZvnEVJPjqpdW6k8/tjeUw==',key_name='tempest-keypair-1499974602',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:11:44Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-oo0mrwne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:11:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b427e506578a4121bf0d008321dacac9',uuid=fa5fe299-857b-41f5-8069-c3324c227036,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:34.874924 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "address": "fa:16:3e:f9:ad:bc", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeeb79be-2a", "ovs_interfaceid": "deeb79be-2aa4-4e3c-aa75-7ea49bf99feb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:34.875548 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:34.875848 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:34.878399 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.878627 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeeb79be-2a, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:34.879577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.880356 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:34.880947 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.882723 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.882928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ad6b4d9-7087-4a80-a194-abacec2d77e3) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:34.883422 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.883923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:34.887214 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:34.889049 np0000003830 nova-compute[98984]: INFO os_vif [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ad:bc,bridge_name='br-int',has_traffic_filtering=True,id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdeeb79be-2a')
Jun 27 04:12:34.889408 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Deleting instance files /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036_del
Jun 27 04:12:34.890197 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Deletion of /opt/stack/data/nova/instances/fa5fe299-857b-41f5-8069-c3324c227036_del complete
Jun 27 04:12:35.226983 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Attempting to attach volume 9f2b1cd9-65b3-43d8-8856-3b134d71049e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]:   <alias name="ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e"/>
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]:   <serial>9f2b1cd9-65b3-43d8-8856-3b134d71049e</serial>
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:12:35.228458 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:12:35.266439 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:35.397526 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Took 1.42 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:35.398238 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:35.398577 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:35.398698 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:35.398988 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:35.464246 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:35.761396 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:12:35.767126 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:12:35.773248 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:12:35.773617 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.547s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:35.773899 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.988s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:35.774017 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:12:35.783593 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:12:35.787244 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.798668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.807957 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.816640 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:35.825516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.825516 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.825516 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.825516 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.825516 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:35.825991 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.825991 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.825991 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.825991 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.825991 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:35.865528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260]
Jun 27 04:12:35.865528 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:35.865528 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.880819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260]
Jun 27 04:12:35.880819 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:35.880819 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.884020 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.897015 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.912333 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.912676 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:35.912895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:35.912895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:12:35.913726 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] HCTL ('9', '-', '-', 0) found on session 84 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:12:35.913940 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.922091 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:35.922449 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:35.922847 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:35.923068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:12:35.924256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] HCTL ('10', '-', '-', 0) found on session 85 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:12:35.924439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:12:35.933140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 84 and hctl ['9', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:35.944429 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 85 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:36.268684 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:36.269579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] Acquiring lock "fa5fe299-857b-41f5-8069-c3324c227036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:36.269898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:36.270125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] Lock "fa5fe299-857b-41f5-8069-c3324c227036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:36.270375 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] No waiting events found dispatching network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:36.270724 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-unplugged-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:36.271114 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Received event network-vif-deleted-deeb79be-2aa4-4e3c-aa75-7ea49bf99feb {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:36.271272 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Neutron deleted interface deeb79be-2aa4-4e3c-aa75-7ea49bf99feb; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:36.273148 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4cee82de-7646-4a53-b8c7-339facec9192 req-a43f8438-b71c-45ed-bc85-c9d98da8456c service nova] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Detach interface failed, port_id=deeb79be-2aa4-4e3c-aa75-7ea49bf99feb, reason: Instance fa5fe299-857b-41f5-8069-c3324c227036 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:36.274075 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:36.274392 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:36.584666 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:36.773703 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:36.774089 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:36.774189 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:36.774372 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:12:36.774537 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:12:36.775333 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.06 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:12:36.777126 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:36.898858 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:36.899424 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:36.899424 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:12:36.899424 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No VIF found with MAC fa:16:3e:06:8c:f2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:12:36.934659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 84 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:36.934872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:12:36.945067 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Searching for a device in session 85 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:12:36.945262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:12:36.982840 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004078940000908915 future=<Future at 0x7ec538305e50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:36.984379 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Emitting event <LifecycleEvent: 1782533541.982273, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:36.984663 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:36.985209 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Stopped (Lifecycle Event)
Jun 27 04:12:36.986058 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.710041793000073 future=<Future at 0x7ec53840a450 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:36.986600 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.709737405999931 future=<Future at 0x7ec53840a450 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:37.086759 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Took 1.69 seconds to deallocate network for instance.
Jun 27 04:12:37.298076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.524s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:37.352978 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocations for instance c702a025-f366-4383-9aa7-4fe61cfb64b8
Jun 27 04:12:37.487626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:37.593488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:37.593670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:37.734396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:12:37.985482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:37.985969 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:38.368706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01072c0b-51aa-4b0a-a17a-b87393386b16 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "c702a025-f366-4383-9aa7-4fe61cfb64b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.384s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:38.475487 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-609473db-10b7-43e6-a983-58c102796458 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.578s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:38.488354 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:38.749110 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Found WWN 33000000014503705 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:12:38.749352 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:38.749605 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== connect_volume: return (6936ms) {'type': 'block', 'scsi_wwn': '33000000014503705', 'path': '/dev/dm-1', 'multipath_id': '33000000014503705'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:38.749800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000014503705', 'path': '/dev/dm-1', 'multipath_id': '33000000014503705'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:12:38.995641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.402s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:39.063765 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Deleted allocations for instance fa5fe299-857b-41f5-8069-c3324c227036
Jun 27 04:12:39.254660 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:12:39.254959 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:39.255545 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <uuid>a41c0a78-a4b0-4a62-b391-e0eef4bd2329</uuid>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <name>instance-00000021</name>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServerActionsTestOtherB-server-118420821</nova:name>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:12:31</nova:creationTime>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:user uuid="e6787c0723ee4e7097d500e19c4cba02">tempest-ServerActionsTestOtherB-2075548864-project-member</nova:user>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:project uuid="7e1b9b8f3bfc490dbd68a422dabbe3c6">tempest-ServerActionsTestOtherB-2075548864</nova:project>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         <nova:port uuid="5a31a876-771a-4133-85ce-0ca67fa2d4af">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <entry name="serial">a41c0a78-a4b0-4a62-b391-e0eef4bd2329</entry>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <entry name="uuid">a41c0a78-a4b0-4a62-b391-e0eef4bd2329</entry>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/disk.config"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <alias name="ua-d3addc83-672b-4534-833a-767e39b9a06e"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <serial>d3addc83-672b-4534-833a-767e39b9a06e</serial>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:bc:36:85"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <target dev="tap5a31a876-77"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329/console.log" append="off"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:12:39.257393 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Preparing to wait for external event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:15Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:39.261063 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:12:39.261700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.261700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '010a60ca-ce21-5cf9-a9c1-331a2f9453cc', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:39.262302 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.262971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:39.271705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.274381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.275020 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a31a876-77, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:39.275096 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a31a876-77, col_values=(('qos', UUID('ff960167-2868-49e2-8e9e-62716b21419a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:39.275216 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a31a876-77, col_values=(('external_ids', {'iface-id': '5a31a876-771a-4133-85ce-0ca67fa2d4af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:36:85', 'vm-uuid': 'a41c0a78-a4b0-4a62-b391-e0eef4bd2329'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:39.279545 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.280398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:39.287048 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.288090 np0000003830 nova-compute[98984]: INFO os_vif [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77')
Jun 27 04:12:39.363923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.836902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.866102 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.869589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:39.959358 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:40.084561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-43bb9120-f58f-45aa-8e91-04fffb6bfed4 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "fa5fe299-857b-41f5-8069-c3324c227036" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.605s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:40.089421 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d5ed654d-3690-4e13-b075-8424f81328a3 req-e3d49dfc-46ca-4bef-8fae-7455a27baefd service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:40.098908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d5ed654d-3690-4e13-b075-8424f81328a3 req-e3d49dfc-46ca-4bef-8fae-7455a27baefd service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:40.098908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d5ed654d-3690-4e13-b075-8424f81328a3 req-e3d49dfc-46ca-4bef-8fae-7455a27baefd service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:40.098908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d5ed654d-3690-4e13-b075-8424f81328a3 req-e3d49dfc-46ca-4bef-8fae-7455a27baefd service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:40.098908 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d5ed654d-3690-4e13-b075-8424f81328a3 req-e3d49dfc-46ca-4bef-8fae-7455a27baefd service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Processing event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:12:40.224152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:40.233439 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:40.250535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:40.254236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:40.254236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:40.254236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:40.254236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:40.254727 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:40.256280 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Terminating instance
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Terminating instance
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003577709999262879 future=<Future at 0x7ec53840a450 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Emitting event <LifecycleEvent: 1782533545.6959846, 1be2d4c5-613b-40a0-97f5-e9776d36a813 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] VM Stopped (Lifecycle Event)
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0021533330000238493 future=<Future at 0x7ec5181fc560 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0024315599998772086 future=<Future at 0x7ec5181fc560 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.323601748999863 future=<Future at 0x7ec518772180 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.3235005500000625 future=<Future at 0x7ec518772180 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Emitting event <LifecycleEvent: 1782533545.6963744, 371a4e1b-1860-46a0-85e5-3f505c4797b3 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] VM Stopped (Lifecycle Event)
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533560.9666429, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Started (Lifecycle Event)
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance running successfully.
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] finish_revert_migration finished successfully. {{(pid=98984) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13001}}
Jun 27 04:12:41.119137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:41.125611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.127097 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.147985 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40202b84-6cdc-4f01-83b9-0beb52b7abd0 req-faf5a333-729f-4128-bc46-7651ea4dbdd4 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-unplugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:41.147985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40202b84-6cdc-4f01-83b9-0beb52b7abd0 req-faf5a333-729f-4128-bc46-7651ea4dbdd4 service nova] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:41.148428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40202b84-6cdc-4f01-83b9-0beb52b7abd0 req-faf5a333-729f-4128-bc46-7651ea4dbdd4 service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:41.148428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40202b84-6cdc-4f01-83b9-0beb52b7abd0 req-faf5a333-729f-4128-bc46-7651ea4dbdd4 service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:41.148428 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40202b84-6cdc-4f01-83b9-0beb52b7abd0 req-faf5a333-729f-4128-bc46-7651ea4dbdd4 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] No waiting events found dispatching network-vif-unplugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:41.148845 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40202b84-6cdc-4f01-83b9-0beb52b7abd0 req-faf5a333-729f-4128-bc46-7651ea4dbdd4 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-unplugged-391135c1-35b6-4234-b241-4376de6f6fe6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:41.154719 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Instance destroyed successfully.
Jun 27 04:12:41.155416 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lazy-loading 'resources' on Instance uuid a243ff55-7b82-43af-a0b8-158eb4b8d030 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:41.156408 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.191526 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.200824 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: 1be2d4c5-613b-40a0-97f5-e9776d36a813] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:41.204212 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3a70245e-9990-42dd-91f6-565ff1a3bec4 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 371a4e1b-1860-46a0-85e5-3f505c4797b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:41.422489 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Instance destroyed successfully.
Jun 27 04:12:41.423559 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'resources' on Instance uuid 075f803b-49f2-4084-9d8a-10d59d1c62eb {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:41.471441 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:41.474346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:41.659414 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1972415158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumemultiattachtest-server-1972415158',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:06:37Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a05730e4d204004b6dbe4c1389b8397',ramdisk_id='',reservation_id='r-hlpugoq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-870912138',owner_user_name='tempest-AttachVolumeMultiAttachTest-870912138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:06:37Z,user_data=None,user_id='7132d5dcadb043838976141746b8a26a',uuid=a243ff55-7b82-43af-a0b8-158eb4b8d030,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:41.659642 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converting VIF {"id": "391135c1-35b6-4234-b241-4376de6f6fe6", "address": "fa:16:3e:29:7f:60", "network": {"id": "aab3725a-2e45-46da-9008-264ae397b127", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-972567941-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a05730e4d204004b6dbe4c1389b8397", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap391135c1-35", "ovs_interfaceid": "391135c1-35b6-4234-b241-4376de6f6fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:41.660278 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:41.660571 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:41.661463 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.661656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391135c1-35, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:41.662936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.663952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:41.672562 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.673804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.674033 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a7e2916-d11a-477c-87b4-29381b540899) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:41.674680 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.675447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:41.680708 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.683364 np0000003830 nova-compute[98984]: INFO os_vif [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7f:60,bridge_name='br-int',has_traffic_filtering=True,id=391135c1-35b6-4234-b241-4376de6f6fe6,network=Network(aab3725a-2e45-46da-9008-264ae397b127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391135c1-35')
Jun 27 04:12:41.747427 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:12:41.747427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:41.747427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:41.747427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:41.747954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '699fda4a-1d32-4e5c-88bb-8d412310cf13', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:12:41.747954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d19c7f16-e8e6-419a-84b7-818c17838389 (non-flash)
Jun 27 04:12:41.776725 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsi session list stdout=tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13 (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d19c7f16-e8e6-419a-84b7-818c17838389 (non-flash)
Jun 27 04:12:41.777024 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:41.777170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d19c7f16-e8e6-419a-84b7-818c17838389', '86')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:12:41.777272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '30')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:41.778880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13', '29')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:41.780565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538153920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'): ({'sdn'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:12:41.780877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Removing multipathed devices sdo, sdn {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:12:41.781157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Flush multipath device 330000000ff7f258d {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:12:41.834590 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:41.884097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:41.926816 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1106153631',display_name='tempest-AttachVolumeTestJSON-server-1106153631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-1106153631',id=30,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7iPUXMfenwdyr/6AC9yp4XTP5YgyX6cw3Hu1PueSAVUhD52zyEUwiuIIbMUg6rnZtfIHP2sdL5HNfteoNhXhVlxTCR9IDbuDto5MAbgF12upHJFKvU325vIievEfFh2A==',key_name='tempest-keypair-1891597890',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:09:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-3r3qhh7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=075f803b-49f2-4084-9d8a-10d59d1c62eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:41.927058 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "address": "fa:16:3e:fd:3a:c2", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef0b1e2-12", "ovs_interfaceid": "eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:41.928983 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:41.928983 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:41.930663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.930663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeef0b1e2-12, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:41.930853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.931580 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:41.932308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.932920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.932975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62db05e4-9f60-4757-a1c5-ecf74f952fbb) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:41.938952 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:12:41.939130 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:12:41.939975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.940778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:41.941423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:41.943069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:12:41.944370 np0000003830 nova-compute[98984]: INFO os_vif [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:3a:c2,bridge_name='br-int',has_traffic_filtering=True,id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef0b1e2-12')
Jun 27 04:12:41.946991 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Deleting instance files /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb_del
Jun 27 04:12:41.946991 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Deletion of /opt/stack/data/nova/instances/075f803b-49f2-4084-9d8a-10d59d1c62eb_del complete
Jun 27 04:12:41.959239 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:12:41.959440 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:12:41.977643 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 27 04:12:41.980966 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533561.9789956, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:41.981874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:41.982370 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Paused (Lifecycle Event)
Jun 27 04:12:42.024836 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.40.100,3260]
Jun 27 04:12:42.024836 np0000003830 nova-compute[98984]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:42.024836 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:42.046413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:42.061340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:42.083967 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3ff11fb9-f71c-4712-80d1-c7c9105c73f9 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance to original state: 'active'
Jun 27 04:12:42.105004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.50.100,3260]
Jun 27 04:12:42.105004 np0000003830 nova-compute[98984]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-699fda4a-1d32-4e5c-88bb-8d412310cf13, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:42.105004 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:42.129990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:42.131000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:42.132474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] <== disconnect_volume: return (384ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:42.133527 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:12:42.133998 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Deleting instance files /opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030_del
Jun 27 04:12:42.134376 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Deletion of /opt/stack/data/nova/instances/a243ff55-7b82-43af-a0b8-158eb4b8d030_del complete
Jun 27 04:12:42.174155 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fbd87e6f-909b-4e20-a12d-aeae8555beab req-cbdb0588-f735-4ab8-ae7b-85026ad51f85 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:42.179519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fbd87e6f-909b-4e20-a12d-aeae8555beab req-cbdb0588-f735-4ab8-ae7b-85026ad51f85 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:42.179519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fbd87e6f-909b-4e20-a12d-aeae8555beab req-cbdb0588-f735-4ab8-ae7b-85026ad51f85 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:42.179519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fbd87e6f-909b-4e20-a12d-aeae8555beab req-cbdb0588-f735-4ab8-ae7b-85026ad51f85 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:42.179519 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fbd87e6f-909b-4e20-a12d-aeae8555beab req-cbdb0588-f735-4ab8-ae7b-85026ad51f85 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:42.179519 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-fbd87e6f-909b-4e20-a12d-aeae8555beab req-cbdb0588-f735-4ab8-ae7b-85026ad51f85 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state active and task_state None.
Jun 27 04:12:42.452923 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:42.453440 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:42.453821 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:42.453913 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:42.454156 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:42.485050 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:42.487802 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533562.4874852, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:42.487985 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Resumed (Lifecycle Event)
Jun 27 04:12:42.656932 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:42.658361 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Took 1.90 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:42.659259 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:42.659409 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:42.659657 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:42.659917 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:42.757123 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:42.990884 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:42.999525 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:12:43.023172 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004868380001425976 future=<Future at 0x7ec518772180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:43.023276 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:43.023474 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.807060425000145 future=<Future at 0x7ec538305760 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:43.023737 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.806906438000169 future=<Future at 0x7ec538305760 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:43.024661 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Emitting event <LifecycleEvent: 1782533548.0225549, e2cd5341-13e7-472d-90ce-b0887dc00f59 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:43.027521 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] VM Stopped (Lifecycle Event)
Jun 27 04:12:43.159418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-865d7eaa-1a5c-4674-851f-770dc5b0f69e req-d639ee65-c5b3-49bc-b9fe-21a469baf812 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-deleted-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:43.159418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-865d7eaa-1a5c-4674-851f-770dc5b0f69e req-d639ee65-c5b3-49bc-b9fe-21a469baf812 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Neutron deleted interface 391135c1-35b6-4234-b241-4376de6f6fe6; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:43.162023 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-865d7eaa-1a5c-4674-851f-770dc5b0f69e req-d639ee65-c5b3-49bc-b9fe-21a469baf812 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Detach interface failed, port_id=391135c1-35b6-4234-b241-4376de6f6fe6, reason: Instance a243ff55-7b82-43af-a0b8-158eb4b8d030 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:43.270593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-unplugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:43.270778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Acquiring lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:43.271371 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:43.271582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:43.271728 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] No waiting events found dispatching network-vif-unplugged-391135c1-35b6-4234-b241-4376de6f6fe6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:43.272484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Received event network-vif-unplugged-391135c1-35b6-4234-b241-4376de6f6fe6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:43.272484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:43.272484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:43.272484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:43.272484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:43.272484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:43.273022 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:43.273133 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:43.273701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Acquiring lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:43.275674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] No waiting events found dispatching network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-unplugged-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing instance network info cache due to event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:43.278665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:43.284195 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:12:43.507961 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999669464999897 future=<Future at 0x7ec5187b98b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:43.508183 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999858166000195 future=<Future at 0x7ec518344f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:43.531886 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e2cd5341-13e7-472d-90ce-b0887dc00f59] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:43.582438 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:43.781931 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:43.889054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:43.889428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:43.889595 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:43.889656 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:43.889980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:43.892597 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Terminating instance
Jun 27 04:12:44.085304 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Took 1.43 seconds to deallocate network for instance.
Jun 27 04:12:44.216149 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.244037 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:44.248934 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-73ce6ec4-9c5b-464e-8d50-c60d29aa6a76 req-4eea1453-7635-46bf-a381-7aa1b011ddf3 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Received event network-vif-deleted-eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:44.248934 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-73ce6ec4-9c5b-464e-8d50-c60d29aa6a76 req-4eea1453-7635-46bf-a381-7aa1b011ddf3 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Neutron deleted interface eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:44.252388 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-73ce6ec4-9c5b-464e-8d50-c60d29aa6a76 req-4eea1453-7635-46bf-a381-7aa1b011ddf3 service nova] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Detach interface failed, port_id=eef0b1e2-12ef-4a7e-8fe6-67e6fe6c72e1, reason: Instance 075f803b-49f2-4084-9d8a-10d59d1c62eb could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:44.365844 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.399130 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:44.412070 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updated VIF entry in instance network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:12:44.412070 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:44.423120 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.426944 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.454532 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.510617 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:44.654019 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.664558 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.690776 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Took 0.60 seconds to detach 1 volumes for instance.
Jun 27 04:12:44.732948 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.768588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.778121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.807080 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.809791 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999171237000155 future=<Future at 0x7ec518353620 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:44.821672 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Instance destroyed successfully.
Jun 27 04:12:44.822618 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'resources' on Instance uuid f5611e50-86aa-420c-9f94-e13d8f80f4b0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:44.915246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0ab22b08-24a0-4799-a1b7-3018e58ede72 req-54edd75c-41a9-431d-bca6-957acd38afa2 service nova] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:44.941576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:44.941976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:44.942331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:44.942587 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:44.942867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:44.944996 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Terminating instance
Jun 27 04:12:44.950272 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:44.959987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.013608 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Took 2.56 seconds to deallocate network for instance.
Jun 27 04:12:45.160296 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.174461 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.205818 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:45.205818 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:45.325792 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332807486',display_name='tempest-ServerRescueNegativeTestJSON-server-1332807486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1332807486',id=29,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:01Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-i83bwfym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:02Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=f5611e50-86aa-420c-9f94-e13d8f80f4b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:45.326377 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "address": "fa:16:3e:b9:c9:99", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13a3de0-7d", "ovs_interfaceid": "d13a3de0-7db1-43f6-a996-1eb633e8717f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:45.327555 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:45.327555 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:45.337689 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.337689 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd13a3de0-7d, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:45.338738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.339661 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:45.340117 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.341383 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.341789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b529a509-95a1-49b3-9952-fb2acc2a77ff) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:45.343137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.343595 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:45.345001 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.349024 np0000003830 nova-compute[98984]: INFO os_vif [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:c9:99,bridge_name='br-int',has_traffic_filtering=True,id=d13a3de0-7db1-43f6-a996-1eb633e8717f,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13a3de0-7d')
Jun 27 04:12:45.349204 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Deleting instance files /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0_del
Jun 27 04:12:45.351284 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Deletion of /opt/stack/data/nova/instances/f5611e50-86aa-420c-9f94-e13d8f80f4b0_del complete
Jun 27 04:12:45.449732 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:45.476913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.482385 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.499857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.520628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:45.523291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.602719 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:45.602894 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:45.755623 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.806469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.824469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.824469 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999678052000036 future=<Future at 0x7ec5183cacc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:45.828253 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Instance destroyed successfully.
Jun 27 04:12:45.831378 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lazy-loading 'resources' on Instance uuid a41c0a78-a4b0-4a62-b391-e0eef4bd2329 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:45.831378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:45.868304 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Took 1.47 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:45.870188 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:45.872135 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:45.872264 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:45.872888 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:45.961535 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:45.996808 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:45.997019 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing instance network info cache due to event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:12:45.997199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:45.997296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:45.997416 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:12:46.105803 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:46.167441 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.174783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.177760 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.207920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.215387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.333452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:10:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-118420821',display_name='tempest-ServerActionsTestOtherB-server-118420821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serveractionstestotherb-server-118420821',id=33,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVkAx5B411BwZ6zoOijY7IXrPa/Ul12W9KXVuMsDofYusEhC5ILTy7EMl+yDGaUaaxhvoyaFS65jbL2mKMXPcp7eYXSrBSZ/REenVSsithG2j6EWuT+5n6RMcz9CElUA==',key_name='tempest-keypair-1693005646',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:41Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e1b9b8f3bfc490dbd68a422dabbe3c6',ramdisk_id='',reservation_id='r-uf0v0qlc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2075548864',owner_user_name='tempest-ServerActionsTestOtherB-2075548864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6787c0723ee4e7097d500e19c4cba02',uuid=a41c0a78-a4b0-4a62-b391-e0eef4bd2329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:46.333452 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converting VIF {"id": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "address": "fa:16:3e:bc:36:85", "network": {"id": "9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1413962802-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7e1b9b8f3bfc490dbd68a422dabbe3c6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a31a876-77", "ovs_interfaceid": "5a31a876-771a-4133-85ce-0ca67fa2d4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:46.334522 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:46.334522 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:46.336695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.336695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a31a876-77, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:46.337515 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.339420 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:46.341687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.341958 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.342220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.342400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.342593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.342781 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:46.342946 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.343141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.343326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.343578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.343688 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.343934 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:46.344869 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.345336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.345709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.345906 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.346033 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.346189 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state rescued and task_state deleting.
Jun 27 04:12:46.346301 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.346668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.347833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received unexpected event network-vif-plugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with vm_state rescued and task_state deleting.
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] No waiting events found dispatching network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-unplugged-d13a3de0-7db1-43f6-a996-1eb633e8717f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.353705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.354998 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:46.354998 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f179c97b-0278-4d81-9e56-f44501545f9d req-5a8e4354-fb7a-4f6a-9d42-ece696feff56 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state active and task_state deleting.
Jun 27 04:12:46.356009 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.356249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff960167-2868-49e2-8e9e-62716b21419a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:46.357017 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.357432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:46.368567 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:46.371279 np0000003830 nova-compute[98984]: INFO os_vif [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:85,bridge_name='br-int',has_traffic_filtering=True,id=5a31a876-771a-4133-85ce-0ca67fa2d4af,network=Network(9678d9e6-8ca3-4a17-9936-1d42ec5d0a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a31a876-77')
Jun 27 04:12:46.374131 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:12:46.374568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:12:46.374706 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:12:46.376236 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-67f8c4ec-145a-4dc5-a2b9-77f9af2ae51e req-6cfbc8c8-030f-4101-b407-646f26f1664d service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Received event network-vif-deleted-d13a3de0-7db1-43f6-a996-1eb633e8717f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:46.376384 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-67f8c4ec-145a-4dc5-a2b9-77f9af2ae51e req-6cfbc8c8-030f-4101-b407-646f26f1664d service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Neutron deleted interface d13a3de0-7db1-43f6-a996-1eb633e8717f; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:46.377565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:12:46.378123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3addc83-672b-4534-833a-767e39b9a06e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:12:46.378257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:12:46.378972 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-67f8c4ec-145a-4dc5-a2b9-77f9af2ae51e req-6cfbc8c8-030f-4101-b407-646f26f1664d service nova] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Detach interface failed, port_id=d13a3de0-7db1-43f6-a996-1eb633e8717f, reason: Instance f5611e50-86aa-420c-9f94-e13d8f80f4b0 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:46.404660 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:46.404660 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:46.404660 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:46.404660 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:46.404660 np0000003830 nova-compute[98984]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d19c7f16-e8e6-419a-84b7-818c17838389 (non-flash)
Jun 27 04:12:46.404660 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:12:46.404925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:46.404925 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:12:46.404925 np0000003830 nova-compute[98984]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:46.404925 np0000003830 nova-compute[98984]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e (non-flash)
Jun 27 04:12:46.404925 np0000003830 nova-compute[98984]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d19c7f16-e8e6-419a-84b7-818c17838389 (non-flash)
Jun 27 04:12:46.404925 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:12:46.405063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d19c7f16-e8e6-419a-84b7-818c17838389', '86')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:12:46.405063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '85')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:46.406123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e', '84')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:12:46.406538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870e0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'): ({'sdd'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:12:46.406715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:12:46.407023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Flush multipath device 33000000014503705 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:12:46.432002 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:46.480484 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:12:46.501698 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:46.530821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:12:46.530982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:12:46.532482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:12:46.547121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:12:46.547551 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:12:46.572473 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:46.613634 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.408s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:46.616805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.096s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:46.623703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260]
Jun 27 04:12:46.623703 np0000003830 nova-compute[98984]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.40.100,3260] successful.
Jun 27 04:12:46.623703 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:46.642652 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:46.656170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:46.686840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260]
Jun 27 04:12:46.686840 np0000003830 nova-compute[98984]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-d3addc83-672b-4534-833a-767e39b9a06e, portal: 192.168.50.100,3260] successful.
Jun 27 04:12:46.686840 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:46.704168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:12:46.704475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:12:46.704700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] <== disconnect_volume: return (329ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:12:46.704837 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:12:46.705299 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Deleting instance files /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_del
Jun 27 04:12:46.711823 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Deletion of /opt/stack/data/nova/instances/a41c0a78-a4b0-4a62-b391-e0eef4bd2329_del complete
Jun 27 04:12:46.734628 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Deleted allocations for instance a243ff55-7b82-43af-a0b8-158eb4b8d030
Jun 27 04:12:46.817028 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:46.831075 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004575329999170208 future=<Future at 0x7ec538305760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:46.831689 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] Emitting event <LifecycleEvent: 1782533551.8304288, c702a025-f366-4383-9aa7-4fe61cfb64b8 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:46.831835 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:46.832011 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] VM Stopped (Lifecycle Event)
Jun 27 04:12:46.832122 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.5311911530002362 future=<Future at 0x7ec5383c8050 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:46.832252 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.531052445000114 future=<Future at 0x7ec5383c8050 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:47.046627 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:47.049348 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:47.049348 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:47.211364 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updated VIF entry in instance network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:12:47.211669 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:47.220040 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Took 1.77 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:47.220889 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:47.221221 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:47.221427 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:47.222333 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:47.323087 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:12:47.329537 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:47.335018 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f100912a-3ada-4973-afb8-bd92441a7645 tempest-VolumesActionsTest-902759485 tempest-VolumesActionsTest-902759485-project-member] [instance: c702a025-f366-4383-9aa7-4fe61cfb64b8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:47.552852 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:47.713534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7c489533-287f-4f95-af0d-830737fada1b req-b13756aa-ec78-4cf0-b00d-8d8b215ada07 service nova] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:12:47.747030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a5196dc-6a15-42b8-8132-a70f248dd250 tempest-AttachVolumeMultiAttachTest-870912138 tempest-AttachVolumeMultiAttachTest-870912138-project-member] Lock "a243ff55-7b82-43af-a0b8-158eb4b8d030" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.496s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:47.832733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:48.066123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.449s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:48.067904 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.234s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:48.073223 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dd35f23c-650d-4705-ba89-c1ff1979433f req-1c8ecb3f-e157-4097-8aca-3fde78d9e36a service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-deleted-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:48.073451 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-dd35f23c-650d-4705-ba89-c1ff1979433f req-1c8ecb3f-e157-4097-8aca-3fde78d9e36a service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Neutron deleted interface 5a31a876-771a-4133-85ce-0ca67fa2d4af; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:48.074824 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dd35f23c-650d-4705-ba89-c1ff1979433f req-1c8ecb3f-e157-4097-8aca-3fde78d9e36a service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Detach interface failed, port_id=5a31a876-771a-4133-85ce-0ca67fa2d4af, reason: Instance a41c0a78-a4b0-4a62-b391-e0eef4bd2329 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:48.131983 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Deleted allocations for instance 075f803b-49f2-4084-9d8a-10d59d1c62eb
Jun 27 04:12:48.359806 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:48.361354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:48.361674 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:48.441861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:48.442127 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:48.442365 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:48.442577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:48.442715 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:48.443294 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received unexpected event network-vif-plugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with vm_state active and task_state deleting.
Jun 27 04:12:48.443294 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:48.443294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:48.443369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:48.443453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:48.443589 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:48.444156 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:48.444332 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:48.444487 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Acquiring lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:48.444669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:48.444807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:48.444927 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] No waiting events found dispatching network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:48.445048 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d2aacd23-fa2d-4ddc-889b-51324b3d5c14 req-546639f7-c0ed-4d71-b370-7d2ed9156776 service nova] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Received event network-vif-unplugged-5a31a876-771a-4133-85ce-0ca67fa2d4af for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:48.863515 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Took 1.64 seconds to deallocate network for instance.
Jun 27 04:12:48.866838 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:49.143580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bc5dc883-6e5b-4b9f-a989-44a9f3a4f7c0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "075f803b-49f2-4084-9d8a-10d59d1c62eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.582s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:49.366608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:49.368636 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.005305589999807125 future=<Future at 0x7ec5383c8050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:49.370102 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Emitting event <LifecycleEvent: 1782533554.363218, fa5fe299-857b-41f5-8069-c3324c227036 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:49.370343 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:49.370700 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] VM Stopped (Lifecycle Event)
Jun 27 04:12:49.371988 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.135740272000021 future=<Future at 0x7ec5187b98b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:49.372072 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.135547162999956 future=<Future at 0x7ec5187b98b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:49.377455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.311s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:49.437632 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Took 0.57 seconds to detach 1 volumes for instance.
Jun 27 04:12:49.454786 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Deleted allocations for instance f5611e50-86aa-420c-9f94-e13d8f80f4b0
Jun 27 04:12:49.687158 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:49.881938 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0a95f94-eebc-4b6d-a992-d1b2de4a59a7 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] [instance: fa5fe299-857b-41f5-8069-c3324c227036] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:49.945341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:49.945569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:50.222209 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:50.222483 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:50.420918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:50.469366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d8863795-d54c-4b77-ac82-2ff74dc13b92 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "f5611e50-86aa-420c-9f94-e13d8f80f4b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.580s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:50.725898 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:51.237682 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.292s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:51.306340 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Deleted allocations for instance a41c0a78-a4b0-4a62-b391-e0eef4bd2329
Jun 27 04:12:51.359705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:51.492827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:51.493217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:51.493217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:51.493217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:51.493362 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:51.496170 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Terminating instance
Jun 27 04:12:52.001286 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:12:52.014392 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.021788 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.026357 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.044946 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.050082 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.074885 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.320567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-33fdab8c-8519-4c97-895f-7220624e2555 tempest-ServerActionsTestOtherB-2075548864 tempest-ServerActionsTestOtherB-2075548864-project-member] Lock "a41c0a78-a4b0-4a62-b391-e0eef4bd2329" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.379s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:52.324703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.362413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.382010 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999583805999919 future=<Future at 0x7ec5183eb0b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:52.395919 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.397318 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Instance destroyed successfully.
Jun 27 04:12:52.397318 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lazy-loading 'resources' on Instance uuid e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:12:52.407319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-46ea2362-8182-44fc-9321-ac9746760a4b req-355ae363-b9ea-481e-91e6-1154078542a4 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:52.407319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-46ea2362-8182-44fc-9321-ac9746760a4b req-355ae363-b9ea-481e-91e6-1154078542a4 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:52.407319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-46ea2362-8182-44fc-9321-ac9746760a4b req-355ae363-b9ea-481e-91e6-1154078542a4 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:52.407319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-46ea2362-8182-44fc-9321-ac9746760a4b req-355ae363-b9ea-481e-91e6-1154078542a4 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:52.407319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-46ea2362-8182-44fc-9321-ac9746760a4b req-355ae363-b9ea-481e-91e6-1154078542a4 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:52.407319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-46ea2362-8182-44fc-9321-ac9746760a4b req-355ae363-b9ea-481e-91e6-1154078542a4 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:52.722485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.729845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.736041 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.766978 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.893909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:52.894088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:52.905808 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.905808 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1902559260',display_name='tempest-ServerRescueNegativeTestJSON-server-1902559260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serverrescuenegativetestjson-server-1902559260',id=28,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:10:16Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc2502eb6e45c19f6b8646b60669f5',ramdisk_id='',reservation_id='r-cvd59xdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1862600164',owner_user_name='tempest-ServerRescueNegativeTestJSON-1862600164-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:10:23Z,user_data=None,user_id='b427e506578a4121bf0d008321dacac9',uuid=e4cc11fc-1add-45d0-9bd3-e1f6de51ea39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:12:52.905808 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converting VIF {"id": "045ddeda-5a24-4df2-826c-346068bd099c", "address": "fa:16:3e:d0:ca:33", "network": {"id": "be1411af-5df7-4c91-bd96-9d3250c68865", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-416613695-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7adc2502eb6e45c19f6b8646b60669f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap045ddeda-5a", "ovs_interfaceid": "045ddeda-5a24-4df2-826c-346068bd099c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:12:52.906654 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:12:52.906975 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:12:52.907986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.908171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap045ddeda-5a, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:52.916840 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.921419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:52.923869 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.925683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.925996 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6eb55894-87f0-49f6-97dd-457f122942f4) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:12:52.928019 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:52.929603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:12:52.931377 np0000003830 nova-compute[98984]: INFO os_vif [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:33,bridge_name='br-int',has_traffic_filtering=True,id=045ddeda-5a24-4df2-826c-346068bd099c,network=Network(be1411af-5df7-4c91-bd96-9d3250c68865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045ddeda-5a')
Jun 27 04:12:52.931698 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Deleting instance files /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39_del
Jun 27 04:12:52.934377 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Deletion of /opt/stack/data/nova/instances/e4cc11fc-1add-45d0-9bd3-e1f6de51ea39_del complete
Jun 27 04:12:53.396899 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:12:53.440917 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 27 04:12:53.444793 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:12:53.445172 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:12:53.445309 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:12:53.445624 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:53.518598 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:53.961300 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:53.961801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:53.967528 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:12:53.967528 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Claim successful on node np0000003830
Jun 27 04:12:54.369591 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:54.479126 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:54.479588 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:54.479813 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:54.479968 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:54.480104 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:54.480629 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:54.480817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:54.481007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:54.481202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:54.481351 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:54.481791 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:54.482005 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state active and task_state deleting.
Jun 27 04:12:54.482198 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:54.482417 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:54.482715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:54.482931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:54.483133 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:54.483325 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received unexpected event network-vif-plugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with vm_state active and task_state deleting.
Jun 27 04:12:54.483554 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:54.483867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:54.486630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:54.487146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:54.488379 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:54.488600 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:54.488767 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:54.488956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Acquiring lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:54.489124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:54.489270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:54.489417 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] No waiting events found dispatching network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:12:54.489600 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-unplugged-045ddeda-5a24-4df2-826c-346068bd099c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:12:54.489746 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Received event network-vif-deleted-045ddeda-5a24-4df2-826c-346068bd099c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:54.489895 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Neutron deleted interface 045ddeda-5a24-4df2-826c-346068bd099c; detaching it from the instance and deleting it from the info cache
Jun 27 04:12:54.493226 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7278b7-2a6c-4a8a-ae2b-3ec6e6cfb2d5 req-9de54a5d-fda4-4560-ad98-8ad7dc04ee03 service nova] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Detach interface failed, port_id=045ddeda-5a24-4df2-826c-346068bd099c, reason: Instance e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:12:54.647774 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:55.149638 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Took 1.70 seconds to deallocate network for instance.
Jun 27 04:12:55.229356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:55.229575 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:55.660340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:55.732638 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:56.242084 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.280s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:56.242084 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:12:56.245222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.585s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:56.507020 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:12:56.507207 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:12:56.748470 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:12:56.748810 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:12:56.749099 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:56.749357 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:56.860230 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '216588ecf8894ad5aeb6914196a090db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72fed82034484f13a228c535b175c167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:12:57.011675 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:12:57.252141 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:12:57.531876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.286s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:57.626582 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Deleted allocations for instance e4cc11fc-1add-45d0-9bd3-e1f6de51ea39
Jun 27 04:12:57.658432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:57.758644 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:12:57.928585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:58.005819 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Successfully created port: c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:12:58.510810 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0011872850000145263 future=<Future at 0x7ec5187b98b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.510810 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Emitting event <LifecycleEvent: 1782533563.5074847, a243ff55-7b82-43af-a0b8-158eb4b8d030 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:58.510810 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.510810 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] VM Stopped (Lifecycle Event)
Jun 27 04:12:58.511842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0029312449996723444 future=<Future at 0x7ec518344f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.511842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.003163426999890362 future=<Future at 0x7ec518344f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.511842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.511842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.2974682389999543 future=<Future at 0x7ec518353620 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.511842 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.2973942019998503 future=<Future at 0x7ec518353620 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:58.512721 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] Emitting event <LifecycleEvent: 1782533563.5079813, 075f803b-49f2-4084-9d8a-10d59d1c62eb => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:58.512890 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] VM Stopped (Lifecycle Event)
Jun 27 04:12:58.639856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-42e22f37-024b-4e9f-9f47-04f85582fff7 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Lock "e4cc11fc-1add-45d0-9bd3-e1f6de51ea39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.147s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:58.774560 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:12:58.775796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:12:58.776004 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Creating image(s)
Jun 27 04:12:58.777509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:58.778087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "/opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:58.778883 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "/opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:58.780078 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:58.786158 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:58.789656 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Successfully updated port: c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:12:58.791467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:58.851441 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Received event network-changed-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:12:58.852642 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Refreshing instance network info cache due to event network-changed-c681e64d-8190-417b-867a-4e1841a469af. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:12:58.852642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] Acquiring lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:58.853051 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] Acquired lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:12:58.853217 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Refreshing network info cache for port c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:12:58.881765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:58.882162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:58.882548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:58.883294 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:58.886749 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:12:58.887093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:58.988324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:58.988927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:59.018178 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: a243ff55-7b82-43af-a0b8-158eb4b8d030] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:59.019979 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b23dae00-37dd-4f6c-86f0-b0129c631f6d None None] [instance: 075f803b-49f2-4084-9d8a-10d59d1c62eb] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:12:59.062580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk 1073741824" returned: 0 in 0.073s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:59.063161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:59.063619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:59.167602 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:59.168020 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:12:59.168295 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:12:59.258803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:12:59.259955 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Cannot resize image /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:12:59.260542 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:12:59.260755 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Ensure instance console log exists: /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:12:59.261106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:12:59.261359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:12:59.261622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:12:59.310533 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:12:59.355945 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:12:59.370963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:12:59.442405 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:12:59.619244 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:12:59.809310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00040863200001695077 future=<Future at 0x7ec518353620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:59.809424 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:59.809637 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.0110470790000363 future=<Future at 0x7ec5183cacc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:59.809707 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.0109353810003086 future=<Future at 0x7ec5183cacc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:12:59.810110 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Emitting event <LifecycleEvent: 1782533564.80878, f5611e50-86aa-420c-9f94-e13d8f80f4b0 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:12:59.810929 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] VM Stopped (Lifecycle Event)
Jun 27 04:13:00.121841 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-11c8d0ba-71f3-4742-b8e9-a995fa5a4b9d req-1504fe9b-e3a6-47e2-807c-23cbba36858c service nova] Releasing lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:00.122518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquired lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:00.122795 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:13:00.309225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:00.309795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:00.309795 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Rebooting instance
Jun 27 04:13:00.313718 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: f5611e50-86aa-420c-9f94-e13d8f80f4b0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:00.334386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:00.706330 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:00.821069 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003810199996223673 future=<Future at 0x7ec5183cacc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:00.821483 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Emitting event <LifecycleEvent: 1782533565.8205652, a41c0a78-a4b0-4a62-b391-e0eef4bd2329 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:00.821674 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:00.821859 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] VM Stopped (Lifecycle Event)
Jun 27 04:13:00.821962 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=6.5593117020002865 future=<Future at 0x7ec5183eb0b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:00.822061 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=6.559196938000241 future=<Future at 0x7ec5183eb0b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:00.889262 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:00.889408 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:00.889526 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:13:00.897580 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:01.064986 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updating instance_info_cache with network_info: [{"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:01.325520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2bf5a0a2-59f8-43d0-9ff7-6fa48f6fb63e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: a41c0a78-a4b0-4a62-b391-e0eef4bd2329] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:01.391868 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:01.567106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Releasing lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:01.567438 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Instance network_info: |[{"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:13:01.569674 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Start _get_guest_xml network_info=[{"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:13:01.574582 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:13:01.576230 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-526867060', uuid='e1cb21b7-7354-467e-b189-0696fa5444f3'), owner=OwnerMeta(userid='216588ecf8894ad5aeb6914196a090db', username='tempest-AttachVolumeTestJSON-559471176-project-member', projectid='72fed82034484f13a228c535b175c167', projectname='tempest-AttachVolumeTestJSON-559471176'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533581.5756972) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:13:01.579905 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:13:01.580029 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:13:01.583088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:13:01.583088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:13:01.583476 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:13:01.584349 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:13:01.584349 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:13:01.585270 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:13:01.585270 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:13:01.585270 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:13:01.585270 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:13:01.586014 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:13:01.586748 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:13:01.586748 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:13:01.587215 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:13:01.587478 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:13:01.603785 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-526867060',display_name='tempest-AttachVolumeTestJSON-server-526867060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-526867060',id=38,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkd6HZH/KNnDOckhlzwdr60nWAezeDTdzyXTtW+Hic4oew8ie3sykOqOOHa6tcb0SINEZTTGZpTWXRyWINHoxuz6cxG8pkPbOgcl6ftROYM3wJQPtLMMOwL7X6eYn2/Uw==',key_name='tempest-keypair-104886217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-gse7wwoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=e1cb21b7-7354-467e-b189-0696fa5444f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:13:01.603980 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:01.604861 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:01.605472 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'pci_devices' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:01.742324 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:01.883658 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <uuid>e1cb21b7-7354-467e-b189-0696fa5444f3</uuid>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <name>instance-00000026</name>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeTestJSON-server-526867060</nova:name>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:13:01</nova:creationTime>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:user uuid="216588ecf8894ad5aeb6914196a090db">tempest-AttachVolumeTestJSON-559471176-project-member</nova:user>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:project uuid="72fed82034484f13a228c535b175c167">tempest-AttachVolumeTestJSON-559471176</nova:project>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         <nova:port uuid="c681e64d-8190-417b-867a-4e1841a469af">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <entry name="serial">e1cb21b7-7354-467e-b189-0696fa5444f3</entry>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <entry name="uuid">e1cb21b7-7354-467e-b189-0696fa5444f3</entry>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.config"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:30:97:02"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <target dev="tapc681e64d-81"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/console.log" append="off"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Preparing to wait for external event network-vif-plugged-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:02.108927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-526867060',display_name='tempest-AttachVolumeTestJSON-server-526867060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-526867060',id=38,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkd6HZH/KNnDOckhlzwdr60nWAezeDTdzyXTtW+Hic4oew8ie3sykOqOOHa6tcb0SINEZTTGZpTWXRyWINHoxuz6cxG8pkPbOgcl6ftROYM3wJQPtLMMOwL7X6eYn2/Uw==',key_name='tempest-keypair-104886217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-gse7wwoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=e1cb21b7-7354-467e-b189-0696fa5444f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:13:02.112324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.113960 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8469d696-7570-51fd-ad12-534248a5e26e', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:02.113960 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.114381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:02.115051 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.117070 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.117357 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc681e64d-81, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:02.118339 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc681e64d-81, col_values=(('qos', UUID('389339cd-eb05-412d-9886-005f8cdfaa14')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:02.118339 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc681e64d-81, col_values=(('external_ids', {'iface-id': 'c681e64d-8190-417b-867a-4e1841a469af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:97:02', 'vm-uuid': 'e1cb21b7-7354-467e-b189-0696fa5444f3'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:02.119015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.121015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:02.127870 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:02.128844 np0000003830 nova-compute[98984]: INFO os_vif [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81')
Jun 27 04:13:02.386041 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:02.893480 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:03.651455 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:03.652801 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:03.652801 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:30:97:02, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:13:03.652801 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Using config drive
Jun 27 04:13:03.937530 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:03.939730 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:03.959953 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:03.962405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:03.982543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:03.993227 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.158984 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:04.275285 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999711984999976 future=<Future at 0x7ec518165fd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:04.277109 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance destroyed successfully.
Jun 27 04:13:04.277974 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'resources' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:04.303883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9d15fda5-3301-4a86-9c83-c9d2df89d637 req-fdc9e1a8-ab4f-4000-90b0-8f215e7f4468 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:04.304070 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d15fda5-3301-4a86-9c83-c9d2df89d637 req-fdc9e1a8-ab4f-4000-90b0-8f215e7f4468 service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:04.305144 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d15fda5-3301-4a86-9c83-c9d2df89d637 req-fdc9e1a8-ab4f-4000-90b0-8f215e7f4468 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:04.306121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d15fda5-3301-4a86-9c83-c9d2df89d637 req-fdc9e1a8-ab4f-4000-90b0-8f215e7f4468 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:04.306121 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9d15fda5-3301-4a86-9c83-c9d2df89d637 req-fdc9e1a8-ab4f-4000-90b0-8f215e7f4468 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:04.306121 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9d15fda5-3301-4a86-9c83-c9d2df89d637 req-fdc9e1a8-ab4f-4000-90b0-8f215e7f4468 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received unexpected event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with vm_state active and task_state reboot_started_hard.
Jun 27 04:13:04.332414 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Creating config drive at /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.config
Jun 27 04:13:04.336798 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu8pxlvm7 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:04.398056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu8pxlvm7" returned: 0 in 0.061s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:04.784675 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1674285695',display_name='tempest-TestMinimumBasicScenario-server-1674285695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1674285695',id=37,image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgum/gIYxMDwJRllTP2re+g6juLUdaKsjIBtLjj/vhSmgumtf+9sVssRINNmjajkhDItVllQdfCF1coq5cKGTOSRLuhpQXPQZcNhNfT45XvB+bz7Gr0woIXPVFo2yV4nA==',key_name='tempest-TestMinimumBasicScenario-921440636',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:24Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-bwl80gc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:13:03Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=7a9c24d6-f85f-4fbf-9f00-33a8f029e43b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:13:04.784675 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:04.785150 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:04.786093 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:13:04.791873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.791873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape16fd2c7-f6, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:04.793231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.794390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:04.801014 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.801543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.801796 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5f5afd8-9df1-413d-986c-56ba7e84eb12) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:04.802527 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.803394 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:04.810888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.814696 np0000003830 nova-compute[98984]: INFO os_vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6')
Jun 27 04:13:04.820939 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:13:04.821512 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:13:04.821774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:04.822447 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:04.822984 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:13:04.823151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:13:04.853195 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:04.853195 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:04.853195 np0000003830 nova-compute[98984]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:04.853195 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:04.853354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [82] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:04.853354 np0000003830 nova-compute[98984]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:04.853354 np0000003830 nova-compute[98984]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:04.853354 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:04.853488 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc', '87')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:13:04.853637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '83')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:13:04.854668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '82')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:13:04.855368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538412d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:13:04.855582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:13:04.855996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flush multipath device 3300000007fb87ae2 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:13:04.889111 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:13:04.942618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:13:04.961309 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.985398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:04.987173 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.002474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:13:05.002474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:13:05.003410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:13:05.019177 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:13:05.019394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:13:05.033173 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.074006 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260]
Jun 27 04:13:05.074006 np0000003830 nova-compute[98984]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260] successful.
Jun 27 04:13:05.074006 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.090280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.105799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.111076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.116658 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.138750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260]
Jun 27 04:13:05.138750 np0000003830 nova-compute[98984]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260] successful.
Jun 27 04:13:05.138750 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.152845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.153073 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:05.153207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== disconnect_volume: return (331ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:13:05.153315 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:13:05.160784 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Start _get_guest_xml network_info=[{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b794a1c-a528-4c36-a812-29377cdc843e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': '0b794a1c-a528-4c36-a812-29377cdc843e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'ac86cc7b-945b-4f30-9eac-bd6992c17e39', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '7a9c24d6-f85f-4fbf-9f00-33a8f029e43b', 'attached_at': '', 'detached_at': '', 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'serial': '9f2b1cd9-65b3-43d8-8856-3b134d71049e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:13:05.164993 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:13:05.166318 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='0b794a1c-a528-4c36-a812-29377cdc843e', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1674285695', uuid='7a9c24d6-f85f-4fbf-9f00-33a8f029e43b'), owner=OwnerMeta(userid='be52472c68cd47fe991efe4050788c09', username='tempest-TestMinimumBasicScenario-1552363864-project-member', projectid='ef6a6b08a14849038c79ff273d34be3f', projectname='tempest-TestMinimumBasicScenario-1552363864'), image=ImageMeta(id='0b794a1c-a528-4c36-a812-29377cdc843e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533585.1659257) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:13:05.170444 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:13:05.170836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:13:05.173600 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:13:05.173600 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:13:05.173928 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:13:05.174228 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b794a1c-a528-4c36-a812-29377cdc843e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:13:05.174415 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:13:05.174530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:13:05.174681 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:13:05.174785 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:13:05.174899 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:13:05.176002 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:13:05.176166 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:13:05.176356 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:13:05.176529 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:13:05.176730 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:13:05.176950 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:05.214685 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37f68a45-167c-490a-82b1-e2498f1ef176 req-41441b81-8380-42d5-834b-ea94c2250d2b service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Received event network-vif-plugged-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:05.215172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37f68a45-167c-490a-82b1-e2498f1ef176 req-41441b81-8380-42d5-834b-ea94c2250d2b service nova] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:05.215328 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37f68a45-167c-490a-82b1-e2498f1ef176 req-41441b81-8380-42d5-834b-ea94c2250d2b service nova] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:05.215485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37f68a45-167c-490a-82b1-e2498f1ef176 req-41441b81-8380-42d5-834b-ea94c2250d2b service nova] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:05.215671 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37f68a45-167c-490a-82b1-e2498f1ef176 req-41441b81-8380-42d5-834b-ea94c2250d2b service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Processing event network-vif-plugged-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:13:05.339572 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.393936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.399633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.421636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:05.680188 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Object Instance<7a9c24d6-f85f-4fbf-9f00-33a8f029e43b> lazy-loaded attributes: resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:13:05.691525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:05.798770 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:05.800777 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:05.800777 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:05.800777 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:05.801181 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:13:05.801935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:13:05.801935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:05.802193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:05.802954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:13:05.816115 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:05.816921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:05.817958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:05.818165 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:13:05.818873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:05.819229 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:13:05.837508 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:13:05.837508 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.845895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:13:05.845895 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e] added
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.860549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:13:05.860719 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:13:05.860873 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e] added
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:05.864509 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:05.864757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:13:05.864965 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:13:05.865142 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:13:06.000786 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533586.0002759, e1cb21b7-7354-467e-b189-0696fa5444f3 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:06.001142 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] VM Started (Lifecycle Event)
Jun 27 04:13:06.002612 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:13:06.012298 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:13:06.016582 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Instance spawned successfully.
Jun 27 04:13:06.017839 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:13:06.413725 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-18f523f2-f8d3-4e14-9aca-c354362678b3 req-00422909-6f60-4bb9-b560-149234bdf693 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:06.413725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-18f523f2-f8d3-4e14-9aca-c354362678b3 req-00422909-6f60-4bb9-b560-149234bdf693 service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:06.413725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-18f523f2-f8d3-4e14-9aca-c354362678b3 req-00422909-6f60-4bb9-b560-149234bdf693 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:06.413994 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-18f523f2-f8d3-4e14-9aca-c354362678b3 req-00422909-6f60-4bb9-b560-149234bdf693 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:06.413994 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-18f523f2-f8d3-4e14-9aca-c354362678b3 req-00422909-6f60-4bb9-b560-149234bdf693 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:06.414079 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-18f523f2-f8d3-4e14-9aca-c354362678b3 req-00422909-6f60-4bb9-b560-149234bdf693 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received unexpected event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with vm_state active and task_state reboot_started_hard.
Jun 27 04:13:06.508274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:06.513090 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:06.525328 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:06.525595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:06.526011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:06.527959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:06.527959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:06.527959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:06.861298 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:13:06.865778 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:13:06.874131 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:13:06.883811 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.890116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.898849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.905676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.905676 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:06.905868 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.905868 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:06.911930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.911930 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:06.912121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.912121 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:06.932376 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260]
Jun 27 04:13:06.932376 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260] successful.
Jun 27 04:13:06.932376 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.944754 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.945307 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260]
Jun 27 04:13:06.945307 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260] successful.
Jun 27 04:13:06.945307 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.959842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.959842 np0000003830 nova-compute[98984]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.959842 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.959842 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:06.960000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.960000 np0000003830 nova-compute[98984]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.960000 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.960000 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:06.960305 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:06.960466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:13:06.961269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] HCTL ('7', '-', '-', 0) found on session 88 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:13:06.961441 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:13:06.962101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66f491ff-94c0-443f-88a7-9cbf3a4410dc (non-flash)
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:06.978280 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:13:06.981961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] HCTL ('8', '-', '-', 0) found on session 89 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:13:06.981961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:13:06.983012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 88 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:13:06.984811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:13:07.001990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 89 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:13:07.001990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:13:07.016586 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:13:07.019885 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533587.0165982, e1cb21b7-7354-467e-b189-0696fa5444f3 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:07.019885 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] VM Paused (Lifecycle Event)
Jun 27 04:13:07.034862 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Took 8.26 seconds to spawn the instance on the hypervisor.
Jun 27 04:13:07.036900 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:07.303155 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9f0754ec-9132-4172-bb61-140fece7287d req-b494e582-d89f-4b64-b1f4-e26ecfe281c6 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Received event network-vif-plugged-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:07.303358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9f0754ec-9132-4172-bb61-140fece7287d req-b494e582-d89f-4b64-b1f4-e26ecfe281c6 service nova] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:07.306536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9f0754ec-9132-4172-bb61-140fece7287d req-b494e582-d89f-4b64-b1f4-e26ecfe281c6 service nova] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:07.306536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9f0754ec-9132-4172-bb61-140fece7287d req-b494e582-d89f-4b64-b1f4-e26ecfe281c6 service nova] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:07.306536 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9f0754ec-9132-4172-bb61-140fece7287d req-b494e582-d89f-4b64-b1f4-e26ecfe281c6 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] No waiting events found dispatching network-vif-plugged-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:07.306536 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9f0754ec-9132-4172-bb61-140fece7287d req-b494e582-d89f-4b64-b1f4-e26ecfe281c6 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Received unexpected event network-vif-plugged-c681e64d-8190-417b-867a-4e1841a469af for instance with vm_state active and task_state None.
Jun 27 04:13:07.382123 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000663335999888659 future=<Future at 0x7ec5183eb0b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:07.382166 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:07.382292 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.892642505999902 future=<Future at 0x7ec518165fd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:07.382431 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.892530198000259 future=<Future at 0x7ec518165fd0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:07.382734 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Emitting event <LifecycleEvent: 1782533572.381211, e4cc11fc-1add-45d0-9bd3-e1f6de51ea39 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:07.382850 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] VM Stopped (Lifecycle Event)
Jun 27 04:13:07.527034 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:07.529094 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533587.5287514, e1cb21b7-7354-467e-b189-0696fa5444f3 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:07.529348 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] VM Resumed (Lifecycle Event)
Jun 27 04:13:07.552304 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Took 13.65 seconds to build instance.
Jun 27 04:13:07.819319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:13:07.885615 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e4cc11fc-1add-45d0-9bd3-e1f6de51ea39] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:08.030905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:08.032939 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:08.039592 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:08.054937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5909f246-5558-413c-a705-38e3555e9a1f tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.160s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:08.837602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found WWN 3300000007fb87ae2 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:13:08.837997 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:08.838232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000007fb87ae2', 'path': '/dev/dm-0', 'multipath_id': '3300000007fb87ae2'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:13:08.843981 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007fb87ae2', 'path': '/dev/dm-0', 'multipath_id': '3300000007fb87ae2'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:13:09.349011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1674285695',display_name='tempest-TestMinimumBasicScenario-server-1674285695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1674285695',id=37,image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgum/gIYxMDwJRllTP2re+g6juLUdaKsjIBtLjj/vhSmgumtf+9sVssRINNmjajkhDItVllQdfCF1coq5cKGTOSRLuhpQXPQZcNhNfT45XvB+bz7Gr0woIXPVFo2yV4nA==',key_name='tempest-TestMinimumBasicScenario-921440636',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:24Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-bwl80gc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:13:03Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=7a9c24d6-f85f-4fbf-9f00-33a8f029e43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:13:09.349430 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:09.350237 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:09.351265 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:09.372826 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:09.454163 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Received event network-changed-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:09.454649 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Refreshing instance network info cache due to event network-changed-c681e64d-8190-417b-867a-4e1841a469af. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:13:09.454924 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] Acquiring lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:09.455043 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] Acquired lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:09.455208 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Refreshing network info cache for port c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:13:09.813553 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:09.853562 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Object Instance<7a9c24d6-f85f-4fbf-9f00-33a8f029e43b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <uuid>7a9c24d6-f85f-4fbf-9f00-33a8f029e43b</uuid>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <name>instance-00000025</name>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestMinimumBasicScenario-server-1674285695</nova:name>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:13:05</nova:creationTime>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:image uuid="0b794a1c-a528-4c36-a812-29377cdc843e">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:user uuid="be52472c68cd47fe991efe4050788c09">tempest-TestMinimumBasicScenario-1552363864-project-member</nova:user>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:project uuid="ef6a6b08a14849038c79ff273d34be3f">tempest-TestMinimumBasicScenario-1552363864</nova:project>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="0b794a1c-a528-4c36-a812-29377cdc843e"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         <nova:port uuid="e16fd2c7-f6ff-473f-abbf-989f993f285c">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <entry name="serial">7a9c24d6-f85f-4fbf-9f00-33a8f029e43b</entry>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <entry name="uuid">7a9c24d6-f85f-4fbf-9f00-33a8f029e43b</entry>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk.config"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <alias name="ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <serial>9f2b1cd9-65b3-43d8-8856-3b134d71049e</serial>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:06:8c:f2"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <target dev="tape16fd2c7-f6"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/console.log" append="off"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:13:09.854828 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:13:09.857788 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:09.955462 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:09.956212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:09.975879 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:10.064544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:10.064544 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:13:10.064740 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:10.567088 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Object Instance<7a9c24d6-f85f-4fbf-9f00-33a8f029e43b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:13:10.567578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:10.602421 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:10.663135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0d3e397c9cd9ff9c48f64a12e785c164b93769c --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:10.663612 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:13:10.663954 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:10.761158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:10.761725 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Cannot resize image /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:13:10.762074 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'migration_context' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:10.849893 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updated VIF entry in instance network info cache for port c681e64d-8190-417b-867a-4e1841a469af. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:13:10.849893 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updating instance_info_cache with network_info: [{"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:11.216906 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:11.217131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:11.265578 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Object Instance<7a9c24d6-f85f-4fbf-9f00-33a8f029e43b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:13:11.266791 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1674285695',display_name='tempest-TestMinimumBasicScenario-server-1674285695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1674285695',id=37,image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgum/gIYxMDwJRllTP2re+g6juLUdaKsjIBtLjj/vhSmgumtf+9sVssRINNmjajkhDItVllQdfCF1coq5cKGTOSRLuhpQXPQZcNhNfT45XvB+bz7Gr0woIXPVFo2yV4nA==',key_name='tempest-TestMinimumBasicScenario-921440636',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:24Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-bwl80gc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:03Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=7a9c24d6-f85f-4fbf-9f00-33a8f029e43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:13:11.267009 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:11.267863 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:11.268183 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:13:11.268586 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.268988 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:11.269311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:13:11.270093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.270276 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6a81750-25b9-53db-a343-182e76af5695', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:11.272120 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.272120 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:11.272120 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.278237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.278640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape16fd2c7-f6, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:11.279415 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape16fd2c7-f6, col_values=(('qos', UUID('e64ba91b-4e22-439d-a1c5-4eec6606ff59')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:11.279700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape16fd2c7-f6, col_values=(('external_ids', {'iface-id': 'e16fd2c7-f6ff-473f-abbf-989f993f285c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:8c:f2', 'vm-uuid': '7a9c24d6-f85f-4fbf-9f00-33a8f029e43b'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:11.281181 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.282104 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:11.287678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.289487 np0000003830 nova-compute[98984]: INFO os_vif [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6')
Jun 27 04:13:11.349556 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e0b0d7a4-5e71-4e38-869c-90cd338f1985 req-f7ed4b38-ae6f-4531-a55c-922c9de568f2 service nova] Releasing lock "refresh_cache-e1cb21b7-7354-467e-b189-0696fa5444f3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:11.720417 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:13:11.802359 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.836731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:11.944903 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:12.209225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:12.211213 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:12.222829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:12.222829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:12.249910 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:12.305474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:12.305474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:12.310389 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:13:12.310784 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Claim successful on node np0000003830
Jun 27 04:13:13.178356 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:13:13.180180 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b due to new event <LifecycleEvent: 1782533593.1792874, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:13:13.180180 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533593.1792874, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:13.180355 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] VM Resumed (Lifecycle Event)
Jun 27 04:13:13.191223 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance rebooted successfully.
Jun 27 04:13:13.556808 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:13:13.557125 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:13:13.683190 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:13.684805 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:14.060405 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:13:14.186952 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jun 27 04:13:14.187406 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533594.1870463, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:14.187406 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] VM Started (Lifecycle Event)
Jun 27 04:13:14.373712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:14.568962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.281s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:14.569396 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:13:14.690062 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:14.692532 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:14.702432 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:14.702655 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:14.702743 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:14.703513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No VIF found with MAC fa:16:3e:06:8c:f2, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:13:14.703513 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:15.079203 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:13:15.079203 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:13:15.079203 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:15.079203 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:15.177662 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39149bed2f8346c28e7bb800cadc9b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565ea3785de40f985397aa1d9254b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:13:15.195930 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jun 27 04:13:15.221055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-22cf7ada-f0df-421e-8fde-1f32dd964f6b tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 14.905s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:15.404610 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3b1cfdc5-b8b3-4b21-894a-69df8da9c59f req-056a8606-296e-481d-8a21-6dea4a05d19d service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:15.404865 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b1cfdc5-b8b3-4b21-894a-69df8da9c59f req-056a8606-296e-481d-8a21-6dea4a05d19d service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:15.405072 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b1cfdc5-b8b3-4b21-894a-69df8da9c59f req-056a8606-296e-481d-8a21-6dea4a05d19d service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:15.405164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b1cfdc5-b8b3-4b21-894a-69df8da9c59f req-056a8606-296e-481d-8a21-6dea4a05d19d service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:15.405287 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3b1cfdc5-b8b3-4b21-894a-69df8da9c59f req-056a8606-296e-481d-8a21-6dea4a05d19d service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:15.405411 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3b1cfdc5-b8b3-4b21-894a-69df8da9c59f req-056a8606-296e-481d-8a21-6dea4a05d19d service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received unexpected event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with vm_state active and task_state None.
Jun 27 04:13:15.583040 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:13:15.744825 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Successfully created port: 6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:13:16.088054 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:13:16.286390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:16.735182 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Successfully updated port: 6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:13:16.811085 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-changed-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:16.811323 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Refreshing instance network info cache due to event network-changed-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:13:16.811565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] Acquiring lock "refresh_cache-fc6a44e4-6a27-4d30-ab01-80374403846a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:16.811708 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] Acquired lock "refresh_cache-fc6a44e4-6a27-4d30-ab01-80374403846a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:16.811854 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Refreshing network info cache for port 6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:13:17.098518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:13:17.099475 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:13:17.099776 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Creating image(s)
Jun 27 04:13:17.100195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:17.100363 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "/opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:17.100975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "/opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:17.101984 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:17.106043 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:17.107154 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:17.221582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:17.222065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:17.222830 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:17.228168 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:17.228168 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:17.228168 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:17.243080 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "refresh_cache-fc6a44e4-6a27-4d30-ab01-80374403846a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:17.315453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:17.316130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:17.336583 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:17.396345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk 1073741824" returned: 0 in 0.079s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:17.396345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:17.396345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:17.438224 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:17.479514 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-82784717-6194-42d1-9c3e-aa3a3f2cb7c5 req-9c296266-65c0-4891-adf0-d7cecd52bc66 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:17.480114 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-82784717-6194-42d1-9c3e-aa3a3f2cb7c5 req-9c296266-65c0-4891-adf0-d7cecd52bc66 service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:17.480357 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-82784717-6194-42d1-9c3e-aa3a3f2cb7c5 req-9c296266-65c0-4891-adf0-d7cecd52bc66 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:17.480599 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-82784717-6194-42d1-9c3e-aa3a3f2cb7c5 req-9c296266-65c0-4891-adf0-d7cecd52bc66 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:17.480811 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-82784717-6194-42d1-9c3e-aa3a3f2cb7c5 req-9c296266-65c0-4891-adf0-d7cecd52bc66 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:17.481124 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-82784717-6194-42d1-9c3e-aa3a3f2cb7c5 req-9c296266-65c0-4891-adf0-d7cecd52bc66 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received unexpected event network-vif-plugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with vm_state active and task_state None.
Jun 27 04:13:17.512827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.117s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:17.513467 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:13:17.513714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:17.631699 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:17.634439 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:17.635301 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Cannot resize image /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:13:17.636028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:13:17.636028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Ensure instance console log exists: /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:13:17.640740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:17.640740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:17.640740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:18.142038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1d9f3049-843f-4b3e-9e23-bdbab7443a27 req-f44600b7-0450-4c7f-bf18-f3a435804790 service nova] Releasing lock "refresh_cache-fc6a44e4-6a27-4d30-ab01-80374403846a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:18.142038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquired lock "refresh_cache-fc6a44e4-6a27-4d30-ab01-80374403846a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:18.142038 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:13:18.710007 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:18.898442 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:19.079611 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Updating instance_info_cache with network_info: [{"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:19.275451 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00045971400004418683 future=<Future at 0x7ec518165fd0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:19.275619 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:19.376460 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:19.579900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Releasing lock "refresh_cache-fc6a44e4-6a27-4d30-ab01-80374403846a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:19.581212 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Instance network_info: |[{"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:13:19.583381 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Start _get_guest_xml network_info=[{"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:13:19.590172 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:13:19.591938 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-2098654423', uuid='fc6a44e4-6a27-4d30-ab01-80374403846a'), owner=OwnerMeta(userid='39149bed2f8346c28e7bb800cadc9b7a', username='tempest-ServersNegativeTestJSON-1704939525-project-member', projectid='3565ea3785de40f985397aa1d9254b99', projectname='tempest-ServersNegativeTestJSON-1704939525'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533599.5914621) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:13:19.593132 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:13:19.593531 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:13:19.594293 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:13:19.594472 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:13:19.595384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:13:19.595813 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:13:19.595813 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:13:19.595909 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:13:19.596021 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:13:19.596102 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:13:19.596209 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:13:19.596390 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:13:19.596515 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:13:19.596617 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:13:19.596762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:13:19.596876 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:13:19.608752 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2098654423',display_name='tempest-ServersNegativeTestJSON-server-2098654423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serversnegativetestjson-server-2098654423',id=39,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3565ea3785de40f985397aa1d9254b99',ramdisk_id='',reservation_id='r-hjk4yt62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1704939525',owner_user_name='tempest-ServersNegativeTestJSON-1704939525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:16Z,user_data=None,user_id='39149bed2f8346c28e7bb800cadc9b7a',uuid=fc6a44e4-6a27-4d30-ab01-80374403846a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:13:19.608926 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converting VIF {"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:19.609707 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:19.610413 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lazy-loading 'pci_devices' on Instance uuid fc6a44e4-6a27-4d30-ab01-80374403846a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <uuid>fc6a44e4-6a27-4d30-ab01-80374403846a</uuid>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <name>instance-00000027</name>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServersNegativeTestJSON-server-2098654423</nova:name>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:13:19</nova:creationTime>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:user uuid="39149bed2f8346c28e7bb800cadc9b7a">tempest-ServersNegativeTestJSON-1704939525-project-member</nova:user>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:project uuid="3565ea3785de40f985397aa1d9254b99">tempest-ServersNegativeTestJSON-1704939525</nova:project>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         <nova:port uuid="6097ba72-a5a1-4bd7-8d0d-55e9d760d47c">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <entry name="serial">fc6a44e4-6a27-4d30-ab01-80374403846a</entry>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <entry name="uuid">fc6a44e4-6a27-4d30-ab01-80374403846a</entry>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.config"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:c4:d0:63"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <target dev="tap6097ba72-a5"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/console.log" append="off"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:13:20.115341 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Preparing to wait for external event network-vif-plugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2098654423',display_name='tempest-ServersNegativeTestJSON-server-2098654423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serversnegativetestjson-server-2098654423',id=39,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3565ea3785de40f985397aa1d9254b99',ramdisk_id='',reservation_id='r-hjk4yt62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1704939525',owner_user_name='tempest-ServersNegativeTestJSON-1704939525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:16Z,user_data=None,user_id='39149bed2f8346c28e7bb800cadc9b7a',uuid=fc6a44e4-6a27-4d30-ab01-80374403846a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converting VIF {"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:20.118656 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:13:20.119305 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:20.119634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:20.120108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:13:20.120852 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:20.121080 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec0be240-bf33-5431-85dd-255f35d4b8e9', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:20.123449 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:20.125224 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:20.127908 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:20.128345 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6097ba72-a5, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:20.129072 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6097ba72-a5, col_values=(('qos', UUID('37dda04b-5a48-4ea6-ab7a-1147cc368532')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:20.129365 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6097ba72-a5, col_values=(('external_ids', {'iface-id': '6097ba72-a5a1-4bd7-8d0d-55e9d760d47c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:d0:63', 'vm-uuid': 'fc6a44e4-6a27-4d30-ab01-80374403846a'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:20.132930 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:20.132930 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:20.138705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:20.139119 np0000003830 nova-compute[98984]: INFO os_vif [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5')
Jun 27 04:13:21.669286 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:21.669805 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:21.669805 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] No VIF found with MAC fa:16:3e:c4:d0:63, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:13:21.670181 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Using config drive
Jun 27 04:13:22.179038 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:22.322354 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Creating config drive at /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.config
Jun 27 04:13:22.328520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_j4pfw_t {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:22.380810 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_j4pfw_t" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:22.838665 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:22.864834 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:23.049560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:23.130799 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3cb459d6-c633-46dd-86cd-d31376ae2f09 req-132fb731-57a6-408d-9631-812f6988d0f6 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-plugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:23.130799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3cb459d6-c633-46dd-86cd-d31376ae2f09 req-132fb731-57a6-408d-9631-812f6988d0f6 service nova] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:23.130995 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3cb459d6-c633-46dd-86cd-d31376ae2f09 req-132fb731-57a6-408d-9631-812f6988d0f6 service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:23.131127 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3cb459d6-c633-46dd-86cd-d31376ae2f09 req-132fb731-57a6-408d-9631-812f6988d0f6 service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:23.131752 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3cb459d6-c633-46dd-86cd-d31376ae2f09 req-132fb731-57a6-408d-9631-812f6988d0f6 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Processing event network-vif-plugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:13:23.260998 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:23.263886 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:23.268918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:23.297465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:23.997575 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533603.9952474, fc6a44e4-6a27-4d30-ab01-80374403846a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:23.997575 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] VM Started (Lifecycle Event)
Jun 27 04:13:23.999318 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:13:24.002039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:13:24.004452 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Instance spawned successfully.
Jun 27 04:13:24.004906 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:13:24.376069 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:24.501912 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:24.513866 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:24.517207 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:24.517448 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:24.518064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:24.518412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:24.518823 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:24.519138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:25.025418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Took 7.93 seconds to spawn the instance on the hypervisor.
Jun 27 04:13:25.028558 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:25.028558 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:13:25.028558 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533605.0264707, fc6a44e4-6a27-4d30-ab01-80374403846a => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:25.028558 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] VM Paused (Lifecycle Event)
Jun 27 04:13:25.140343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:25.219514 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-089ed4d8-5a1e-4cf4-8b81-8c283bc2a506 req-6e3f266e-666e-4446-84b3-0afd25a159b6 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-plugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:25.219514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-089ed4d8-5a1e-4cf4-8b81-8c283bc2a506 req-6e3f266e-666e-4446-84b3-0afd25a159b6 service nova] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:25.219514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-089ed4d8-5a1e-4cf4-8b81-8c283bc2a506 req-6e3f266e-666e-4446-84b3-0afd25a159b6 service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:25.219514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-089ed4d8-5a1e-4cf4-8b81-8c283bc2a506 req-6e3f266e-666e-4446-84b3-0afd25a159b6 service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:25.219514 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-089ed4d8-5a1e-4cf4-8b81-8c283bc2a506 req-6e3f266e-666e-4446-84b3-0afd25a159b6 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] No waiting events found dispatching network-vif-plugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:25.219514 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-089ed4d8-5a1e-4cf4-8b81-8c283bc2a506 req-6e3f266e-666e-4446-84b3-0afd25a159b6 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received unexpected event network-vif-plugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c for instance with vm_state active and task_state None.
Jun 27 04:13:25.530921 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:25.534147 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533605.5324314, fc6a44e4-6a27-4d30-ab01-80374403846a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:25.534147 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] VM Resumed (Lifecycle Event)
Jun 27 04:13:25.538933 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Took 13.31 seconds to build instance.
Jun 27 04:13:26.040507 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:26.042022 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69fcf77f-42bb-4ebc-861f-1c52b8aa77cf tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.825s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:26.045597 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:26.831227 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:26.831958 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:26.832309 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:13:27.731200 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:27.731686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:28.233834 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:13:28.830562 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:28.831777 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:13:28.836360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:28.836933 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:28.842268 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:13:28.842690 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Claim successful on node np0000003830
Jun 27 04:13:29.378673 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:29.830296 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:29.830473 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:13:29.830712 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:30.144524 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:30.173065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:13:30.173435 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:13:30.335396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:30.682285 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:13:31.195847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.359s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:31.196357 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:13:31.200033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.864s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:31.200033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:31.202107 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:13:31.703747 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:13:31.704047 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:13:31.704382 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:31.704830 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:31.809715 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39149bed2f8346c28e7bb800cadc9b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3565ea3785de40f985397aa1d9254b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:13:32.215000 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:13:32.260652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:32.315706 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Successfully created port: 9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:13:32.387204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:32.388577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:32.508663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:32.509583 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:13:32.517293 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:32.641885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:32.642406 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:32.723121 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:13:32.750458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:32.758543 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:32.874152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:32.874746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:32.986425 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:32.990259 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:13:32.993097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:33.046720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:33.046720 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50763MB free_disk=73.40068817138672GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:13:33.046720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:33.046720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:33.105697 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Successfully updated port: 9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:13:33.172715 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Received event network-changed-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:33.173269 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Refreshing instance network info cache due to event network-changed-9aac016f-dada-49c3-b2af-6e90cc1e39a0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:13:33.173269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] Acquiring lock "refresh_cache-c706e2d7-9f1f-46dc-84b5-f0ead4542d24" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:33.173458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] Acquired lock "refresh_cache-c706e2d7-9f1f-46dc-84b5-f0ead4542d24" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:33.173458 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Refreshing network info cache for port 9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:13:33.608199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "refresh_cache-c706e2d7-9f1f-46dc-84b5-f0ead4542d24" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:33.675884 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:33.742144 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:13:33.743851 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:13:33.743962 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Creating image(s)
Jun 27 04:13:33.745240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "/opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:33.749643 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "/opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:33.751380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "/opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:33.752630 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:33.757900 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:33.758251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:33.783357 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:33.874537 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:33.877581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:33.877581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:33.877581 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:33.879149 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:33.879620 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:33.991344 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:33.993108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.113s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:33.993664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:34.060315 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk 1073741824" returned: 0 in 0.066s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:34.060756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:34.061049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:34.152196 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:34.154521 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:13:34.155291 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:13:34.155457 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e1cb21b7-7354-467e-b189-0696fa5444f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:13:34.155898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:34.156082 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance fc6a44e4-6a27-4d30-ab01-80374403846a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:13:34.156227 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c706e2d7-9f1f-46dc-84b5-f0ead4542d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:13:34.156446 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:13:34.156830 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:13:33 up 36 min,  2 users,  load average: 9.71, 9.29, 5.70\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_ef6a6b08a14849038c79ff273d34be3f': '1', 'io_workload': '1', 'num_proj_72fed82034484f13a228c535b175c167': '1', 'num_proj_3565ea3785de40f985397aa1d9254b99': '2', 'num_vm_building': '1', 'num_task_block_device_mapping': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:13:34.266209 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:34.266672 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Cannot resize image /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:13:34.267100 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:13:34.267315 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Ensure instance console log exists: /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:13:34.267751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:34.268199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:34.268199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:34.382089 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:34.509613 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:13:34.509903 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:13:34.517331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ff921c77-5469-41c5-a456-a9e114c91f68 req-858224ce-de32-41aa-a26b-0d55b410fec0 service nova] Releasing lock "refresh_cache-c706e2d7-9f1f-46dc-84b5-f0ead4542d24" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:34.518631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquired lock "refresh_cache-c706e2d7-9f1f-46dc-84b5-f0ead4542d24" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:34.518949 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:13:35.014061 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:13:35.114744 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:35.149171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:35.301894 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:35.464079 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Updating instance_info_cache with network_info: [{"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:35.527759 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:13:35.527967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.482s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:35.528350 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:13:35.966633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Releasing lock "refresh_cache-c706e2d7-9f1f-46dc-84b5-f0ead4542d24" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:35.967127 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Instance network_info: |[{"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:13:35.971275 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Start _get_guest_xml network_info=[{"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:13:35.977133 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:13:35.978925 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1197978709', uuid='c706e2d7-9f1f-46dc-84b5-f0ead4542d24'), owner=OwnerMeta(userid='39149bed2f8346c28e7bb800cadc9b7a', username='tempest-ServersNegativeTestJSON-1704939525-project-member', projectid='3565ea3785de40f985397aa1d9254b99', projectname='tempest-ServersNegativeTestJSON-1704939525'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533615.978439) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:13:35.981965 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:13:35.981965 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:13:35.983982 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:13:35.984355 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:13:35.985453 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:13:35.985906 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:13:35.986086 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:13:35.986209 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:13:35.986421 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:13:35.987377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:13:35.987377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:13:35.987377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:13:35.987377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:13:35.987377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:13:35.987377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:13:35.987965 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:13:36.005884 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1197978709',display_name='tempest-ServersNegativeTestJSON-server-1197978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serversnegativetestjson-server-1197978709',id=40,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3565ea3785de40f985397aa1d9254b99',ramdisk_id='',reservation_id='r-5t1oe4vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1704939525',owner_user_name='tempest-ServersNegativeTestJSON-1704939525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:33Z,user_data=None,user_id='39149bed2f8346c28e7bb800cadc9b7a',uuid=c706e2d7-9f1f-46dc-84b5-f0ead4542d24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:13:36.005884 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converting VIF {"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:36.007444 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:36.010016 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lazy-loading 'pci_devices' on Instance uuid c706e2d7-9f1f-46dc-84b5-f0ead4542d24 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <uuid>c706e2d7-9f1f-46dc-84b5-f0ead4542d24</uuid>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <name>instance-00000028</name>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:name>tempest-ServersNegativeTestJSON-server-1197978709</nova:name>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:13:35</nova:creationTime>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:user uuid="39149bed2f8346c28e7bb800cadc9b7a">tempest-ServersNegativeTestJSON-1704939525-project-member</nova:user>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:project uuid="3565ea3785de40f985397aa1d9254b99">tempest-ServersNegativeTestJSON-1704939525</nova:project>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         <nova:port uuid="9aac016f-dada-49c3-b2af-6e90cc1e39a0">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <entry name="serial">c706e2d7-9f1f-46dc-84b5-f0ead4542d24</entry>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <entry name="uuid">c706e2d7-9f1f-46dc-84b5-f0ead4542d24</entry>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.config"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:82:62:58"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <target dev="tap9aac016f-da"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/console.log" append="off"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:13:36.512938 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Preparing to wait for external event network-vif-plugged-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1197978709',display_name='tempest-ServersNegativeTestJSON-server-1197978709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serversnegativetestjson-server-1197978709',id=40,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3565ea3785de40f985397aa1d9254b99',ramdisk_id='',reservation_id='r-5t1oe4vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1704939525',owner_user_name='tempest-ServersNegativeTestJSON-1704939525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:33Z,user_data=None,user_id='39149bed2f8346c28e7bb800cadc9b7a',uuid=c706e2d7-9f1f-46dc-84b5-f0ead4542d24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converting VIF {"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.516405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:36.517111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:13:36.517395 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.517938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea9b2aab-b0e9-5659-a3fe-831baa84c771', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:36.518646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.519419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:36.520464 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.522939 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.523164 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aac016f-da, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:36.523516 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9aac016f-da, col_values=(('qos', UUID('d65b039b-5354-4308-a34c-dbe3a05a9a60')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:36.523853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9aac016f-da, col_values=(('external_ids', {'iface-id': '9aac016f-dada-49c3-b2af-6e90cc1e39a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:62:58', 'vm-uuid': 'c706e2d7-9f1f-46dc-84b5-f0ead4542d24'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:36.524466 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:36.524856 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.525215 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:36.527066 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:36.527341 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:36.527688 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:13:36.528001 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.30 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:13:36.532223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:36.534950 np0000003830 nova-compute[98984]: INFO os_vif [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da')
Jun 27 04:13:37.245533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:38.060793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:38.060793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:38.060793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] No VIF found with MAC fa:16:3e:82:62:58, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:13:38.060793 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Using config drive
Jun 27 04:13:38.567352 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:38.732075 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Creating config drive at /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.config
Jun 27 04:13:38.736116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpufv2anss {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:38.805192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpufv2anss" returned: 0 in 0.068s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:39.216027 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:39.348943 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:39.380252 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:39.384834 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:39.521235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:39.592722 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:39.594234 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:40.506054 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533620.5054538, c706e2d7-9f1f-46dc-84b5-f0ead4542d24 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:40.506746 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] VM Started (Lifecycle Event)
Jun 27 04:13:41.016715 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:41.020450 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533621.0201752, c706e2d7-9f1f-46dc-84b5-f0ead4542d24 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:41.021562 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] VM Paused (Lifecycle Event)
Jun 27 04:13:41.525062 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:41.525727 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:41.530994 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:42.036647 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:13:43.216441 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:44.389827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:46.196045 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b3551f6e-900e-412d-bcfe-dcc6ab92e7a5 req-eea9ec48-7c55-45f8-97bb-698e5dc4beae service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Received event network-vif-plugged-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:46.196700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b3551f6e-900e-412d-bcfe-dcc6ab92e7a5 req-eea9ec48-7c55-45f8-97bb-698e5dc4beae service nova] Acquiring lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:46.196903 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b3551f6e-900e-412d-bcfe-dcc6ab92e7a5 req-eea9ec48-7c55-45f8-97bb-698e5dc4beae service nova] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:46.197083 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b3551f6e-900e-412d-bcfe-dcc6ab92e7a5 req-eea9ec48-7c55-45f8-97bb-698e5dc4beae service nova] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:46.197234 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b3551f6e-900e-412d-bcfe-dcc6ab92e7a5 req-eea9ec48-7c55-45f8-97bb-698e5dc4beae service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Processing event network-vif-plugged-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:13:46.197895 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:13:46.202609 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533626.2022882, c706e2d7-9f1f-46dc-84b5-f0ead4542d24 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:13:46.202754 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] VM Resumed (Lifecycle Event)
Jun 27 04:13:46.204152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:13:46.206849 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Instance spawned successfully.
Jun 27 04:13:46.207183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:13:46.535819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:46.635982 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:46.636140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:46.706408 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:46.710639 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:13:46.718420 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:46.718615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:46.719005 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:46.719259 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:46.719578 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:46.719779 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:13:47.004471 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:13:47.141576 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:47.213674 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:13:47.226644 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Took 13.48 seconds to spawn the instance on the hypervisor.
Jun 27 04:13:47.227115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:13:47.228097 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:47.739009 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Took 19.00 seconds to build instance.
Jun 27 04:13:48.145839 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:48.241299 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:48.291489 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0bf2cbb9-3626-46e8-ae4f-4a245a9ae952 req-c0be3bb0-7fa7-4a1e-b524-bde11816fcd6 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Received event network-vif-plugged-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:48.293370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0bf2cbb9-3626-46e8-ae4f-4a245a9ae952 req-c0be3bb0-7fa7-4a1e-b524-bde11816fcd6 service nova] Acquiring lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:48.298548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0bf2cbb9-3626-46e8-ae4f-4a245a9ae952 req-c0be3bb0-7fa7-4a1e-b524-bde11816fcd6 service nova] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:48.298548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0bf2cbb9-3626-46e8-ae4f-4a245a9ae952 req-c0be3bb0-7fa7-4a1e-b524-bde11816fcd6 service nova] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:48.298548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0bf2cbb9-3626-46e8-ae4f-4a245a9ae952 req-c0be3bb0-7fa7-4a1e-b524-bde11816fcd6 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] No waiting events found dispatching network-vif-plugged-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:13:48.298548 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-0bf2cbb9-3626-46e8-ae4f-4a245a9ae952 req-c0be3bb0-7fa7-4a1e-b524-bde11816fcd6 service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Received unexpected event network-vif-plugged-9aac016f-dada-49c3-b2af-6e90cc1e39a0 for instance with vm_state active and task_state None.
Jun 27 04:13:49.053300 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:49.053517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:49.053701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:49.053834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:49.053950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:49.060547 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Terminating instance
Jun 27 04:13:49.240665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:49.240871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:49.241133 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attaching volume 83d37273-15fb-4b05-8fbc-58822fb8cd9b to /dev/vdb
Jun 27 04:13:49.304623 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:13:49.319285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:13:49.343386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:49.385422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:13:49.386355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:13:49.392277 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.395172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:13:49.397516 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe30:9702', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fe06:8cf2', 'fe80::80f0:94ff:feae:c312', 'fe80::fc16:3eff:fec4:d063', 'fe80::3ce8:6dff:fe1b:cebf', 'fe80::fc16:3eff:fe82:6258'] 
Jun 27 04:13:49.397516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:13:49.397516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:13:49.397516 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:13:49.397516 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updating existing volume attachment record: 6bf5e159-cb89-4fbc-8dc0-75c38576a183 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:13:49.566029 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:13:49.588348 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.591949 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.615712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.762347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.768766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.875055 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.884541 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:49.910295 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999634642999808 future=<Future at 0x7ec53afec050 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:49.911228 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998952860999907 future=<Future at 0x7ec53afec050 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:49.911228 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998721861999911 future=<Future at 0x7ec53afec050 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:13:49.916153 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Instance destroyed successfully.
Jun 27 04:13:49.916927 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lazy-loading 'resources' on Instance uuid c706e2d7-9f1f-46dc-84b5-f0ead4542d24 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:49.968140 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:13:49.968452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:13:49.968649 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:50.420589 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1197978709',display_name='tempest-ServersNegativeTestJSON-server-1197978709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serversnegativetestjson-server-1197978709',id=40,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:13:47Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3565ea3785de40f985397aa1d9254b99',ramdisk_id='',reservation_id='r-5t1oe4vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1704939525',owner_user_name='tempest-ServersNegativeTestJSON-1704939525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:13:47Z,user_data=None,user_id='39149bed2f8346c28e7bb800cadc9b7a',uuid=c706e2d7-9f1f-46dc-84b5-f0ead4542d24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:13:50.421058 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converting VIF {"id": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "address": "fa:16:3e:82:62:58", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aac016f-da", "ovs_interfaceid": "9aac016f-dada-49c3-b2af-6e90cc1e39a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:50.421435 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:50.421694 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:13:50.424987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:50.425285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aac016f-da, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:50.426411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:50.427826 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:50.428766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:50.428927 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d65b039b-5354-4308-a34c-dbe3a05a9a60) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:50.429381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:50.430760 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:50.432543 np0000003830 nova-compute[98984]: INFO os_vif [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:62:58,bridge_name='br-int',has_traffic_filtering=True,id=9aac016f-dada-49c3-b2af-6e90cc1e39a0,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aac016f-da')
Jun 27 04:13:50.432860 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Deleting instance files /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24_del
Jun 27 04:13:50.433687 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Deletion of /opt/stack/data/nova/instances/c706e2d7-9f1f-46dc-84b5-f0ead4542d24_del complete
Jun 27 04:13:50.474923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:50.475108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:50.939919 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 27 04:13:50.940996 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:13:50.941318 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:13:50.941449 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:13:50.941760 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:50.977451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:13:51.023219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.054s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:51.023578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:13:51.035332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:51.036020 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:51.036704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:51.036926 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:13:51.037381 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:51.037753 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:13:51.049583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:13:51.049583 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:51.055787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:13:51.055787 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:51.062080 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b] added
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:51.063968 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:51.064229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:13:51.064428 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:13:51.064625 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b] added
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:13:51.066349 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:51.066562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:13:51.066785 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:13:51.066943 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:13:51.443770 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c1e4a50d-407f-4568-82a7-deec53b6b93f req-3591d2b5-97be-4224-a3a2-43552a92d3cc service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Received event network-vif-deleted-9aac016f-dada-49c3-b2af-6e90cc1e39a0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:51.444375 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-c1e4a50d-407f-4568-82a7-deec53b6b93f req-3591d2b5-97be-4224-a3a2-43552a92d3cc service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Neutron deleted interface 9aac016f-dada-49c3-b2af-6e90cc1e39a0; detaching it from the instance and deleting it from the info cache
Jun 27 04:13:51.447382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c1e4a50d-407f-4568-82a7-deec53b6b93f req-3591d2b5-97be-4224-a3a2-43552a92d3cc service nova] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Detach interface failed, port_id=9aac016f-dada-49c3-b2af-6e90cc1e39a0, reason: Instance c706e2d7-9f1f-46dc-84b5-f0ead4542d24 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:13:51.565087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:51.565361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:51.569278 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:13:51.569672 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Claim successful on node np0000003830
Jun 27 04:13:51.869073 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:52.065077 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:13:52.067943 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:13:52.079478 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:13:52.086638 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.092711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.102906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.108266 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.108634 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.123916 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.124214 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:52.150117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.40.100,3260]
Jun 27 04:13:52.150117 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.40.100,3260] successful.
Jun 27 04:13:52.150117 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.163357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.173969 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.50.100,3260]
Jun 27 04:13:52.173969 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.50.100,3260] successful.
Jun 27 04:13:52.173969 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.187687 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.188033 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:52.188254 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:52.188420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:13:52.189132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:52.190580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('13', '-', '-', 0) found on session 97 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:13:52.190717 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-352bfa7f-a831-43d1-a35d-3e95ebf0b3cb (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba464188-ec73-4251-9629-e89bdb143871 (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:52.207176 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:52.207883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:52.207883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:13:52.209038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('14', '-', '-', 0) found on session 98 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:13:52.209038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:13:52.215601 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 97 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:13:52.219690 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:13:52.233798 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 98 and hctl ['14', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:13:52.370996 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Took 1.43 seconds to deallocate network for instance.
Jun 27 04:13:52.878887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:52.880273 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:13:52.880552 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:13:53.208510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:53.226417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 98 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:13:53.226417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:13:53.383939 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:13:53.488275 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:53.488808 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing instance network info cache due to event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:13:53.488985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:53.489256 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:53.489256 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:13:53.894879 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.329s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:53.895849 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.016s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:53.896172 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:13:53.991603 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:54.055365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found WWN 33000000083007b16 for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:13:54.055668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:54.055964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== connect_volume: return (4087ms) {'type': 'block', 'scsi_wwn': '33000000083007b16', 'path': '/dev/dm-2', 'multipath_id': '33000000083007b16'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:13:54.055964 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000083007b16', 'path': '/dev/dm-2', 'multipath_id': '33000000083007b16'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:13:54.064539 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:54.263649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:13:54.263917 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:13:54.374121 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:54.395991 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:54.404880 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:13:54.405081 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:13:54.405335 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:54.405615 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:54.503691 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a2a8189b804630997728bfb949fba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c1eb5f65f0446eae1f4967af349cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:13:54.533844 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updated VIF entry in instance network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:13:54.534275 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:54.573048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attempting to attach volume 83d37273-15fb-4b05-8fbc-58822fb8cd9b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]:   <alias name="ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b"/>
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]:   <serial>83d37273-15fb-4b05-8fbc-58822fb8cd9b</serial>
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:13:54.577595 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:13:54.693673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:54.693875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:54.769801 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:13:54.908147 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:13:55.036698 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9ffb1365-eea2-4c6a-84ff-4836807536b1 req-fead91f9-3f66-4e5f-9576-280a4da92907 service nova] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:55.199004 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Detaching volume 9f2b1cd9-65b3-43d8-8856-3b134d71049e
Jun 27 04:13:55.264284 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Attempting to driver detach volume 9f2b1cd9-65b3-43d8-8856-3b134d71049e from mountpoint /dev/vdb
Jun 27 04:13:55.274423 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found disk vdb by alias ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:13:55.276226 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found disk vdb by alias ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:13:55.276374 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Attempting to detach device vdb from instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:   <alias name="ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e"/>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:   <serial>9f2b1cd9-65b3-43d8-8856-3b134d71049e</serial>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:13:55.276949 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:13:55.279169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.383s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:55.301926 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully detached device vdb from instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b from the persistent domain config.
Jun 27 04:13:55.302102 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] (1/8): Attempting to detach device vdb with device alias ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e from instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:   <alias name="ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e"/>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:   <serial>9f2b1cd9-65b3-43d8-8856-3b134d71049e</serial>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:13:55.302448 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:13:55.333961 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Successfully created port: 2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:13:55.342676 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Deleted allocations for instance c706e2d7-9f1f-46dc-84b5-f0ead4542d24
Jun 27 04:13:55.411738 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:13:55.430747 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:55.580678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:55.580839 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing instance network info cache due to event network-changed-e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:13:55.580976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] Acquiring lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:55.581321 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] Acquired lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:55.581604 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Refreshing network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:13:55.820183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533635.8198335, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:13:55.821568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9f2b1cd9-65b3-43d8-8856-3b134d71049e for instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:13:55.826285 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully detached device vdb from instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b from the live domain config.
Jun 27 04:13:55.827394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:13:55.827560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:13:55.827682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:13:55.827985 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:13:55.828268 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f2b1cd9-65b3-43d8-8856-3b134d71049e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:13:55.828424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:13:55.860486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:55.860486 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:55.860486 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:55.860486 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:55.860486 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:55.860486 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e (non-flash)
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1 (non-flash)
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-287bbe74-0f79-43d5-ab80-d22f4560a7b1', '94'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', '98')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:13:55.860864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '89')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:13:55.861790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e', '88')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:13:55.862549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5384676a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:13:55.862720 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:13:55.863007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flush multipath device 3300000007fb87ae2 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:13:55.900930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:13:55.950680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:13:55.978851 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Successfully updated port: 2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:13:56.007353 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:13:56.007549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:13:56.008450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:13:56.019228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:13:56.019549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:13:56.030040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:56.033840 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-changed-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:13:56.033979 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Refreshing instance network info cache due to event network-changed-2f7efb1a-130e-45dd-b077-127b3da195c7. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:13:56.034121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] Acquiring lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:56.034212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] Acquired lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:56.034302 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Refreshing network info cache for port 2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:13:56.064508 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260]
Jun 27 04:13:56.064508 np0000003830 nova-compute[98984]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.40.100,3260] successful.
Jun 27 04:13:56.064508 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:56.077711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:56.083597 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:56.086854 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:56.118273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260]
Jun 27 04:13:56.118273 np0000003830 nova-compute[98984]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-9f2b1cd9-65b3-43d8-8856-3b134d71049e, portal: 192.168.50.100,3260] successful.
Jun 27 04:13:56.118273 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:56.131905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:13:56.132068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:13:56.132242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== disconnect_volume: return (304ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:13:56.132392 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:13:56.269043 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:56.269198 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:56.269329 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:13:56.269489 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:30:97:02, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:13:56.355187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cd52480f-345c-4a1c-81ab-984abd06c11f tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "c706e2d7-9f1f-46dc-84b5-f0ead4542d24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.302s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:56.406381 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:56.421553 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:13:56.422558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:13:56.422784 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Creating image(s)
Jun 27 04:13:56.423202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "/opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:56.423340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:56.423924 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:56.424532 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:56.427154 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:56.428274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:56.481470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:13:56.515696 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:56.516136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:56.516550 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:56.517028 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:56.520461 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:13:56.520842 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:56.540892 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:56.608356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:56.608930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:56.635694 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updated VIF entry in instance network info cache for port e16fd2c7-f6ff-473f-abbf-989f993f285c. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:13:56.636955 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [{"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:56.645866 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:56.689137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk 1073741824" returned: 0 in 0.080s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:56.692520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:56.692520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:56.726740 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'flavor' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:56.784708 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:56.788515 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:13:56.788515 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:13:56.881519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:13:56.883152 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Cannot resize image /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:13:56.883152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:13:56.883152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Ensure instance console log exists: /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:13:56.883690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:56.884071 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:56.884375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:56.983663 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:57.150302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7cae7e38-d4a7-4dad-8bcb-cb5bcf0067a1 req-9f7c98d8-7afd-4ef5-9974-009848d43d3e service nova] Releasing lock "refresh_cache-7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:57.486474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0a3c3855-6ed5-407c-a946-4d01ddc21416 req-072eb747-5d60-4846-9c20-6ef64fb1840f service nova] Releasing lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:57.487349 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:13:57.488962 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:13:57.740470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-60a0de17-7ae3-4a20-8704-91af3a0b5780 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.046s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:57.872166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59574215-87e3-4c3a-89fd-0286f4b6b03d tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.631s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:58.069400 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:13:58.238099 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:13:58.387911 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Updating instance_info_cache with network_info: [{"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:13:58.890751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:13:58.890751 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Instance network_info: |[{"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:13:58.894063 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Start _get_guest_xml network_info=[{"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:13:58.898609 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:13:58.900315 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1430360511', uuid='369f807f-1f9c-4c3a-b2d4-28e28f697c6c'), owner=OwnerMeta(userid='c0a2a8189b804630997728bfb949fba1', username='tempest-TestEncryptedCinderVolumes-1777393507-project-member', projectid='56c1eb5f65f0446eae1f4967af349cd1', projectname='tempest-TestEncryptedCinderVolumes-1777393507'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533638.8987331) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:13:58.902778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:13:58.902778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:13:58.903645 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:13:58.904952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:13:58.904952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:13:58.905707 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:13:58.905707 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:13:58.905707 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:13:58.905922 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:13:58.905922 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:13:58.906386 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:13:58.906386 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:13:58.906386 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:13:58.906386 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:13:58.906835 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:13:58.906835 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:13:58.923077 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1430360511',display_name='tempest-TestEncryptedCinderVolumes-server-1430360511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1430360511',id=41,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6YRMst/9RKz8EyOaIiB+mBEO4fn3TZxC0AWnrJ7zlkHB6pkKFx2v7S1MJOwlABFoE2PzPm+l0AH2bjZ14m6hS8xzM+S2excHG2SHvlmimz0zeglKqcNlLVhoKr70M4Jg==',key_name='tempest-keypair-128199564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-kq0fygfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=369f807f-1f9c-4c3a-b2d4-28e28f697c6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:13:58.923276 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:58.924000 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:58.924656 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'pci_devices' on Instance uuid 369f807f-1f9c-4c3a-b2d4-28e28f697c6c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:59.155943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:59.156314 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:59.355435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:59.355655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:59.355844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:59.355986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:59.356136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:59.359866 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Terminating instance
Jun 27 04:13:59.396011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <uuid>369f807f-1f9c-4c3a-b2d4-28e28f697c6c</uuid>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <name>instance-00000029</name>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1430360511</nova:name>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:13:58</nova:creationTime>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:user uuid="c0a2a8189b804630997728bfb949fba1">tempest-TestEncryptedCinderVolumes-1777393507-project-member</nova:user>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:project uuid="56c1eb5f65f0446eae1f4967af349cd1">tempest-TestEncryptedCinderVolumes-1777393507</nova:project>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         <nova:port uuid="2f7efb1a-130e-45dd-b077-127b3da195c7">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <entry name="serial">369f807f-1f9c-4c3a-b2d4-28e28f697c6c</entry>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <entry name="uuid">369f807f-1f9c-4c3a-b2d4-28e28f697c6c</entry>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.config"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d6:d5:67"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <target dev="tap2f7efb1a-13"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/console.log" append="off"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:13:59.427803 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Preparing to wait for external event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1430360511',display_name='tempest-TestEncryptedCinderVolumes-server-1430360511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1430360511',id=41,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6YRMst/9RKz8EyOaIiB+mBEO4fn3TZxC0AWnrJ7zlkHB6pkKFx2v7S1MJOwlABFoE2PzPm+l0AH2bjZ14m6hS8xzM+S2excHG2SHvlmimz0zeglKqcNlLVhoKr70M4Jg==',key_name='tempest-keypair-128199564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-kq0fygfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=369f807f-1f9c-4c3a-b2d4-28e28f697c6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.433891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f535260-5235-5289-9050-5cc03a82adfa', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:59.434937 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.436452 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:59.438874 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.439111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f7efb1a-13, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:59.439653 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f7efb1a-13, col_values=(('qos', UUID('c8adf60e-5863-4d71-83d6-57c9e519089a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:59.439883 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f7efb1a-13, col_values=(('external_ids', {'iface-id': '2f7efb1a-130e-45dd-b077-127b3da195c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d5:67', 'vm-uuid': '369f807f-1f9c-4c3a-b2d4-28e28f697c6c'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:13:59.442520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.444074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:13:59.450222 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.451485 np0000003830 nova-compute[98984]: INFO os_vif [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13')
Jun 27 04:13:59.659872 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:13:59.864088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:13:59.891840 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.893750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.912962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.918766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.940630 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:13:59.949440 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.066394 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0d4eb7b7-300d-4d10-bd9f-5e0a2ae2216c req-51a47426-1f07-4496-8ab1-9458660c4e22 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:00.066858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0d4eb7b7-300d-4d10-bd9f-5e0a2ae2216c req-51a47426-1f07-4496-8ab1-9458660c4e22 service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:00.068058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0d4eb7b7-300d-4d10-bd9f-5e0a2ae2216c req-51a47426-1f07-4496-8ab1-9458660c4e22 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:00.068058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0d4eb7b7-300d-4d10-bd9f-5e0a2ae2216c req-51a47426-1f07-4496-8ab1-9458660c4e22 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:00.068286 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0d4eb7b7-300d-4d10-bd9f-5e0a2ae2216c req-51a47426-1f07-4496-8ab1-9458660c4e22 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:00.068548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0d4eb7b7-300d-4d10-bd9f-5e0a2ae2216c req-51a47426-1f07-4496-8ab1-9458660c4e22 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:14:00.210014 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999687631999677 future=<Future at 0x7ec5183454f0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:00.211806 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Instance destroyed successfully.
Jun 27 04:14:00.212144 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'resources' on Instance uuid 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:00.665126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:00.716790 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1674285695',display_name='tempest-TestMinimumBasicScenario-server-1674285695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1674285695',id=37,image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgum/gIYxMDwJRllTP2re+g6juLUdaKsjIBtLjj/vhSmgumtf+9sVssRINNmjajkhDItVllQdfCF1coq5cKGTOSRLuhpQXPQZcNhNfT45XvB+bz7Gr0woIXPVFo2yV4nA==',key_name='tempest-TestMinimumBasicScenario-921440636',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:12:24Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-bwl80gc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0b794a1c-a528-4c36-a812-29377cdc843e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:13:15Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=7a9c24d6-f85f-4fbf-9f00-33a8f029e43b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:14:00.717040 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "address": "fa:16:3e:06:8c:f2", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16fd2c7-f6", "ovs_interfaceid": "e16fd2c7-f6ff-473f-abbf-989f993f285c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:00.717761 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:00.717980 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:14:00.719273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.719487 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape16fd2c7-f6, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:00.720929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.722131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:00.726679 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.727520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.727691 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e64ba91b-4e22-439d-a1c5-4eec6606ff59) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:00.728194 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.728726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:00.734921 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:00.736862 np0000003830 nova-compute[98984]: INFO os_vif [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:8c:f2,bridge_name='br-int',has_traffic_filtering=True,id=e16fd2c7-f6ff-473f-abbf-989f993f285c,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16fd2c7-f6')
Jun 27 04:14:00.738553 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Deleting instance files /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b_del
Jun 27 04:14:00.738553 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Deletion of /opt/stack/data/nova/instances/7a9c24d6-f85f-4fbf-9f00-33a8f029e43b_del complete
Jun 27 04:14:00.985144 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:00.985369 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:00.986645 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:d6:d5:67, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:00.986645 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Using config drive
Jun 27 04:14:01.266461 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Took 1.40 seconds to destroy the instance on the hypervisor.
Jun 27 04:14:01.267179 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:14:01.267429 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:14:01.267533 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:14:01.267721 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:01.367260 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:01.493517 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:01.647280 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Creating config drive at /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.config
Jun 27 04:14:01.658317 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzdi8q8in {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:01.708815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzdi8q8in" returned: 0 in 0.061s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:01.786435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-92670c95-f4f3-4d80-b383-101df26d8fbe req-9379a024-65f9-4dc2-99a4-ddaec0c8153d service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-deleted-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:01.786680 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-92670c95-f4f3-4d80-b383-101df26d8fbe req-9379a024-65f9-4dc2-99a4-ddaec0c8153d service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Neutron deleted interface e16fd2c7-f6ff-473f-abbf-989f993f285c; detaching it from the instance and deleting it from the info cache
Jun 27 04:14:01.788963 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-92670c95-f4f3-4d80-b383-101df26d8fbe req-9379a024-65f9-4dc2-99a4-ddaec0c8153d service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Detach interface failed, port_id=e16fd2c7-f6ff-473f-abbf-989f993f285c, reason: Instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:14:01.834732 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:01.834958 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:01.835151 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attaching volume e6d28272-fb64-434f-b669-c12d15f41609 to /dev/vdc
Jun 27 04:14:01.934513 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:01.948242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:14:01.973204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:02.024359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:14:02.024715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:14:02.039984 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:14:02.041369 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe30:9702', 'fe80::435:f5ff:fe42:a84c', 'fe80::fc16:3eff:fec4:d063', 'fe80::3ce8:6dff:fe1b:cebf'] 
Jun 27 04:14:02.041538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:14:02.041827 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:14:02.041927 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:02.042350 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updating existing volume attachment record: 266cd15f-3ce6-47e1-bb6e-6bb944d75519 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:14:02.130053 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-979c3f6d-00d8-48a2-81fd-63174c7bdb88 req-98960826-bb52-4dae-b3c5-75008d3ff3b8 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:02.130273 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-979c3f6d-00d8-48a2-81fd-63174c7bdb88 req-98960826-bb52-4dae-b3c5-75008d3ff3b8 service nova] Acquiring lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:02.130516 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-979c3f6d-00d8-48a2-81fd-63174c7bdb88 req-98960826-bb52-4dae-b3c5-75008d3ff3b8 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:02.130863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-979c3f6d-00d8-48a2-81fd-63174c7bdb88 req-98960826-bb52-4dae-b3c5-75008d3ff3b8 service nova] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:02.131014 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-979c3f6d-00d8-48a2-81fd-63174c7bdb88 req-98960826-bb52-4dae-b3c5-75008d3ff3b8 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] No waiting events found dispatching network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:02.131103 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-979c3f6d-00d8-48a2-81fd-63174c7bdb88 req-98960826-bb52-4dae-b3c5-75008d3ff3b8 service nova] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Received event network-vif-unplugged-e16fd2c7-f6ff-473f-abbf-989f993f285c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:14:02.193994 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:02.201530 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.227563 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.330428 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.457844 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e524fa76-851b-4562-8619-ac5a9cbfe2ab req-1f5c8d01-47b8-4415-bd47-7d79218bf7f4 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:02.458097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e524fa76-851b-4562-8619-ac5a9cbfe2ab req-1f5c8d01-47b8-4415-bd47-7d79218bf7f4 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:02.458318 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e524fa76-851b-4562-8619-ac5a9cbfe2ab req-1f5c8d01-47b8-4415-bd47-7d79218bf7f4 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:02.458750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e524fa76-851b-4562-8619-ac5a9cbfe2ab req-1f5c8d01-47b8-4415-bd47-7d79218bf7f4 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:02.458750 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e524fa76-851b-4562-8619-ac5a9cbfe2ab req-1f5c8d01-47b8-4415-bd47-7d79218bf7f4 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Processing event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:14:02.597511 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.600252 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.602211 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.603654 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.616474 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:14:02.616883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d28272-fb64-434f-b669-c12d15f41609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:02.616983 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:02.617321 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:02.617578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d28272-fb64-434f-b669-c12d15f41609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:14:02.630762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:02.632533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:02.633926 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:02.635084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:02.635474 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:14:02.636040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:02.636275 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:14:02.649298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:14:02.649298 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:02.650122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:14:02.650122 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609] added
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:02.660906 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:02.661684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:14:02.661684 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:14:02.661883 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609] added
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:02.665662 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:02.666048 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:14:02.666094 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:14:02.666289 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:14:02.702555 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Took 1.43 seconds to deallocate network for instance.
Jun 27 04:14:03.044741 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533643.044284, 369f807f-1f9c-4c3a-b2d4-28e28f697c6c => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:03.045326 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:14:03.046162 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] VM Started (Lifecycle Event)
Jun 27 04:14:03.047756 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:14:03.050028 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Instance spawned successfully.
Jun 27 04:14:03.050385 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:14:03.210895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:03.211090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:03.502762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:03.503244 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:03.548471 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:03.550934 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:03.558057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:03.558057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:03.558221 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:03.558786 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:03.558905 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:03.559344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:03.662790 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:14:03.666714 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:14:03.677758 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:14:03.682580 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.690422 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.695819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.704058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.704058 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.704058 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:03.704320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.704320 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.704320 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:03.710859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.710859 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.710859 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:03.711103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.711103 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.711103 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:03.745994 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.50.100,3260]
Jun 27 04:14:03.745994 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.50.100,3260] successful.
Jun 27 04:14:03.745994 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.762467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.768629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.40.100,3260]
Jun 27 04:14:03.768629 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.40.100,3260] successful.
Jun 27 04:14:03.768629 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('7', '-', '-', 0) found on session 99 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:14:03.778526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:14:03.783343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:03.796689 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 99 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:03.796689 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6d28272-fb64-434f-b669-c12d15f41609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:03.805849 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:03.806157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:03.806157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:14:03.807148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] HCTL ('8', '-', '-', 0) found on session 100 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:14:03.807148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:14:03.823431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Searching for a device in session 100 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:03.823431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d28272-fb64-434f-b669-c12d15f41609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:14:04.005967 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:04.056937 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:14:04.057322 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533644.0570543, 369f807f-1f9c-4c3a-b2d4-28e28f697c6c => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:04.057451 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] VM Paused (Lifecycle Event)
Jun 27 04:14:04.065229 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Took 7.64 seconds to spawn the instance on the hypervisor.
Jun 27 04:14:04.065487 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:04.081194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:04.081471 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:04.081740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:04.081946 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:04.082109 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:04.085140 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Terminating instance
Jun 27 04:14:04.397695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:04.512706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.301s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:04.519892 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-98703ffd-4b56-4dce-9613-02def08605fd req-2a3516d4-95c0-4001-8e80-a871ba0566a6 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:04.520062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-98703ffd-4b56-4dce-9613-02def08605fd req-2a3516d4-95c0-4001-8e80-a871ba0566a6 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:04.520339 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-98703ffd-4b56-4dce-9613-02def08605fd req-2a3516d4-95c0-4001-8e80-a871ba0566a6 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:04.520452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-98703ffd-4b56-4dce-9613-02def08605fd req-2a3516d4-95c0-4001-8e80-a871ba0566a6 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:04.520904 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-98703ffd-4b56-4dce-9613-02def08605fd req-2a3516d4-95c0-4001-8e80-a871ba0566a6 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:04.520904 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-98703ffd-4b56-4dce-9613-02def08605fd req-2a3516d4-95c0-4001-8e80-a871ba0566a6 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received unexpected event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with vm_state active and task_state None.
Jun 27 04:14:04.559775 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:04.563828 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533644.5635664, 369f807f-1f9c-4c3a-b2d4-28e28f697c6c => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:04.564022 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] VM Resumed (Lifecycle Event)
Jun 27 04:14:04.568869 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Deleted allocations for instance 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b
Jun 27 04:14:04.575573 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Took 13.09 seconds to build instance.
Jun 27 04:14:04.588446 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:14:04.610007 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:04.611312 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:04.633069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:14:04.640658 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:04.648858 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:04.678035 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:04.815215 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88226360-9885-4d84-b204-65185267b0ba req-80357740-a47d-4018-b35c-ec07c91cfe83 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-unplugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:04.815423 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88226360-9885-4d84-b204-65185267b0ba req-80357740-a47d-4018-b35c-ec07c91cfe83 service nova] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:04.815612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88226360-9885-4d84-b204-65185267b0ba req-80357740-a47d-4018-b35c-ec07c91cfe83 service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:04.815731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-88226360-9885-4d84-b204-65185267b0ba req-80357740-a47d-4018-b35c-ec07c91cfe83 service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:04.815843 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88226360-9885-4d84-b204-65185267b0ba req-80357740-a47d-4018-b35c-ec07c91cfe83 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] No waiting events found dispatching network-vif-unplugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:04.815984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-88226360-9885-4d84-b204-65185267b0ba req-80357740-a47d-4018-b35c-ec07c91cfe83 service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-unplugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:14:04.911528 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005094660000395379 future=<Future at 0x7ec53afec050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:04.911528 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:04.911528 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=10.298913468999672 future=<Future at 0x7ec5183454f0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:04.911528 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=10.29881020699986 future=<Future at 0x7ec5183454f0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:04.911528 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Emitting event <LifecycleEvent: 1782533629.909769, c706e2d7-9f1f-46dc-84b5-f0ead4542d24 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:04.911528 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] VM Stopped (Lifecycle Event)
Jun 27 04:14:04.950121 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Instance destroyed successfully.
Jun 27 04:14:04.950723 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lazy-loading 'resources' on Instance uuid fc6a44e4-6a27-4d30-ab01-80374403846a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:05.066867 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:05.070204 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:05.080666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fc83469-9d6c-4198-b486-aec8282a5764 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.604s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:05.414019 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: c706e2d7-9f1f-46dc-84b5-f0ead4542d24] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:05.453304 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:13:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2098654423',display_name='tempest-ServersNegativeTestJSON-server-2098654423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-serversnegativetestjson-server-2098654423',id=39,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:13:25Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3565ea3785de40f985397aa1d9254b99',ramdisk_id='',reservation_id='r-hjk4yt62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1704939525',owner_user_name='tempest-ServersNegativeTestJSON-1704939525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:13:25Z,user_data=None,user_id='39149bed2f8346c28e7bb800cadc9b7a',uuid=fc6a44e4-6a27-4d30-ab01-80374403846a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:14:05.453632 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converting VIF {"id": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "address": "fa:16:3e:c4:d0:63", "network": {"id": "98e41605-141e-46bc-b0fb-b5882f31d50c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-454170517-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3565ea3785de40f985397aa1d9254b99", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6097ba72-a5", "ovs_interfaceid": "6097ba72-a5a1-4bd7-8d0d-55e9d760d47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:05.454351 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:05.454709 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:14:05.456181 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:05.456507 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6097ba72-a5, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:05.468180 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:05.469354 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:05.470007 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:05.470957 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:05.471151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37dda04b-5a48-4ea6-ab7a-1147cc368532) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:05.472047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:05.472779 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:05.473107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:05.475120 np0000003830 nova-compute[98984]: INFO os_vif [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:d0:63,bridge_name='br-int',has_traffic_filtering=True,id=6097ba72-a5a1-4bd7-8d0d-55e9d760d47c,network=Network(98e41605-141e-46bc-b0fb-b5882f31d50c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6097ba72-a5')
Jun 27 04:14:05.475410 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Deleting instance files /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a_del
Jun 27 04:14:05.476216 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Deletion of /opt/stack/data/nova/instances/fc6a44e4-6a27-4d30-ab01-80374403846a_del complete
Jun 27 04:14:05.576597 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999687642000026 future=<Future at 0x7ec5381b4a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:05.577435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bde75eb8-7829-4216-bb69-b056977c2a3e tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "7a9c24d6-f85f-4fbf-9f00-33a8f029e43b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.222s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:05.651148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found WWN 330000000880570a1 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:14:05.651148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:05.651148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000880570a1', 'path': '/dev/dm-0', 'multipath_id': '330000000880570a1'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:05.651148 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000880570a1', 'path': '/dev/dm-0', 'multipath_id': '330000000880570a1'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:14:05.654258 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:05.982832 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:14:05.983389 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:14:05.983776 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:14:05.983896 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:14:05.984139 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:06.051523 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:06.158280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attempting to attach volume e6d28272-fb64-434f-b669-c12d15f41609 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]:   <alias name="ua-e6d28272-fb64-434f-b669-c12d15f41609"/>
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]:   <serial>e6d28272-fb64-434f-b669-c12d15f41609</serial>
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:06.159804 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:14:06.820688 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:06.892829 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-unplugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:06.893401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] Acquiring lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:06.893588 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:06.893634 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:06.893800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] No waiting events found dispatching network-vif-unplugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:06.893926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-unplugged-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:14:06.894092 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-changed-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:06.894161 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Refreshing instance network info cache due to event network-changed-2f7efb1a-130e-45dd-b077-127b3da195c7. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:06.894237 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] Acquiring lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:06.894363 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] Acquired lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:06.894516 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Refreshing network info cache for port 2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:06.944978 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:06.945160 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:07.325783 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Took 1.34 seconds to deallocate network for instance.
Jun 27 04:14:07.399061 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:07.447105 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:14:07.834886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:07.834886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:07.842487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:07.842679 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:07.842924 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:07.843056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:07.843188 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] No VIF found with MAC fa:16:3e:30:97:02, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:07.859159 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:08.052823 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:08.135159 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Updated VIF entry in instance network info cache for port 2f7efb1a-130e-45dd-b077-127b3da195c7. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:14:08.135159 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Updating instance_info_cache with network_info: [{"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:08.157339 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:08.157682 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:08.637580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] Releasing lock "refresh_cache-369f807f-1f9c-4c3a-b2d4-28e28f697c6c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:08.637833 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7ddbccc4-5da4-4797-87df-b69e060182a2 req-eced987f-9b57-44ca-8b08-44477833bcda service nova] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Received event network-vif-deleted-6097ba72-a5a1-4bd7-8d0d-55e9d760d47c {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:08.660275 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:09.169334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.335s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:09.171816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.117s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:09.175868 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:14:09.176393 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Claim successful on node np0000003830
Jun 27 04:14:09.253016 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Deleted allocations for instance fc6a44e4-6a27-4d30-ab01-80374403846a
Jun 27 04:14:09.402140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:09.434748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97bb0d30-9efe-428d-a47f-54d4f0ca6a3b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.591s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:10.045469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:10.045469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:10.071836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:10.071836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:10.261093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9411ef6f-47ee-47c0-a1ff-a22ddf59cef9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Lock "fc6a44e4-6a27-4d30-ab01-80374403846a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:10.473126 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:10.546679 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:14:10.574238 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Detaching volume 83d37273-15fb-4b05-8fbc-58822fb8cd9b
Jun 27 04:14:10.588981 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:10.589259 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:10.706452 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attempting to driver detach volume 83d37273-15fb-4b05-8fbc-58822fb8cd9b from mountpoint /dev/vdb
Jun 27 04:14:10.711171 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found disk vdb by alias ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found disk vdb by alias ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Attempting to detach device vdb from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:   <alias name="ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b"/>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:   <serial>83d37273-15fb-4b05-8fbc-58822fb8cd9b</serial>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:10.714015 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:14:10.727313 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully detached device vdb from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the persistent domain config.
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] (1/8): Attempting to detach device vdb with device alias ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:   <alias name="ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b"/>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:   <serial>83d37273-15fb-4b05-8fbc-58822fb8cd9b</serial>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:10.728664 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:14:11.091998 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:11.131693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:11.329039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533651.3284528, e1cb21b7-7354-467e-b189-0696fa5444f3 => ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:14:11.333550 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-83d37273-15fb-4b05-8fbc-58822fb8cd9b for instance e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:14:11.337083 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully detached device vdb from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the live domain config.
Jun 27 04:14:11.338079 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:14:11.338170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:11.338317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:11.338899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:11.338899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83d37273-15fb-4b05-8fbc-58822fb8cd9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:14:11.339649 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:14:11.371005 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:11.371005 np0000003830 nova-compute[98984]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1abe3374-0880-465f-b99e-9f5446681b79 (non-flash)
Jun 27 04:14:11.371005 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:11.371005 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:11.371005 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:11.371005 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1abe3374-0880-465f-b99e-9f5446681b79 (non-flash)
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b (non-flash)
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:11.371476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1abe3374-0880-465f-b99e-9f5446681b79', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', '99')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:14:11.371959 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', '97')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:14:11.372658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b', '98')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:14:11.373648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5381df100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'): ({'sdi'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:14:11.373929 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:14:11.374599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flush multipath device 33000000083007b16 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:14:11.411489 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:14:11.472688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:14:11.535577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:14:11.535577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:14:11.536544 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:14:11.548801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:14:11.549160 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:14:11.560417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:11.600326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.431s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:11.601047 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:14:11.603667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.470s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:11.604618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.40.100,3260]
Jun 27 04:14:11.604618 np0000003830 nova-compute[98984]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.40.100,3260] successful.
Jun 27 04:14:11.604618 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:11.607648 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:14:11.607762 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Claim successful on node np0000003830
Jun 27 04:14:11.625083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:11.640300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:11.679855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.50.100,3260]
Jun 27 04:14:11.679855 np0000003830 nova-compute[98984]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-83d37273-15fb-4b05-8fbc-58822fb8cd9b, portal: 192.168.50.100,3260] successful.
Jun 27 04:14:11.679855 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:11.695875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:11.696243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:11.696243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== disconnect_volume: return (357ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:11.696426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:14:12.114883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:14:12.114883 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:14:12.114883 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:12.114883 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:12.310398 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:12.342536 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cf90b3e43344e76aa1e04e16824517a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1121cceb6eae4ccb920a6e3123169bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:14:12.616027 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:14:12.913559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:12.913907 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:12.953517 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Successfully created port: 9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:14:13.120256 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:14:13.164659 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:13.317763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ad88e1cf-30a2-427a-9c68-693b6e6a3acb tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.246s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:13.416708 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:13.504646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:13.504646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:13.656212 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Successfully updated port: 9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:14:13.735915 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Received event network-changed-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:13.736994 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Refreshing instance network info cache due to event network-changed-9bf81426-3f68-4cb0-b70d-efcdec2bf131. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:13.737914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] Acquiring lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:13.737914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] Acquired lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:13.737914 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Refreshing network info cache for port 9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:13.925389 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.324s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:13.925772 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:14:14.011688 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Detaching volume e6d28272-fb64-434f-b669-c12d15f41609
Jun 27 04:14:14.072261 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Attempting to driver detach volume e6d28272-fb64-434f-b669-c12d15f41609 from mountpoint /dev/vdc
Jun 27 04:14:14.078745 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found disk vdc by alias ua-e6d28272-fb64-434f-b669-c12d15f41609 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:14:14.082064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Found disk vdc by alias ua-e6d28272-fb64-434f-b669-c12d15f41609 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:14:14.082212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Attempting to detach device vdc from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:   <alias name="ua-e6d28272-fb64-434f-b669-c12d15f41609"/>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:   <serial>e6d28272-fb64-434f-b669-c12d15f41609</serial>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:14.082482 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:14:14.092658 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully detached device vdc from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the persistent domain config.
Jun 27 04:14:14.092932 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] (1/8): Attempting to detach device vdc with device alias ua-e6d28272-fb64-434f-b669-c12d15f41609 from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:   <alias name="ua-e6d28272-fb64-434f-b669-c12d15f41609"/>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:   <serial>e6d28272-fb64-434f-b669-c12d15f41609</serial>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:14.093255 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:14:14.131726 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:14:14.132807 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:14:14.133113 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Creating image(s)
Jun 27 04:14:14.134027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:14.134244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "/opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:14.135511 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "/opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:14.136642 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:14.140476 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:14.141991 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:14.161967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:14.240737 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:14.244119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:14.244721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:14.245395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:14.246076 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:14.256889 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:14.257355 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:14.361415 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:14.413680 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:14.433419 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:14:14.434688 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:14:14.434688 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:14.434846 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:14.463630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.206s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:14.464555 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:14.527526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk 1073741824" returned: 0 in 0.061s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:14.527526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:14.527526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:14.549136 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be52472c68cd47fe991efe4050788c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6a6b08a14849038c79ff273d34be3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:14:14.562323 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:14.631103 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:14.631566 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:14:14.631797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:14.731825 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533654.7297974, e1cb21b7-7354-467e-b189-0696fa5444f3 => ua-e6d28272-fb64-434f-b669-c12d15f41609> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:14:14.731825 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-e6d28272-fb64-434f-b669-c12d15f41609 for instance e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:14:14.737289 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully detached device vdc from instance e1cb21b7-7354-467e-b189-0696fa5444f3 from the live domain config.
Jun 27 04:14:14.738946 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:14:14.739563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d28272-fb64-434f-b669-c12d15f41609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:14.740092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:14.740273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:14.740770 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6d28272-fb64-434f-b669-c12d15f41609', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:14:14.741271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:14:14.749413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:14.751304 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Cannot resize image /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:14:14.751660 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:14:14.751660 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Ensure instance console log exists: /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:14:14.751914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:14.752211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:14.752629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:14.771175 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1abe3374-0880-465f-b99e-9f5446681b79 (non-flash)
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1abe3374-0880-465f-b99e-9f5446681b79 (non-flash)
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609 (non-flash)
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1abe3374-0880-465f-b99e-9f5446681b79', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', '99')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:14:14.774349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', '100')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:14:14.775476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609', '99')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:14:14.777844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538418c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:14:14.778357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:14:14.779029 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Flush multipath device 330000000880570a1 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:14:14.823686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:14:14.876335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:14:14.930384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:14:14.930640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:14:14.931821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:14:14.939317 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:14:14.945376 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:14:14.945718 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:14:14.958786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:14.990221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.40.100,3260]
Jun 27 04:14:14.990221 np0000003830 nova-compute[98984]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.40.100,3260] successful.
Jun 27 04:14:14.990221 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:15.005474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:15.020745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:15.067146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c5482b03-5c74-40fe-989e-a885463ce348 req-1516476f-6808-4a4a-876e-62121c358a2f service nova] Releasing lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:15.068013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquired lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:15.069064 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.50.100,3260]
Jun 27 04:14:15.069064 np0000003830 nova-compute[98984]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-e6d28272-fb64-434f-b669-c12d15f41609, portal: 192.168.50.100,3260] successful.
Jun 27 04:14:15.069064 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:15.069324 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:14:15.081866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:15.082420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:15.082557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] <== disconnect_volume: return (342ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:15.082693 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:14:15.211671 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.001947123000263673 future=<Future at 0x7ec5183454f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:15.212096 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:15.212441 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] Emitting event <LifecycleEvent: 1782533640.2096026, 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:15.212747 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.363461261999873 future=<Future at 0x7ec5381b4a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:15.213015 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] VM Stopped (Lifecycle Event)
Jun 27 04:14:15.215287 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.360948516999997 future=<Future at 0x7ec5381b4a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:15.218331 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Successfully created port: d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:14:15.446855 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:14:15.482818 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:15.661896 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'flavor' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:15.666848 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:15.722097 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cc2672bc-cf83-4f7b-9fa4-d9928658644d tempest-ServerActionsTestOtherA-1390022329 tempest-ServerActionsTestOtherA-1390022329-project-member] [instance: 7a9c24d6-f85f-4fbf-9f00-33a8f029e43b] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:15.893987 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Successfully updated port: d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:14:15.916312 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:15.953167 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:15.953421 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing instance network info cache due to event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:15.953691 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:15.953826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:15.958585 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:16.126712 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Updating instance_info_cache with network_info: [{"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:16.397152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:16.462430 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:16.467571 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:14:16.478108 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:14:16.479063 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Creating image(s)
Jun 27 04:14:16.479692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:16.479890 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "/opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:16.480361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "/opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:16.480693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:16.482507 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:16.580055 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:16.629512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Releasing lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:16.629808 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Instance network_info: |[{"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:14:16.631515 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Start _get_guest_xml network_info=[{"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:14:16.634191 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:14:16.635295 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-379239479', uuid='6e74649b-6954-4503-88e8-3d819ef17d34'), owner=OwnerMeta(userid='1cf90b3e43344e76aa1e04e16824517a', username='tempest-VolumesBackupsTest-1314634333-project-member', projectid='1121cceb6eae4ccb920a6e3123169bf9', projectname='tempest-VolumesBackupsTest-1314634333'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533656.6349742) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:14:16.636545 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:14:16.636948 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:14:16.637831 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:14:16.638029 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:14:16.639036 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:14:16.639336 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:14:16.639517 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:14:16.639615 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:14:16.640262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:14:16.640262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:14:16.640262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:14:16.640262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:14:16.640262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:14:16.640262 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:14:16.640421 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:14:16.640421 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:14:16.651146 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-379239479',display_name='tempest-VolumesBackupsTest-instance-379239479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesbackupstest-instance-379239479',id=42,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1GppAjEFM5D8ZcCEYd51cmkpoko7JXLYXZv59caB2S0eLe/z+zFpDsAbGDHzez11zHDIsOy9bJa7CDMPN4tX5+iFVjlcpFUvEVvK2/qe0WBD1KscTWOdCzQO9L2aYg0w==',key_name='tempest-keypair-1759897499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1121cceb6eae4ccb920a6e3123169bf9',ramdisk_id='',reservation_id='r-bwsz05u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1314634333',owner_user_name='tempest-VolumesBackupsTest-1314634333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cf90b3e43344e76aa1e04e16824517a',uuid=6e74649b-6954-4503-88e8-3d819ef17d34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:14:16.651382 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converting VIF {"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:16.652127 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:16.652553 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e74649b-6954-4503-88e8-3d819ef17d34 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:16.680299 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5fa26721-8f8f-41bf-8b52-ad126af864b0 tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.177s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:16.783281 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:17.086842 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:17.087148 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:17.087455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:17.087706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:17.087903 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:17.090763 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Terminating instance
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <uuid>6e74649b-6954-4503-88e8-3d819ef17d34</uuid>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <name>instance-0000002a</name>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesBackupsTest-instance-379239479</nova:name>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:14:16</nova:creationTime>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:user uuid="1cf90b3e43344e76aa1e04e16824517a">tempest-VolumesBackupsTest-1314634333-project-member</nova:user>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:project uuid="1121cceb6eae4ccb920a6e3123169bf9">tempest-VolumesBackupsTest-1314634333</nova:project>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         <nova:port uuid="9bf81426-3f68-4cb0-b70d-efcdec2bf131">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <entry name="serial">6e74649b-6954-4503-88e8-3d819ef17d34</entry>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <entry name="uuid">6e74649b-6954-4503-88e8-3d819ef17d34</entry>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.config"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:a5:04:a1"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <target dev="tap9bf81426-3f"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/console.log" append="off"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Preparing to wait for external event network-vif-plugged-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-379239479',display_name='tempest-VolumesBackupsTest-instance-379239479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesbackupstest-instance-379239479',id=42,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1GppAjEFM5D8ZcCEYd51cmkpoko7JXLYXZv59caB2S0eLe/z+zFpDsAbGDHzez11zHDIsOy9bJa7CDMPN4tX5+iFVjlcpFUvEVvK2/qe0WBD1KscTWOdCzQO9L2aYg0w==',key_name='tempest-keypair-1759897499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1121cceb6eae4ccb920a6e3123169bf9',ramdisk_id='',reservation_id='r-bwsz05u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1314634333',owner_user_name='tempest-VolumesBackupsTest-1314634333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cf90b3e43344e76aa1e04e16824517a',uuid=6e74649b-6954-4503-88e8-3d819ef17d34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converting VIF {"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:17.157581 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:17.159700 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:14:17.159700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.159700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:17.159700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:14:17.160913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.161096 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '485ef15a-9d18-5371-af35-66211d4da215', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:17.164631 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.165352 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:17.167462 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.167787 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bf81426-3f, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:17.168787 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bf81426-3f, col_values=(('qos', UUID('c3c01176-8c10-4aff-ba41-97f93e57ed15')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:17.168942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bf81426-3f, col_values=(('external_ids', {'iface-id': '9bf81426-3f68-4cb0-b70d-efcdec2bf131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:04:a1', 'vm-uuid': '6e74649b-6954-4503-88e8-3d819ef17d34'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:17.169992 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.173407 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:17.177980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.180311 np0000003830 nova-compute[98984]: INFO os_vif [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f')
Jun 27 04:14:17.245512 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:17.247910 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:17.248285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:17.290930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef331ff1-26ac-4aa3-93ab-4abc6a6520a3 req-93428a47-1559-4a22-96f8-e377b6674bb6 service nova] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:17.290930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:17.290930 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:14:17.363386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.372610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.part --force-share --output=json" returned: 0 in 0.123s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:17.372610 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] 2ec8639d-f3e3-4949-8f3f-a5eb64821970 was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:14:17.374388 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:14:17.374634 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.part /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:17.596056 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:14:17.626020 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.630342 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.648936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.part /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.converted" returned: 0 in 0.274s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:17.657090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:17.673077 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.702311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:17.780884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b.converted --force-share --output=json" returned: 0 in 0.124s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:17.781658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.301s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:17.782133 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:17.786722 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:17.788279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:17.898421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:17.900938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:17.901637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:17.902092 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:17.908777 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:17.910697 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:17.937464 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:17.964518 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999576206000256 future=<Future at 0x7ec5381fafc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:17.966787 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Instance destroyed successfully.
Jun 27 04:14:17.969428 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lazy-loading 'resources' on Instance uuid e1cb21b7-7354-467e-b189-0696fa5444f3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:18.028905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:18.030746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b,backing_fmt=raw /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:18.087065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b,backing_fmt=raw /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk 1073741824" returned: 0 in 0.057s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:18.087327 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:18.087858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:18.182473 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:18.197649 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ff12c1e04aa53ebd2e4f1884f2bac66e22b49b6b --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:18.198388 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:14:18.198731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:18.277123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-96d4a08e-ef84-4fda-89ac-df7fd2ebb62d req-5b7fac18-d3a0-4c5e-a741-15225fbdd5d1 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:18.279239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96d4a08e-ef84-4fda-89ac-df7fd2ebb62d req-5b7fac18-d3a0-4c5e-a741-15225fbdd5d1 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:18.279239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96d4a08e-ef84-4fda-89ac-df7fd2ebb62d req-5b7fac18-d3a0-4c5e-a741-15225fbdd5d1 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:18.279239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96d4a08e-ef84-4fda-89ac-df7fd2ebb62d req-5b7fac18-d3a0-4c5e-a741-15225fbdd5d1 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:18.279239 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-96d4a08e-ef84-4fda-89ac-df7fd2ebb62d req-5b7fac18-d3a0-4c5e-a741-15225fbdd5d1 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:18.279239 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-96d4a08e-ef84-4fda-89ac-df7fd2ebb62d req-5b7fac18-d3a0-4c5e-a741-15225fbdd5d1 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received unexpected event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with vm_state building and task_state spawning.
Jun 27 04:14:18.302871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:18.303998 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Cannot resize image /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:14:18.303998 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:14:18.304938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Ensure instance console log exists: /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:14:18.304938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:18.304938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:18.307211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:18.402355 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:18.476452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-526867060',display_name='tempest-AttachVolumeTestJSON-server-526867060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumetestjson-server-526867060',id=38,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkd6HZH/KNnDOckhlzwdr60nWAezeDTdzyXTtW+Hic4oew8ie3sykOqOOHa6tcb0SINEZTTGZpTWXRyWINHoxuz6cxG8pkPbOgcl6ftROYM3wJQPtLMMOwL7X6eYn2/Uw==',key_name='tempest-keypair-104886217',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:13:07Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72fed82034484f13a228c535b175c167',ramdisk_id='',reservation_id='r-gse7wwoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-559471176',owner_user_name='tempest-AttachVolumeTestJSON-559471176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:13:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='216588ecf8894ad5aeb6914196a090db',uuid=e1cb21b7-7354-467e-b189-0696fa5444f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:14:18.476669 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converting VIF {"id": "c681e64d-8190-417b-867a-4e1841a469af", "address": "fa:16:3e:30:97:02", "network": {"id": "9eea6795-2f92-4440-a8d1-d73eaf106416", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-656697501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "72fed82034484f13a228c535b175c167", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc681e64d-81", "ovs_interfaceid": "c681e64d-8190-417b-867a-4e1841a469af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:18.477347 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:18.477523 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:14:18.479081 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.479509 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc681e64d-81, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:18.480552 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.481357 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:18.489334 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.490628 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.491171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=389339cd-eb05-412d-9886-005f8cdfaa14) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:18.494354 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.495306 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:18.506373 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.513833 np0000003830 nova-compute[98984]: INFO os_vif [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:97:02,bridge_name='br-int',has_traffic_filtering=True,id=c681e64d-8190-417b-867a-4e1841a469af,network=Network(9eea6795-2f92-4440-a8d1-d73eaf106416),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc681e64d-81')
Jun 27 04:14:18.513833 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Deleting instance files /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3_del
Jun 27 04:14:18.514710 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Deletion of /opt/stack/data/nova/instances/e1cb21b7-7354-467e-b189-0696fa5444f3_del complete
Jun 27 04:14:18.601794 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:18.740445 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:18.740662 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:18.740793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No VIF found with MAC fa:16:3e:a5:04:a1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:18.741346 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Using config drive
Jun 27 04:14:18.904323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:18.904805 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance network_info: |[{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:14:18.906716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Start _get_guest_xml network_info=[{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:14:07Z,direct_url=<?>,disk_format='qcow2',id=2ec8639d-f3e3-4949-8f3f-a5eb64821970,min_disk=0,min_ram=0,name='tempest-scenario-img--1402366020',owner='ef6a6b08a14849038c79ff273d34be3f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:14:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': '2ec8639d-f3e3-4949-8f3f-a5eb64821970'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:14:18.910461 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:14:18.912859 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2ec8639d-f3e3-4949-8f3f-a5eb64821970', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1661289853', uuid='bd98b468-fcaa-42e2-a1a3-bdc82a6e7538'), owner=OwnerMeta(userid='be52472c68cd47fe991efe4050788c09', username='tempest-TestMinimumBasicScenario-1552363864-project-member', projectid='ef6a6b08a14849038c79ff273d34be3f', projectname='tempest-TestMinimumBasicScenario-1552363864'), image=ImageMeta(id='2ec8639d-f3e3-4949-8f3f-a5eb64821970', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533658.9120276) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:14:18.914646 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:14:18.915213 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:14:18.916835 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:14:18.917336 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:14:18.918893 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:14:18.919479 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:14:07Z,direct_url=<?>,disk_format='qcow2',id=2ec8639d-f3e3-4949-8f3f-a5eb64821970,min_disk=0,min_ram=0,name='tempest-scenario-img--1402366020',owner='ef6a6b08a14849038c79ff273d34be3f',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:14:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:14:18.920139 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:14:18.920139 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:14:18.920139 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:14:18.920298 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:14:18.920822 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:14:18.920822 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:14:18.920822 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:14:18.921400 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:14:18.921527 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:14:18.921795 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:14:18.938071 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1661289853',display_name='tempest-TestMinimumBasicScenario-server-1661289853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1661289853',id=43,image_ref='2ec8639d-f3e3-4949-8f3f-a5eb64821970',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC0UcXVulFkkNBn+fTBc5uG2TWKIIwPQ5d/+CRqAMWUrlVM6Oq97P/Liwt/sHQwcKVHhHM/Fn8XHjxWgBNqwk6jTYLg8RZLuZATPQFZTwAmfFi6b1bCQhRQY4JMRyGa8g==',key_name='tempest-TestMinimumBasicScenario-1306838645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-9kt0tn1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ec8639d-f3e3-4949-8f3f-a5eb64821970',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:15Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=bd98b468-fcaa-42e2-a1a3-bdc82a6e7538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:14:18.938071 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:18.938862 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:18.939244 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'pci_devices' on Instance uuid bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:19.034814 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 27 04:14:19.038561 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:14:19.038743 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:14:19.038743 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:14:19.039476 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:19.181620 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:19.249710 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:19.415346 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.440391 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Creating config drive at /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.config
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <uuid>bd98b468-fcaa-42e2-a1a3-bdc82a6e7538</uuid>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <name>instance-0000002b</name>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestMinimumBasicScenario-server-1661289853</nova:name>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:14:18</nova:creationTime>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:image uuid="2ec8639d-f3e3-4949-8f3f-a5eb64821970">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:properties/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:user uuid="be52472c68cd47fe991efe4050788c09">tempest-TestMinimumBasicScenario-1552363864-project-member</nova:user>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:project uuid="ef6a6b08a14849038c79ff273d34be3f">tempest-TestMinimumBasicScenario-1552363864</nova:project>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="2ec8639d-f3e3-4949-8f3f-a5eb64821970"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         <nova:port uuid="d311bb0b-e507-4ae4-8620-e98564a10081">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <entry name="serial">bd98b468-fcaa-42e2-a1a3-bdc82a6e7538</entry>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <entry name="uuid">bd98b468-fcaa-42e2-a1a3-bdc82a6e7538</entry>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.config"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:5c:58:76"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <target dev="tapd311bb0b-e5"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/console.log" append="off"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:14:19.445526 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:14:19.447891 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Preparing to wait for external event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:14:19.447891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:19.447891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:19.447891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:19.447891 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1661289853',display_name='tempest-TestMinimumBasicScenario-server-1661289853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1661289853',id=43,image_ref='2ec8639d-f3e3-4949-8f3f-a5eb64821970',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC0UcXVulFkkNBn+fTBc5uG2TWKIIwPQ5d/+CRqAMWUrlVM6Oq97P/Liwt/sHQwcKVHhHM/Fn8XHjxWgBNqwk6jTYLg8RZLuZATPQFZTwAmfFi6b1bCQhRQY4JMRyGa8g==',key_name='tempest-TestMinimumBasicScenario-1306838645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-9kt0tn1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ec8639d-f3e3-4949-8f3f-a5eb64821970',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:15Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=bd98b468-fcaa-42e2-a1a3-bdc82a6e7538,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:14:19.448833 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:19.449835 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:19.450217 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:14:19.450812 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.452018 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:19.452381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:14:19.453409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.453963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afab9063-c1b5-5a65-a2a9-552842892e1f', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:19.455672 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.456590 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:19.460614 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuwrgmskt {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:19.482855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.492517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.493758 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd311bb0b-e5, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:19.495568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd311bb0b-e5, col_values=(('qos', UUID('1345a158-5aab-4581-b83d-6c52861b2030')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:19.495568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd311bb0b-e5, col_values=(('external_ids', {'iface-id': 'd311bb0b-e507-4ae4-8620-e98564a10081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:58:76', 'vm-uuid': 'bd98b468-fcaa-42e2-a1a3-bdc82a6e7538'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:19.497815 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.498651 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:19.512921 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:19.514983 np0000003830 nova-compute[98984]: INFO os_vif [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5')
Jun 27 04:14:19.532718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuwrgmskt" returned: 0 in 0.072s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:20.068120 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.112546 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.200482 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.206774 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9bf15197-ab32-4cb0-b8d8-a79b4cf52018 req-06d2bdf0-17e2-4eca-a028-1ff0c3c49287 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Received event network-vif-deleted-c681e64d-8190-417b-867a-4e1841a469af {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:20.207000 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-9bf15197-ab32-4cb0-b8d8-a79b4cf52018 req-06d2bdf0-17e2-4eca-a028-1ff0c3c49287 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Neutron deleted interface c681e64d-8190-417b-867a-4e1841a469af; detaching it from the instance and deleting it from the info cache
Jun 27 04:14:20.223200 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9bf15197-ab32-4cb0-b8d8-a79b4cf52018 req-06d2bdf0-17e2-4eca-a028-1ff0c3c49287 service nova] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Detach interface failed, port_id=c681e64d-8190-417b-867a-4e1841a469af, reason: Instance e1cb21b7-7354-467e-b189-0696fa5444f3 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:14:20.366737 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-436d68e4-2242-485e-acb9-66ca1e7afe55 req-60eefbe9-8190-4006-8349-97cb34f00677 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Received event network-vif-plugged-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:20.366737 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-436d68e4-2242-485e-acb9-66ca1e7afe55 req-60eefbe9-8190-4006-8349-97cb34f00677 service nova] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:20.366737 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-436d68e4-2242-485e-acb9-66ca1e7afe55 req-60eefbe9-8190-4006-8349-97cb34f00677 service nova] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:20.366886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-436d68e4-2242-485e-acb9-66ca1e7afe55 req-60eefbe9-8190-4006-8349-97cb34f00677 service nova] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:20.367015 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-436d68e4-2242-485e-acb9-66ca1e7afe55 req-60eefbe9-8190-4006-8349-97cb34f00677 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Processing event network-vif-plugged-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:14:20.526127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.536873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.541880 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.573848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.576872 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005907350000597944 future=<Future at 0x7ec5381b4a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:20.577362 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:20.581112 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Emitting event <LifecycleEvent: 1782533645.5761151, fc6a44e4-6a27-4d30-ab01-80374403846a => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:20.581380 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] VM Stopped (Lifecycle Event)
Jun 27 04:14:20.582594 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=12.380327973000021 future=<Future at 0x7ec5381fafc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:20.582741 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=12.380161384000075 future=<Future at 0x7ec5381fafc0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:20.582848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:20.646254 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:20.679152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:21.044512 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:21.044884 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:21.044884 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No VIF found with MAC fa:16:3e:5c:58:76, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:21.045382 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Using config drive
Jun 27 04:14:21.087822 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: fc6a44e4-6a27-4d30-ab01-80374403846a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:21.140865 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:14:21.141682 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533661.1413867, 6e74649b-6954-4503-88e8-3d819ef17d34 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:21.142204 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] VM Started (Lifecycle Event)
Jun 27 04:14:21.145949 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:14:21.149738 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Took 2.11 seconds to deallocate network for instance.
Jun 27 04:14:21.152747 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Instance spawned successfully.
Jun 27 04:14:21.153132 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:14:21.555818 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:21.647647 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:21.651445 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:21.665613 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:21.665793 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:21.666189 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:21.666508 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:21.667541 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:21.667541 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:21.674014 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:21.674255 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:21.695353 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:21.787915 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Creating config drive at /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.config
Jun 27 04:14:21.792200 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2ghv4gng {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:21.867703 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2ghv4gng" returned: 0 in 0.076s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:22.008056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:22.008325 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:22.154337 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:14:22.154796 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533662.1544425, 6e74649b-6954-4503-88e8-3d819ef17d34 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:22.154796 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] VM Paused (Lifecycle Event)
Jun 27 04:14:22.172749 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Took 8.04 seconds to spawn the instance on the hypervisor.
Jun 27 04:14:22.172943 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:22.336454 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.362030 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.365166 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.452254 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.512317 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:22.575832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a6de38cc-6bc4-45b4-906c-a91238ec2f8c req-63cace51-4b79-4806-adba-f6aa75a4f8d0 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Received event network-vif-plugged-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:22.575832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a6de38cc-6bc4-45b4-906c-a91238ec2f8c req-63cace51-4b79-4806-adba-f6aa75a4f8d0 service nova] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:22.575832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a6de38cc-6bc4-45b4-906c-a91238ec2f8c req-63cace51-4b79-4806-adba-f6aa75a4f8d0 service nova] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:22.575832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a6de38cc-6bc4-45b4-906c-a91238ec2f8c req-63cace51-4b79-4806-adba-f6aa75a4f8d0 service nova] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:22.575832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a6de38cc-6bc4-45b4-906c-a91238ec2f8c req-63cace51-4b79-4806-adba-f6aa75a4f8d0 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] No waiting events found dispatching network-vif-plugged-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:22.575832 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a6de38cc-6bc4-45b4-906c-a91238ec2f8c req-63cace51-4b79-4806-adba-f6aa75a4f8d0 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Received unexpected event network-vif-plugged-9bf81426-3f68-4cb0-b70d-efcdec2bf131 for instance with vm_state active and task_state None.
Jun 27 04:14:22.657832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:22.675418 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533662.6750793, 6e74649b-6954-4503-88e8-3d819ef17d34 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:22.677531 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] VM Resumed (Lifecycle Event)
Jun 27 04:14:22.684936 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Took 14.73 seconds to build instance.
Jun 27 04:14:22.721047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.721047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.721047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.748208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:22.844347 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-629df814-b3cb-40f5-8b8a-f395020f24cf req-6f425788-a239-4dc9-884b-b3bb3faef086 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:22.848752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-629df814-b3cb-40f5-8b8a-f395020f24cf req-6f425788-a239-4dc9-884b-b3bb3faef086 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:22.848752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-629df814-b3cb-40f5-8b8a-f395020f24cf req-6f425788-a239-4dc9-884b-b3bb3faef086 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:22.848752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-629df814-b3cb-40f5-8b8a-f395020f24cf req-6f425788-a239-4dc9-884b-b3bb3faef086 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:22.848752 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-629df814-b3cb-40f5-8b8a-f395020f24cf req-6f425788-a239-4dc9-884b-b3bb3faef086 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Processing event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:14:23.021809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.347s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:23.112363 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Deleted allocations for instance e1cb21b7-7354-467e-b189-0696fa5444f3
Jun 27 04:14:23.180520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:23.184283 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:23.186631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.241s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:23.584868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:14:23.587221 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:14:23.589119 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance spawned successfully.
Jun 27 04:14:23.590647 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:14:23.688236 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533663.6873226, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:23.688236 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] VM Started (Lifecycle Event)
Jun 27 04:14:23.792112 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Received event network-changed-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:23.792251 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Refreshing instance network info cache due to event network-changed-9bf81426-3f68-4cb0-b70d-efcdec2bf131. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:23.792398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] Acquiring lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:23.792487 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] Acquired lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:23.792626 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Refreshing network info cache for port 9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:24.098558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:24.098558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:24.098558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:24.098558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:24.098558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:24.098558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:24.127108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cf6446c0-67e8-4d0f-ba18-4740a543770b tempest-AttachVolumeTestJSON-559471176 tempest-AttachVolumeTestJSON-559471176-project-member] Lock "e1cb21b7-7354-467e-b189-0696fa5444f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.040s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:24.191772 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:24.194283 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:24.295315 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:24.424306 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:24.496667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:24.605205 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Took 8.14 seconds to spawn the instance on the hypervisor.
Jun 27 04:14:24.605205 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:24.698480 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:14:24.701825 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533664.7003791, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:24.701825 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] VM Paused (Lifecycle Event)
Jun 27 04:14:24.760928 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:24.945993 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1a09cd38-ef2f-407e-a9af-98b0f09edc2b req-ac36306f-67d0-4e23-a221-6259e99edce0 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:24.946194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1a09cd38-ef2f-407e-a9af-98b0f09edc2b req-ac36306f-67d0-4e23-a221-6259e99edce0 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:24.946359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1a09cd38-ef2f-407e-a9af-98b0f09edc2b req-ac36306f-67d0-4e23-a221-6259e99edce0 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:24.946513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1a09cd38-ef2f-407e-a9af-98b0f09edc2b req-ac36306f-67d0-4e23-a221-6259e99edce0 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:24.946670 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1a09cd38-ef2f-407e-a9af-98b0f09edc2b req-ac36306f-67d0-4e23-a221-6259e99edce0 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:24.948918 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-1a09cd38-ef2f-407e-a9af-98b0f09edc2b req-ac36306f-67d0-4e23-a221-6259e99edce0 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received unexpected event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with vm_state active and task_state None.
Jun 27 04:14:25.013271 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Updated VIF entry in instance network info cache for port 9bf81426-3f68-4cb0-b70d-efcdec2bf131. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:14:25.014044 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Updating instance_info_cache with network_info: [{"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:25.125707 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Took 14.07 seconds to build instance.
Jun 27 04:14:25.181780 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:25.203791 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:25.205568 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533665.2053342, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:25.205711 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] VM Resumed (Lifecycle Event)
Jun 27 04:14:25.517394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04a06a3d-6dfd-472a-8a3d-862509e99cc6 req-16aed326-53dd-4c02-b554-b9b76bf616aa service nova] Releasing lock "refresh_cache-6e74649b-6954-4503-88e8-3d819ef17d34" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:25.628047 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.584s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:25.708161 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:25.710296 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:25.717990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:25.718240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:26.220694 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:14:26.790002 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:26.790183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:26.794071 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:14:26.794071 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Claim successful on node np0000003830
Jun 27 04:14:27.496148 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:27.496655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:27.830559 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:27.830755 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:27.831024 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:14:28.000815 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'flavor' on Instance uuid bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:28.063960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:28.064169 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:28.566990 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:29.008486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:29.072937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.283s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:29.073337 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:14:29.428075 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:29.498313 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:29.578883 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:14:29.580853 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:14:29.581224 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:29.581561 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:29.686633 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a614c2dbe3dc443cab3c16539edca35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd1ebe1144a427082b2a28cd85def6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:14:29.830310 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:30.083234 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:14:30.219940 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:30.220196 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:30.220571 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Attaching volume 12c169d3-3d80-4ec4-801a-c6543bcf8ad2 to /dev/vdb
Jun 27 04:14:30.296532 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:30.311462 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:14:30.337717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:30.338485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:30.339012 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:30.340033 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:14:30.342867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:30.405742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:14:30.406108 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:14:30.423163 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:14:30.427076 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fed6:d567', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fea5:4a1', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe5c:5876', 'fe80::80f0:94ff:feae:c312'] 
Jun 27 04:14:30.427845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:14:30.428408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:14:30.429433 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:30.429433 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating existing volume attachment record: 3d4b1762-d180-43fb-ad2f-c04791a08236 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:14:30.587768 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:14:30.729112 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Successfully created port: 14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:14:30.873281 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:31.021612 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:14:31.022305 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:31.022693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:31.023376 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:31.023709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:14:31.039756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:31.041391 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:31.042113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:31.042350 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:14:31.042793 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:31.043115 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:14:31.057030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:14:31.057030 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:31.062122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:14:31.062122 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2] added
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:31.070425 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:31.071004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:14:31.071004 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:14:31.071004 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2] added
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:31.079242 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:31.079471 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:14:31.079756 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:14:31.080065 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:14:31.451311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.570858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.571689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.601129 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:14:31.603234 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:14:31.603644 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Creating image(s)
Jun 27 04:14:31.604637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:31.605065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:31.605808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:31.606781 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:31.610610 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:31.612851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.704038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.708477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.737330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.124s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.739442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:31.743824 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:31.744992 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:31.754365 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:31.754867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.785672 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Successfully updated port: 14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:14:31.833583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.834110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.883192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.128s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.883675 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.942597 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.947664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:31.970409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk 1073741824" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:31.974127 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:31.975930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:32.019246 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-changed-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:32.019433 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Refreshing instance network info cache due to event network-changed-14401e48-b7c6-4b89-9062-607cb966d96e. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:32.020097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] Acquiring lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:32.020097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] Acquired lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:32.020237 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Refreshing network info cache for port 14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:32.072199 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:14:32.082084 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:14:32.087641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:32.088084 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:32.109258 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.130s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:14:32.110099 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:32.123911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:32.137028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:32.137028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:32.151530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:14:32.151530 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:32.151697 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:14:32.151697 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:32.152201 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:14:32.152201 np0000003830 nova-compute[98984]: 
Jun 27 04:14:32.159019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:14:32.159019 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:32.159260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:14:32.159260 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:32.159383 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:14:32.159383 np0000003830 nova-compute[98984]: 
Jun 27 04:14:32.193810 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.40.100,3260]
Jun 27 04:14:32.193810 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.40.100,3260] successful.
Jun 27 04:14:32.193810 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:32.198242 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:32.200377 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:14:32.202150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:32.216220 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:32.231288 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:32.231288 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:32.231742 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:32.231742 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:32.232708 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:32.232924 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:14:32.233840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] HCTL ('7', '-', '-', 0) found on session 102 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:14:32.234683 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Cannot resize image /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Ensure instance console log exists: /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 102 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51050MB free_disk=73.29947662353516GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:32.269231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:32.290104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:32.526067 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:32.612599 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:32.857809 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:32.963663 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005915899996580265 future=<Future at 0x7ec5381fafc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:32.964397 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Emitting event <LifecycleEvent: 1782533657.9627967, e1cb21b7-7354-467e-b189-0696fa5444f3 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:32.964669 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:14:32.964912 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] VM Stopped (Lifecycle Event)
Jun 27 04:14:33.199354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.50.100,3260]
Jun 27 04:14:33.199354 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.50.100,3260] successful.
Jun 27 04:14:33.199354 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:33.215044 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:33.231084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:33.231084 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:33.231084 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:33.231279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:33.231279 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:33.231279 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:33.232013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.189s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:33.232013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:14:33.232235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] HCTL ('8', '-', '-', 0) found on session 103 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:14:33.232382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:14:33.254644 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 103 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:33.348765 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:14:33.349722 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6e74649b-6954-4503-88e8-3d819ef17d34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:14:33.349722 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:14:33.349907 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:14:33.350181 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:14:33.351295 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:14:32 up 37 min,  2 users,  load average: 7.86, 8.80, 5.75\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_56c1eb5f65f0446eae1f4967af349cd1': '1', 'io_workload': '1', 'num_proj_1121cceb6eae4ccb920a6e3123169bf9': '1', 'num_proj_ef6a6b08a14849038c79ff273d34be3f': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_cbd1ebe1144a427082b2a28cd85def6b': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:14:33.360009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5456c533-3e42-43a8-a69c-6591060ffea9 req-9f8c1d71-885f-4c9e-bef1-a29ddabe3818 service nova] Releasing lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:33.360665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquired lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:33.360860 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:14:33.468242 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a79ad9c-431f-4452-bcba-d3b26dfe2e5b tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e1cb21b7-7354-467e-b189-0696fa5444f3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:33.656626 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:33.666670 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:33.933232 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:34.110917 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:34.159374 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:34.255657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Searching for a device in session 103 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:34.255657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:14:34.262660 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Updating instance_info_cache with network_info: [{"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:34.441655 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:34.498652 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:34.665836 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:14:34.666344 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.399s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:34.666344 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:14:34.764995 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Releasing lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:34.765360 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Instance network_info: |[{"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:14:34.767865 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Start _get_guest_xml network_info=[{"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:14:34.770512 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:14:34.772281 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-771838564', uuid='4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e'), owner=OwnerMeta(userid='a614c2dbe3dc443cab3c16539edca35c', username='tempest-AttachVolumeNegativeTest-981489683-project-member', projectid='cbd1ebe1144a427082b2a28cd85def6b', projectname='tempest-AttachVolumeNegativeTest-981489683'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533674.7717624) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:14:34.773994 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:14:34.774518 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:14:34.775679 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:14:34.775968 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:14:34.777516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:14:34.778040 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:14:34.778420 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:14:34.778632 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:14:34.778830 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:14:34.778995 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:14:34.779183 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:14:34.779409 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:14:34.779592 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:14:34.779724 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:14:34.779844 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:14:34.780092 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:14:34.793025 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-771838564',display_name='tempest-AttachVolumeNegativeTest-server-771838564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-771838564',id=44,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKdkqV93OoYTBGzDX0Vcudc6DDotrKTPOkPHIspi9haXBmWJN6b6dkvAXBJ1yxIZnAfARu5prdhHOUsGrHYMgKDPtQWgaBf5w+cU523wpAb767rYj1/rNRnfW9YemZZaw==',key_name='tempest-keypair-2127817202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-ay4o0b27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:14:34.793205 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:34.803969 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:34.803969 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:35.085334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799047 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:14:35.085719 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.062s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:35.085964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== connect_volume: return (4063ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799047', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799047'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:35.086125 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799047', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799047'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:14:35.088949 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'flavor' on Instance uuid bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <uuid>4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e</uuid>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <name>instance-0000002c</name>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeNegativeTest-server-771838564</nova:name>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:14:34</nova:creationTime>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:user uuid="a614c2dbe3dc443cab3c16539edca35c">tempest-AttachVolumeNegativeTest-981489683-project-member</nova:user>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:project uuid="cbd1ebe1144a427082b2a28cd85def6b">tempest-AttachVolumeNegativeTest-981489683</nova:project>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         <nova:port uuid="14401e48-b7c6-4b89-9062-607cb966d96e">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <entry name="serial">4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e</entry>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <entry name="uuid">4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e</entry>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.config"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:35:49:09"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <target dev="tap14401e48-b7"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/console.log" append="off"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:14:35.300307 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Preparing to wait for external event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-771838564',display_name='tempest-AttachVolumeNegativeTest-server-771838564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-771838564',id=44,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKdkqV93OoYTBGzDX0Vcudc6DDotrKTPOkPHIspi9haXBmWJN6b6dkvAXBJ1yxIZnAfARu5prdhHOUsGrHYMgKDPtQWgaBf5w+cU523wpAb767rYj1/rNRnfW9YemZZaw==',key_name='tempest-keypair-2127817202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-ay4o0b27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:35.307060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ea98642-f685-58e8-b5d6-86874b298065', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:35.307723 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:35.308580 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:35.310810 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:35.311195 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14401e48-b7, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:35.311721 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14401e48-b7, col_values=(('qos', UUID('5f611bc7-0f3d-4b6e-9e69-623f358cd486')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:35.311978 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14401e48-b7, col_values=(('external_ids', {'iface-id': '14401e48-b7c6-4b89-9062-607cb966d96e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:49:09', 'vm-uuid': '4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:35.316118 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:35.320967 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:35.322278 np0000003830 nova-compute[98984]: INFO os_vif [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7')
Jun 27 04:14:35.593653 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Attempting to attach volume 12c169d3-3d80-4ec4-801a-c6543bcf8ad2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]:   <alias name="ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2"/>
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]:   <serial>12c169d3-3d80-4ec4-801a-c6543bcf8ad2</serial>
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:35.599341 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:14:35.669077 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:35.669587 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:35.669687 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:35.669868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:14:35.670142 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.16 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:14:35.696146 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:35.827362 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:35.827681 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:14:35.830012 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:14:35.830248 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:14:36.873677 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:36.874287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:36.874287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:35:49:09, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:36.874512 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Using config drive
Jun 27 04:14:37.301417 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:37.301417 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:37.301576 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:37.301630 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] No VIF found with MAC fa:16:3e:5c:58:76, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:37.380332 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:37.541731 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Creating config drive at /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.config
Jun 27 04:14:37.546687 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpelan57oj {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:37.614314 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpelan57oj" returned: 0 in 0.067s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:38.108208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.119269 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.268025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.276586 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.303350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.547589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.550219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.559248 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.562692 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.586577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:38.663303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b512c68-0d46-4e96-a431-773542fde941 req-d498fff5-6e17-4575-9aaa-f0b50a826160 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:38.663303 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b512c68-0d46-4e96-a431-773542fde941 req-d498fff5-6e17-4575-9aaa-f0b50a826160 service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:38.663303 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b512c68-0d46-4e96-a431-773542fde941 req-d498fff5-6e17-4575-9aaa-f0b50a826160 service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:38.663303 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b512c68-0d46-4e96-a431-773542fde941 req-d498fff5-6e17-4575-9aaa-f0b50a826160 service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:38.663303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b512c68-0d46-4e96-a431-773542fde941 req-d498fff5-6e17-4575-9aaa-f0b50a826160 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Processing event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:14:38.880385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-52abca43-5aaa-4377-8286-996ec365e9a5 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.660s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:39.222911 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533679.2223527, 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:39.222911 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] VM Started (Lifecycle Event)
Jun 27 04:14:39.226161 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:14:39.231077 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:14:39.235021 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Instance spawned successfully.
Jun 27 04:14:39.235635 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:14:39.440469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:39.727255 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:39.730370 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:39.745033 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:39.745272 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:39.745899 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:39.746403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:39.746845 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:39.747514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:40.008449 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:40.233381 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:14:40.233931 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533680.2334492, 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:40.233931 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] VM Paused (Lifecycle Event)
Jun 27 04:14:40.259968 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Took 8.66 seconds to spawn the instance on the hypervisor.
Jun 27 04:14:40.260167 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:40.314142 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:40.743092 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:40.745656 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533680.745337, 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:40.745799 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] VM Resumed (Lifecycle Event)
Jun 27 04:14:40.749631 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6aea57e8-13d8-4893-88c0-f68405b72525 req-4888ed68-f53b-4e9a-8e67-7c83d4fc0d06 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:40.749960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6aea57e8-13d8-4893-88c0-f68405b72525 req-4888ed68-f53b-4e9a-8e67-7c83d4fc0d06 service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:40.749960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6aea57e8-13d8-4893-88c0-f68405b72525 req-4888ed68-f53b-4e9a-8e67-7c83d4fc0d06 service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:40.750134 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6aea57e8-13d8-4893-88c0-f68405b72525 req-4888ed68-f53b-4e9a-8e67-7c83d4fc0d06 service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:40.750293 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6aea57e8-13d8-4893-88c0-f68405b72525 req-4888ed68-f53b-4e9a-8e67-7c83d4fc0d06 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:40.750389 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-6aea57e8-13d8-4893-88c0-f68405b72525 req-4888ed68-f53b-4e9a-8e67-7c83d4fc0d06 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received unexpected event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with vm_state active and task_state None.
Jun 27 04:14:40.772026 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Took 14.04 seconds to build instance.
Jun 27 04:14:40.934609 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:40.934609 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing instance network info cache due to event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:40.934609 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:40.934609 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:40.934609 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:41.252733 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:41.256184 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:41.274697 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.556s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:41.444952 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:42.070394 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:42.477747 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:42.478172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:42.504266 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:42.731577 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updated VIF entry in instance network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:14:42.731927 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:42.985714 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 369f807f-1f9c-4c3a-b2d4-28e28f697c6c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:43.007310 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-changed-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:43.011666 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Refreshing instance network info cache due to event network-changed-14401e48-b7c6-4b89-9062-607cb966d96e. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:43.011666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] Acquiring lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:43.011666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] Acquired lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:43.011666 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Refreshing network info cache for port 14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:43.235484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19617fb3-59fe-4b47-85f6-9a2a36a56944 req-0ba76710-ce02-4d13-ac6b-6ff6e2f3e55a service nova] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:43.512789 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:43.659439 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:43.659801 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing instance network info cache due to event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:43.662936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:43.663516 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:43.663702 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:43.943004 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:44.003696 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:44.166556 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:44.180239 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Updated VIF entry in instance network info cache for port 14401e48-b7c6-4b89-9062-607cb966d96e. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:14:44.180640 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Updating instance_info_cache with network_info: [{"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:44.442446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:44.564260 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:44.684505 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-89e9007b-ce1f-441a-bbd8-5fa4b3e13fd9 req-07f9916f-0071-49a9-94da-9269780ba9d2 service nova] Releasing lock "refresh_cache-4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:44.721819 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updated VIF entry in instance network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:14:44.722117 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:44.841913 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:45.084937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:45.085095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:45.085331 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Attaching volume 8ecedcdf-42d1-47ff-9cfc-02c71d11a49a to /dev/vdb
Jun 27 04:14:45.122261 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:45.134690 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:14:45.160024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:45.221149 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:14:45.221883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:14:45.224619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bd14af3b-f12e-4741-b413-435509d3d045 req-459cd7ee-be4f-4c72-b844-f21ce0045fef service nova] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:45.234146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:14:45.235657 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fed6:d567', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fea5:4a1', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe5c:5876', 'fe80::80f0:94ff:feae:c312', 'fe80::fc16:3eff:fe35:4909', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:14:45.235843 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:14:45.235944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:14:45.236256 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:45.237069 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Updating existing volume attachment record: 1e3603f9-0947-4864-9dd9-315be6b17b91 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:14:45.316071 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:45.331754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:45.331969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:45.834679 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:14:45.859371 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '369f807f-1f9c-4c3a-b2d4-28e28f697c6c', 'attached_at': '', 'detached_at': '', 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'serial': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:14:45.862325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:14:45.862640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:45.862833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:45.863231 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:45.863477 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:14:45.876520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:45.877947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:45.878763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:45.879013 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:14:45.879510 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:45.879759 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:14:45.893396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:14:45.893396 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:45.895463 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:14:45.895463 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a] added
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:45.907017 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:45.907456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:14:45.907456 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:14:45.907583 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a] added
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:14:45.909750 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:45.910025 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:14:45.910126 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:14:45.910281 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:14:46.403454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:46.403454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:46.406697 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:14:46.406893 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Claim successful on node np0000003830
Jun 27 04:14:46.659386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:46.908113 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:14:46.912668 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:14:46.921254 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:14:46.929125 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:46.934207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:46.942608 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:46.950515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.950515 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.950515 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:46.950779 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.950779 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.950779 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:46.957768 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.957768 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.957768 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:46.957971 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.957971 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:46.957971 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:46.991577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.40.100,3260]
Jun 27 04:14:46.991577 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.40.100,3260] successful.
Jun 27 04:14:46.991577 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:46.998341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.50.100,3260]
Jun 27 04:14:46.998341 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.50.100,3260] successful.
Jun 27 04:14:46.998341 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:47.003486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:47.013535 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:47.018431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.018431 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.018431 np0000003830 nova-compute[98984]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.018431 np0000003830 nova-compute[98984]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.018431 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:47.018666 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.018666 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.018666 np0000003830 nova-compute[98984]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.018666 np0000003830 nova-compute[98984]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.018666 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:47.018933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:47.019079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:14:47.019882 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('9', '-', '-', 0) found on session 104 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:14:47.020022 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:47.027671 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:47.028674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:47.028674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:14:47.028795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('10', '-', '-', 0) found on session 105 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:14:47.029027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:14:47.039982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 104 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:47.039982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:14:47.048941 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:14:47.049049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:14:47.723654 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:14:47.723923 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:14:47.879346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:14:48.226994 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:14:48.740593 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.337s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:48.741241 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:14:48.899373 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found WWN 330000000131ba669 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:14:48.899373 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:48.900375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000131ba669', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000131ba669'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:48.901285 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000131ba669', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000131ba669'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:14:48.903814 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:14:48.904360 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:14:48.907244 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:14:48.907244 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7ec5381a2ff0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '369f807f-1f9c-4c3a-b2d4-28e28f697c6c', 'attached_at': '', 'detached_at': '', 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'serial': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:14:48.907856 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.cryptsetup [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
Jun 27 04:14:48.908097 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98984) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
Jun 27 04:14:48.908097 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.cryptsetup [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] opening encrypted volume /dev/dm-1 {{(pid=98984) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
Jun 27 04:14:49.026888 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 369f807f-1f9c-4c3a-b2d4-28e28f697c6c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:49.246958 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:14:49.247661 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:14:49.248388 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:49.248718 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:49.327487 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c2bc77d02a4c81b4c573a8044a95ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc4bbb57b484481bf3cc234fdb870c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:14:49.452742 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:49.532830 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Attempting to attach volume 8ecedcdf-42d1-47ff-9cfc-02c71d11a49a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]:   <alias name="ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a"/>
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]:   <serial>8ecedcdf-42d1-47ff-9cfc-02c71d11a49a</serial>
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:49.534120 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:14:49.578084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:49.750965 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:14:50.167130 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Successfully created port: 698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:14:50.255117 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:14:50.318067 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:50.838882 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Successfully updated port: 698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:14:50.898029 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-changed-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:50.898029 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Refreshing instance network info cache due to event network-changed-698ccfda-7c5d-449d-98b9-d02743a4668f. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:14:50.898029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] Acquiring lock "refresh_cache-e3721d09-cca1-4d1d-81f5-7bc9759571cf" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:50.898029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] Acquired lock "refresh_cache-e3721d09-cca1-4d1d-81f5-7bc9759571cf" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:50.898029 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Refreshing network info cache for port 698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:14:51.205869 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:51.206003 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:51.206088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:51.206179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:d6:d5:67, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:51.268167 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:14:51.269862 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:14:51.269862 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Creating image(s)
Jun 27 04:14:51.276021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:51.276523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "/opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:51.278566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "/opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:51.279591 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:51.282918 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:51.284284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:51.318609 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:51.342466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "refresh_cache-e3721d09-cca1-4d1d-81f5-7bc9759571cf" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:51.393388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:51.394607 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:51.395323 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:51.395950 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:51.399685 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:14:51.401595 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:51.405369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:51.505669 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:51.513521 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:51.513854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:51.569894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk 1073741824" returned: 0 in 0.056s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:51.570383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:51.570856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:51.663147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:51.663698 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:14:51.664014 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:51.720225 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:51.757899 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:51.758292 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Cannot resize image /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:14:51.758892 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:14:51.759109 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Ensure instance console log exists: /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:14:51.759713 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:51.759955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:51.760143 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:52.224437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f4b440e9-bc4b-4e90-9e87-31ac136c721f req-d9680942-30b8-4974-9236-138a372ba20b service nova] Releasing lock "refresh_cache-e3721d09-cca1-4d1d-81f5-7bc9759571cf" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:52.225205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquired lock "refresh_cache-e3721d09-cca1-4d1d-81f5-7bc9759571cf" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:52.225369 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:14:52.776211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ca52c2da-36ab-4ed2-954b-88f37670c956 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.691s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:52.808763 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:14:52.989213 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:52.995136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:52.995136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:53.143699 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Updating instance_info_cache with network_info: [{"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:14:53.499306 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Detaching volume 8ecedcdf-42d1-47ff-9cfc-02c71d11a49a
Jun 27 04:14:53.540244 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Attempting to driver detach volume 8ecedcdf-42d1-47ff-9cfc-02c71d11a49a from mountpoint /dev/vdb
Jun 27 04:14:53.577330 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '369f807f-1f9c-4c3a-b2d4-28e28f697c6c', 'attached_at': '', 'detached_at': '', 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'serial': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:14:53.580124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:14:53.581304 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:14:53.581419 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Attempting to detach device vdb from instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:   <alias name="ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a"/>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:   <serial>8ecedcdf-42d1-47ff-9cfc-02c71d11a49a</serial>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:53.581705 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:14:53.587583 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c from the persistent domain config.
Jun 27 04:14:53.587803 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] (1/8): Attempting to detach device vdb with device alias ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a from instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:   <alias name="ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a"/>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:   <serial>8ecedcdf-42d1-47ff-9cfc-02c71d11a49a</serial>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:14:53.588074 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:14:53.645954 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Releasing lock "refresh_cache-e3721d09-cca1-4d1d-81f5-7bc9759571cf" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:14:53.646766 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Instance network_info: |[{"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:14:53.647745 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Start _get_guest_xml network_info=[{"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:14:53.651176 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:14:53.651855 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-600678041', uuid='e3721d09-cca1-4d1d-81f5-7bc9759571cf'), owner=OwnerMeta(userid='13c2bc77d02a4c81b4c573a8044a95ee', username='tempest-VolumesActionsTest-463751719-project-member', projectid='bbc4bbb57b484481bf3cc234fdb870c7', projectname='tempest-VolumesActionsTest-463751719'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533693.6514752) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:14:53.654429 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:14:53.654429 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:14:53.654613 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:14:53.654681 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:14:53.655747 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:14:53.656061 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:14:53.656196 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:14:53.656312 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:14:53.656432 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:14:53.656532 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:14:53.656683 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:14:53.656862 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:14:53.656962 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:14:53.657061 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:14:53.657157 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:14:53.657280 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:14:53.669102 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-600678041',display_name='tempest-VolumesActionsTest-instance-600678041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-600678041',id=45,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbc4bbb57b484481bf3cc234fdb870c7',ramdisk_id='',reservation_id='r-34brvczz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-463751719',owner_user_name='tempest-VolumesActionsTest-463751719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:50Z,user_data=None,user_id='13c2bc77d02a4c81b4c573a8044a95ee',uuid=e3721d09-cca1-4d1d-81f5-7bc9759571cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:14:53.669324 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converting VIF {"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:53.669822 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:53.670616 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lazy-loading 'pci_devices' on Instance uuid e3721d09-cca1-4d1d-81f5-7bc9759571cf {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:54.138923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533694.138531, 369f807f-1f9c-4c3a-b2d4-28e28f697c6c => ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:14:54.139695 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a for instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:14:54.141913 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c from the live domain config.
Jun 27 04:14:54.143283 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:14:54.143587 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:14:54.143693 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:14:54.144263 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7ec53864bf80>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '369f807f-1f9c-4c3a-b2d4-28e28f697c6c', 'attached_at': '', 'detached_at': '', 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'serial': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:14:54.144361 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.cryptsetup [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] closing encrypted volume /dev/dm-2 {{(pid=98984) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
Jun 27 04:14:54.171442 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:14:54.171914 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:14:54.172259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <uuid>e3721d09-cca1-4d1d-81f5-7bc9759571cf</uuid>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <name>instance-0000002d</name>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesActionsTest-instance-600678041</nova:name>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:14:53</nova:creationTime>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:user uuid="13c2bc77d02a4c81b4c573a8044a95ee">tempest-VolumesActionsTest-463751719-project-member</nova:user>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:project uuid="bbc4bbb57b484481bf3cc234fdb870c7">tempest-VolumesActionsTest-463751719</nova:project>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         <nova:port uuid="698ccfda-7c5d-449d-98b9-d02743a4668f">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <entry name="serial">e3721d09-cca1-4d1d-81f5-7bc9759571cf</entry>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <entry name="uuid">e3721d09-cca1-4d1d-81f5-7bc9759571cf</entry>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.config"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:24:5d:ab"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <target dev="tap698ccfda-7c"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/console.log" append="off"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:14:54.176918 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Preparing to wait for external event network-vif-plugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-600678041',display_name='tempest-VolumesActionsTest-instance-600678041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-600678041',id=45,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbc4bbb57b484481bf3cc234fdb870c7',ramdisk_id='',reservation_id='r-34brvczz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-463751719',owner_user_name='tempest-VolumesActionsTest-463751719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:14:50Z,user_data=None,user_id='13c2bc77d02a4c81b4c573a8044a95ee',uuid=e3721d09-cca1-4d1d-81f5-7bc9759571cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converting VIF {"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:14:54.179959 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:14:54.180281 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:14:54.181447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.181858 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:54.182167 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:14:54.183329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.183625 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec9ffffb-d009-59d0-834d-14a1cf5ba45b', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:54.184634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.185401 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:54.188715 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.191284 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.191513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap698ccfda-7c, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:54.191969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap698ccfda-7c, col_values=(('qos', UUID('013c760b-70ae-4ccb-9024-0f10810d5fa8')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:54.192291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap698ccfda-7c, col_values=(('external_ids', {'iface-id': '698ccfda-7c5d-449d-98b9-d02743a4668f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:5d:ab', 'vm-uuid': 'e3721d09-cca1-4d1d-81f5-7bc9759571cf'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:14:54.193361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.194674 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:14:54.201285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:54.202384 np0000003830 nova-compute[98984]: INFO os_vif [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c')
Jun 27 04:14:54.454569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:55.722661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:55.723086 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:14:55.723086 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] No VIF found with MAC fa:16:3e:24:5d:ab, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:14:55.723410 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Using config drive
Jun 27 04:14:56.230321 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:14:56.405214 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Creating config drive at /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.config
Jun 27 04:14:56.409013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps7ibcyme {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:14:56.498971 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps7ibcyme" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:14:56.531918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.359s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:14:56.532716 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:14:56.532995 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:14:56.562792 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a (non-flash)
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:14:56.563092 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:14:56.563353 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', '107')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:14:56.563446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', '104')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:14:56.565025 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a', '105')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:14:56.566251 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538296e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:14:56.566665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:14:56.567009 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flush multipath device 330000000131ba669 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:14:56.607523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:14:56.668995 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:14:56.724981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:14:56.724981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:14:56.724981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:14:56.748786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:14:56.748786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:14:56.748786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:56.797092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.40.100,3260]
Jun 27 04:14:56.797092 np0000003830 nova-compute[98984]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.40.100,3260] successful.
Jun 27 04:14:56.797092 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:56.813602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:56.827102 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:56.858253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.50.100,3260]
Jun 27 04:14:56.858253 np0000003830 nova-compute[98984]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-8ecedcdf-42d1-47ff-9cfc-02c71d11a49a, portal: 192.168.50.100,3260] successful.
Jun 27 04:14:56.858253 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:56.876755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:14:56.878003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:14:56.878188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== disconnect_volume: return (2706ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:14:56.878383 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:14:57.099524 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.137692 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.140920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.227984 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.395210 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bc79c9e3-cf32-4eb2-b917-e28d7cef3b6f req-6da9d039-9705-4d49-8563-61e267e83251 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-plugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:57.395870 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bc79c9e3-cf32-4eb2-b917-e28d7cef3b6f req-6da9d039-9705-4d49-8563-61e267e83251 service nova] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:57.396046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bc79c9e3-cf32-4eb2-b917-e28d7cef3b6f req-6da9d039-9705-4d49-8563-61e267e83251 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:57.396222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bc79c9e3-cf32-4eb2-b917-e28d7cef3b6f req-6da9d039-9705-4d49-8563-61e267e83251 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:57.396317 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bc79c9e3-cf32-4eb2-b917-e28d7cef3b6f req-6da9d039-9705-4d49-8563-61e267e83251 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Processing event network-vif-plugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:14:57.471881 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 369f807f-1f9c-4c3a-b2d4-28e28f697c6c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:14:57.547610 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.563734 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.567989 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.569092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:57.597376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:58.287039 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:14:58.287643 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533698.2872066, e3721d09-cca1-4d1d-81f5-7bc9759571cf => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:58.287996 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] VM Started (Lifecycle Event)
Jun 27 04:14:58.290332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:14:58.292993 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Instance spawned successfully.
Jun 27 04:14:58.293229 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:14:58.482599 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1dba6fb-a2e5-49d0-b621-153e7d6527b9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.488s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:58.791624 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:58.801316 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:14:58.810573 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:58.810711 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:58.811161 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:58.811419 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:58.811794 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:58.812117 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:14:59.020544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:59.020767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:59.021039 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Rebooting instance
Jun 27 04:14:59.197761 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:59.307329 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:14:59.307822 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533699.307296, e3721d09-cca1-4d1d-81f5-7bc9759571cf => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:59.307822 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] VM Paused (Lifecycle Event)
Jun 27 04:14:59.318682 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Took 8.05 seconds to spawn the instance on the hypervisor.
Jun 27 04:14:59.318937 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:59.458187 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:14:59.477689 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-72d3b31b-ad5d-4c93-b9fe-0cf44569e289 req-75ca19c3-ec5e-471f-ad19-61a6069663d5 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-plugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:14:59.478165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-72d3b31b-ad5d-4c93-b9fe-0cf44569e289 req-75ca19c3-ec5e-471f-ad19-61a6069663d5 service nova] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:59.478381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-72d3b31b-ad5d-4c93-b9fe-0cf44569e289 req-75ca19c3-ec5e-471f-ad19-61a6069663d5 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:59.478577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-72d3b31b-ad5d-4c93-b9fe-0cf44569e289 req-75ca19c3-ec5e-471f-ad19-61a6069663d5 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:59.478699 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-72d3b31b-ad5d-4c93-b9fe-0cf44569e289 req-75ca19c3-ec5e-471f-ad19-61a6069663d5 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] No waiting events found dispatching network-vif-plugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:14:59.478864 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-72d3b31b-ad5d-4c93-b9fe-0cf44569e289 req-75ca19c3-ec5e-471f-ad19-61a6069663d5 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received unexpected event network-vif-plugged-698ccfda-7c5d-449d-98b9-d02743a4668f for instance with vm_state active and task_state None.
Jun 27 04:14:59.515342 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:59.515700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:59.515949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:14:59.516156 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:14:59.516329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:14:59.518970 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Terminating instance
Jun 27 04:14:59.593380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:14:59.593617 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:14:59.593832 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:14:59.810530 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:14:59.813076 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533699.8127332, e3721d09-cca1-4d1d-81f5-7bc9759571cf => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:14:59.813309 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] VM Resumed (Lifecycle Event)
Jun 27 04:14:59.827915 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Took 13.49 seconds to build instance.
Jun 27 04:15:00.029764 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:15:00.052221 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.055313 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.088750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.094874 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.104337 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:00.126812 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.322850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:00.322850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:00.330661 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3e7754ec-38e0-4ca5-9455-fdae7dc0d4ca tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.998s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:00.331678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.372585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.395387 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Instance destroyed successfully.
Jun 27 04:15:00.395387 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'resources' on Instance uuid 369f807f-1f9c-4c3a-b2d4-28e28f697c6c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:00.405333 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-66876bfc-52bb-4e11-87ab-1931df4ded97 req-3897a825-af82-4908-9df5-6c2b6e9c4a4c service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:00.407992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-66876bfc-52bb-4e11-87ab-1931df4ded97 req-3897a825-af82-4908-9df5-6c2b6e9c4a4c service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:00.408474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-66876bfc-52bb-4e11-87ab-1931df4ded97 req-3897a825-af82-4908-9df5-6c2b6e9c4a4c service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:00.410220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-66876bfc-52bb-4e11-87ab-1931df4ded97 req-3897a825-af82-4908-9df5-6c2b6e9c4a4c service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:00.410402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.414007 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-66876bfc-52bb-4e11-87ab-1931df4ded97 req-3897a825-af82-4908-9df5-6c2b6e9c4a4c service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:00.414265 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-66876bfc-52bb-4e11-87ab-1931df4ded97 req-3897a825-af82-4908-9df5-6c2b6e9c4a4c service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:00.622190 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:00.814230 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:00.829653 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999576139000055 future=<Future at 0x7ec5381ffc20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:00.829653 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99917681199986 future=<Future at 0x7ec5381ffc20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:00.829653 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999009193999882 future=<Future at 0x7ec5381ffc20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:00.863882 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.871712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.876811 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.896557 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:13:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1430360511',display_name='tempest-TestEncryptedCinderVolumes-server-1430360511',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1430360511',id=41,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6YRMst/9RKz8EyOaIiB+mBEO4fn3TZxC0AWnrJ7zlkHB6pkKFx2v7S1MJOwlABFoE2PzPm+l0AH2bjZ14m6hS8xzM+S2excHG2SHvlmimz0zeglKqcNlLVhoKr70M4Jg==',key_name='tempest-keypair-128199564',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:14:04Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-kq0fygfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=369f807f-1f9c-4c3a-b2d4-28e28f697c6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:15:00.896557 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "2f7efb1a-130e-45dd-b077-127b3da195c7", "address": "fa:16:3e:d6:d5:67", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7efb1a-13", "ovs_interfaceid": "2f7efb1a-130e-45dd-b077-127b3da195c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:00.896557 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:00.896557 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:15:00.897683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.897933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f7efb1a-13, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:00.899113 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.900093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:00.902337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.904969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.906123 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.906533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8adf60e-5863-4d71-83d6-57c9e519089a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:00.909370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.909370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:00.909370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:00.910946 np0000003830 nova-compute[98984]: INFO os_vif [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2f7efb1a-130e-45dd-b077-127b3da195c7,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7efb1a-13')
Jun 27 04:15:00.912465 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Deleting instance files /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c_del
Jun 27 04:15:00.912465 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Deletion of /opt/stack/data/nova/instances/369f807f-1f9c-4c3a-b2d4-28e28f697c6c_del complete
Jun 27 04:15:01.029991 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:01.054015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:01.316839 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:01.424293 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:15:01.428984 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:15:01.428984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:15:01.429471 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:15:01.429471 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:01.580972 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:01.821514 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:02.154044 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-85ff0e18-9bfa-4b70-8793-c5f4289d44ca req-cc1be5cf-a78e-457c-9b45-e7fabd631627 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-deleted-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:02.154440 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-85ff0e18-9bfa-4b70-8793-c5f4289d44ca req-cc1be5cf-a78e-457c-9b45-e7fabd631627 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Neutron deleted interface 2f7efb1a-130e-45dd-b077-127b3da195c7; detaching it from the instance and deleting it from the info cache
Jun 27 04:15:02.157185 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-85ff0e18-9bfa-4b70-8793-c5f4289d44ca req-cc1be5cf-a78e-457c-9b45-e7fabd631627 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Detach interface failed, port_id=2f7efb1a-130e-45dd-b077-127b3da195c7, reason: Instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:15:02.483112 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:02.486281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:02.486611 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:02.486929 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:02.487098 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:02.487261 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:02.487487 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:02.487798 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:02.487995 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:02.488166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:02.488348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:02.488516 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received unexpected event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with vm_state active and task_state deleting.
Jun 27 04:15:02.488675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:02.488873 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:02.489028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:02.489212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:02.489377 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:02.489576 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received unexpected event network-vif-plugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with vm_state active and task_state deleting.
Jun 27 04:15:02.490135 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:02.490324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:02.490729 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:02.490892 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:02.491056 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:02.491228 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:02.491387 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:02.491594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Acquiring lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:02.491782 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:02.491924 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:02.492071 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] No waiting events found dispatching network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:02.492225 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8494ba6b-625c-40bb-b010-23b010ec757c req-35301b22-3f87-49df-bb86-1defa04595c1 service nova] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Received event network-vif-unplugged-2f7efb1a-130e-45dd-b077-127b3da195c7 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:02.602761 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:03.104465 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Took 1.68 seconds to deallocate network for instance.
Jun 27 04:15:03.170739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:03.171301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:03.171301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:03.171301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:03.171605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:03.176215 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Terminating instance
Jun 27 04:15:03.610635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:03.611076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:03.681585 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:15:03.701544 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:03.703012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:03.733339 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:03.762969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:03.856024 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8edeaf3d-5d86-4100-bbac-780f363c3b72 req-3eafda11-56ab-432e-8715-2b97cdb8b670 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-unplugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:03.858037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8edeaf3d-5d86-4100-bbac-780f363c3b72 req-3eafda11-56ab-432e-8715-2b97cdb8b670 service nova] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:03.858224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8edeaf3d-5d86-4100-bbac-780f363c3b72 req-3eafda11-56ab-432e-8715-2b97cdb8b670 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:03.858400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8edeaf3d-5d86-4100-bbac-780f363c3b72 req-3eafda11-56ab-432e-8715-2b97cdb8b670 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:03.858577 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8edeaf3d-5d86-4100-bbac-780f363c3b72 req-3eafda11-56ab-432e-8715-2b97cdb8b670 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] No waiting events found dispatching network-vif-unplugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:03.858790 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8edeaf3d-5d86-4100-bbac-780f363c3b72 req-3eafda11-56ab-432e-8715-2b97cdb8b670 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-unplugged-698ccfda-7c5d-449d-98b9-d02743a4668f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:04.009716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:04.009982 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:04.033667 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999750030000087 future=<Future at 0x7ec518238c20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:04.037380 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Instance destroyed successfully.
Jun 27 04:15:04.037380 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lazy-loading 'resources' on Instance uuid e3721d09-cca1-4d1d-81f5-7bc9759571cf {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:04.461832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:04.514042 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:04.539989 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-600678041',display_name='tempest-VolumesActionsTest-instance-600678041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-600678041',id=45,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:14:59Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbc4bbb57b484481bf3cc234fdb870c7',ramdisk_id='',reservation_id='r-34brvczz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-463751719',owner_user_name='tempest-VolumesActionsTest-463751719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:14:59Z,user_data=None,user_id='13c2bc77d02a4c81b4c573a8044a95ee',uuid=e3721d09-cca1-4d1d-81f5-7bc9759571cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:15:04.540248 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converting VIF {"id": "698ccfda-7c5d-449d-98b9-d02743a4668f", "address": "fa:16:3e:24:5d:ab", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap698ccfda-7c", "ovs_interfaceid": "698ccfda-7c5d-449d-98b9-d02743a4668f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:04.540702 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:04.540913 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:15:04.541743 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:04.541928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap698ccfda-7c, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:04.542914 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:04.543666 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:04.544458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:04.545067 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:04.545191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=013c760b-70ae-4ccb-9024-0f10810d5fa8) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:04.546180 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:04.546878 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:04.551173 np0000003830 nova-compute[98984]: INFO os_vif [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5d:ab,bridge_name='br-int',has_traffic_filtering=True,id=698ccfda-7c5d-449d-98b9-d02743a4668f,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap698ccfda-7c')
Jun 27 04:15:04.551515 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Deleting instance files /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf_del
Jun 27 04:15:04.552152 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Deletion of /opt/stack/data/nova/instances/e3721d09-cca1-4d1d-81f5-7bc9759571cf_del complete
Jun 27 04:15:05.020282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.409s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:05.058955 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 27 04:15:05.059541 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:15:05.060271 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:15:05.060544 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:15:05.060808 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:05.097303 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deleted allocations for instance 369f807f-1f9c-4c3a-b2d4-28e28f697c6c
Jun 27 04:15:05.145756 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:05.437689 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:05.446398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:05.471931 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:05.517982 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:05.563146 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3bfa2e9a-ffdd-4448-ac25-d30939c273c2 req-642504e6-9674-48a4-a0ad-9cb32ce7d101 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-deleted-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:05.563292 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-3bfa2e9a-ffdd-4448-ac25-d30939c273c2 req-642504e6-9674-48a4-a0ad-9cb32ce7d101 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Neutron deleted interface 698ccfda-7c5d-449d-98b9-d02743a4668f; detaching it from the instance and deleting it from the info cache
Jun 27 04:15:05.566616 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3bfa2e9a-ffdd-4448-ac25-d30939c273c2 req-642504e6-9674-48a4-a0ad-9cb32ce7d101 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Detach interface failed, port_id=698ccfda-7c5d-449d-98b9-d02743a4668f, reason: Instance e3721d09-cca1-4d1d-81f5-7bc9759571cf could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:15:05.807182 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99973806700018 future=<Future at 0x7ec53821bb90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:05.846350 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance shutdown successfully.
Jun 27 04:15:05.922003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-52032c39-3391-407f-9f29-9795e39f1fe9 req-20681228-d65b-4811-9d92-7f45e7e1d1f4 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-unplugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:05.922360 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-52032c39-3391-407f-9f29-9795e39f1fe9 req-20681228-d65b-4811-9d92-7f45e7e1d1f4 service nova] Acquiring lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:05.922563 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-52032c39-3391-407f-9f29-9795e39f1fe9 req-20681228-d65b-4811-9d92-7f45e7e1d1f4 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:05.922671 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-52032c39-3391-407f-9f29-9795e39f1fe9 req-20681228-d65b-4811-9d92-7f45e7e1d1f4 service nova] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:05.922869 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-52032c39-3391-407f-9f29-9795e39f1fe9 req-20681228-d65b-4811-9d92-7f45e7e1d1f4 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] No waiting events found dispatching network-vif-unplugged-698ccfda-7c5d-449d-98b9-d02743a4668f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:05.922975 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-52032c39-3391-407f-9f29-9795e39f1fe9 req-20681228-d65b-4811-9d92-7f45e7e1d1f4 service nova] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Received event network-vif-unplugged-698ccfda-7c5d-449d-98b9-d02743a4668f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:06.011555 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:06.108419 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89c39e7e-074a-43b2-8e11-b5bcf02328a3 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "369f807f-1f9c-4c3a-b2d4-28e28f697c6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.593s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:06.356848 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.394952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.402114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.513902 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:15:06.516984 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.774033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:06.774376 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:06.797003 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.801076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.803802 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:06.832126 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:07.024343 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:07.024667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:07.277935 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:15:07.408525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:07.408711 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:07.427749 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 due to new event <LifecycleEvent: 1782533707.4273968, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:15:07.428615 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533707.4273968, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:07.431035 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] VM Resumed (Lifecycle Event)
Jun 27 04:15:07.432070 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance running successfully.
Jun 27 04:15:07.432442 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance soft rebooted successfully.
Jun 27 04:15:07.432687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:07.635532 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:07.635676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:07.636145 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:07.636291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:07.636437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:07.636583 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received unexpected event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with vm_state active and task_state None.
Jun 27 04:15:07.636677 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:07.636785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:07.637163 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:07.638312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:07.638443 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:07.638589 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received unexpected event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with vm_state active and task_state None.
Jun 27 04:15:07.638678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:07.638781 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:07.638886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:07.638977 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:07.639068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:07.639165 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received unexpected event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with vm_state active and task_state None.
Jun 27 04:15:07.639251 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:07.641830 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:07.641960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:07.642093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:07.642382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:07.642510 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3d1c3c8c-0547-4999-a808-6e3e7aab82d5 req-c9bd6062-4b79-42e3-b1c6-f71751e9b8f7 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received unexpected event network-vif-plugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with vm_state active and task_state None.
Jun 27 04:15:07.847369 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:07.911562 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:07.933783 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:07.936258 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:07.955034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a02e2c09-6300-4cb3-a408-134b0748da67 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.934s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:08.420923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.396s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:08.422927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.574s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:08.427542 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:15:08.427851 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Claim successful on node np0000003830
Jun 27 04:15:08.438998 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533708.4386368, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:08.439240 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] VM Started (Lifecycle Event)
Jun 27 04:15:08.525842 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Deleted allocations for instance e3721d09-cca1-4d1d-81f5-7bc9759571cf
Jun 27 04:15:08.941641 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:08.943578 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:09.462418 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:09.530529 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-affddf6f-e570-4dcb-ba79-527121c4f32d tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "e3721d09-cca1-4d1d-81f5-7bc9759571cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.360s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:09.547466 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:09.731326 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:09.731652 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:10.235525 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:10.745232 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.324s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:10.746399 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:15:11.253909 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:15:11.255348 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:15:11.255348 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:11.255348 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:11.329461 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db2d0b5572c9405aafaa0091643121a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d99f8411b741b2ae3a730bfefef27b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:15:11.435523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:11.435523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:11.758244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:11.758730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:11.760867 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:15:11.937241 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:15:12.047898 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Successfully created port: 948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:15:12.260208 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:15:12.268049 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:15:12.501394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:12.501394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:12.501394 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:15:12.501394 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Claim successful on node np0000003830
Jun 27 04:15:12.840045 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:12.917708 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Successfully updated port: 948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:15:12.961991 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Received event network-changed-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:12.962505 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Refreshing instance network info cache due to event network-changed-948b7213-232b-4bbc-a30d-8b316076fd8b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:12.962846 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] Acquiring lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:12.962996 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] Acquired lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:12.963151 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Refreshing network info cache for port 948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:13.275509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:15:13.276688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:15:13.276975 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Creating image(s)
Jun 27 04:15:13.277582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "/opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:13.277822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "/opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:13.278414 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "/opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:13.283638 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:13.284084 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:13.285166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:13.397520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.112s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:13.398072 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:13.398560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:13.399041 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:13.402131 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:13.402474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:13.418401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:13.466087 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:13.493905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:13.494419 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:13.557874 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:13.589164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk 1073741824" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:13.589164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:13.589164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:13.696760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:13.697301 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:15:13.697588 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:13.791410 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:13.813931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:13.814219 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Cannot resize image /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:15:13.814689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:15:13.814845 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Ensure instance console log exists: /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:15:13.815077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:13.815286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:13.815431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:13.949683 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:13.950079 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:14.294684 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-032b8fd6-4ece-4285-862d-62583e53472e req-6dca53f4-d309-426c-9c02-0223173335fa service nova] Releasing lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:14.295193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquired lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:14.295382 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:15:14.452944 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:14.466392 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:14.548803 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:14.885259 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:14.963222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.466s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:14.963734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.125s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:14.964360 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:15:14.968134 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:15:14.968290 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Claim successful on node np0000003830
Jun 27 04:15:15.040487 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:15.173604 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Updating instance_info_cache with network_info: [{"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:15.475169 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:15:15.475400 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:15:15.475761 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:15.475978 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:15.557404 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c2bc77d02a4c81b4c573a8044a95ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbc4bbb57b484481bf3cc234fdb870c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:15:15.676155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Releasing lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:15.676155 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Instance network_info: |[{"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:15:15.680237 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Start _get_guest_xml network_info=[{"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:15:15.688462 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:15:15.691780 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-681704950', uuid='68efeba8-e1f9-421b-bcd0-a8a8116b4c80'), owner=OwnerMeta(userid='db2d0b5572c9405aafaa0091643121a6', username='tempest-TestEncryptedCinderVolumes-1089025697-project-member', projectid='47d99f8411b741b2ae3a730bfefef27b', projectname='tempest-TestEncryptedCinderVolumes-1089025697'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533715.690066) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:15:15.696839 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:15:15.697332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:15:15.698370 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:15:15.699872 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:15:15.699872 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:15:15.700133 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:15:15.700339 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:15:15.700478 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:15:15.700669 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:15:15.700868 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:15:15.701006 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:15:15.701297 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:15:15.701462 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:15:15.701696 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:15:15.701864 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:15:15.702030 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:15:15.712819 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-681704950',display_name='tempest-TestEncryptedCinderVolumes-server-681704950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-681704950',id=46,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItdecCAgggdpBWVtYsXEmK4IUyyeeqKhg23wISR9k4TSa/jQ64Q8L8jMCZvo8zmEB66Y/n5P00KJLI8m2M90k5Jwjzdo+ktJBrbhQFwvHbS4g208YMDgHEcEKB7uA3Bw==',key_name='tempest-keypair-593816567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-tbxzxiat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2d0b5572c9405aafaa0091643121a6',uuid=68efeba8-e1f9-421b-bcd0-a8a8116b4c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:15:15.713077 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:15.713645 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:15.714378 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'pci_devices' on Instance uuid 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:15.825792 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003876060000038706 future=<Future at 0x7ec5381ffc20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:15.826206 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Emitting event <LifecycleEvent: 1782533700.825283, 369f807f-1f9c-4c3a-b2d4-28e28f697c6c => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:15.826350 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:15.826503 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] VM Stopped (Lifecycle Event)
Jun 27 04:15:15.827472 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.2056345569999394 future=<Future at 0x7ec518238c20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:15.828244 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.204837819000204 future=<Future at 0x7ec518238c20 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:15.942434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:15.942434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:15.984129 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:15:16.035420 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Successfully created port: 64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <uuid>68efeba8-e1f9-421b-bcd0-a8a8116b4c80</uuid>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <name>instance-0000002e</name>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-681704950</nova:name>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:15:15</nova:creationTime>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:user uuid="db2d0b5572c9405aafaa0091643121a6">tempest-TestEncryptedCinderVolumes-1089025697-project-member</nova:user>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:project uuid="47d99f8411b741b2ae3a730bfefef27b">tempest-TestEncryptedCinderVolumes-1089025697</nova:project>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         <nova:port uuid="948b7213-232b-4bbc-a30d-8b316076fd8b">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <entry name="serial">68efeba8-e1f9-421b-bcd0-a8a8116b4c80</entry>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <entry name="uuid">68efeba8-e1f9-421b-bcd0-a8a8116b4c80</entry>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.config"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d1:48:6e"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <target dev="tap948b7213-23"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/console.log" append="off"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:15:16.216777 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Preparing to wait for external event network-vif-plugged-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-681704950',display_name='tempest-TestEncryptedCinderVolumes-server-681704950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-681704950',id=46,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItdecCAgggdpBWVtYsXEmK4IUyyeeqKhg23wISR9k4TSa/jQ64Q8L8jMCZvo8zmEB66Y/n5P00KJLI8m2M90k5Jwjzdo+ktJBrbhQFwvHbS4g208YMDgHEcEKB7uA3Bw==',key_name='tempest-keypair-593816567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-tbxzxiat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2d0b5572c9405aafaa0091643121a6',uuid=68efeba8-e1f9-421b-bcd0-a8a8116b4c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:16.218819 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:15:16.219186 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.219397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:16.219641 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:15:16.220309 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.220506 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b00eba03-863b-5c16-ac9e-acfe695def65', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:16.221304 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.222019 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:16.223386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.233151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.233151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap948b7213-23, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:16.233151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap948b7213-23, col_values=(('qos', UUID('c191a2cb-ee69-43b9-850d-b6f330a94d98')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:16.233151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap948b7213-23, col_values=(('external_ids', {'iface-id': '948b7213-232b-4bbc-a30d-8b316076fd8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:48:6e', 'vm-uuid': '68efeba8-e1f9-421b-bcd0-a8a8116b4c80'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:16.233570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.235267 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:16.242141 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:16.243935 np0000003830 nova-compute[98984]: INFO os_vif [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23')
Jun 27 04:15:16.298735 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:16.299284 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:16.329252 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c4c94ca3-2064-4ae1-abc3-bccc252cb84c tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: 369f807f-1f9c-4c3a-b2d4-28e28f697c6c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:16.445375 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'flavor' on Instance uuid 6e74649b-6954-4503-88e8-3d819ef17d34 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:16.487622 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:15:16.773573 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Successfully updated port: 64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:15:16.801830 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:16.821565 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-changed-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:16.822462 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Refreshing instance network info cache due to event network-changed-64e4e4cb-6472-4813-9828-6391fa5d0517. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:16.822635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] Acquiring lock "refresh_cache-634b4e13-367a-465a-832c-a45d8d90b07d" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:16.822725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] Acquired lock "refresh_cache-634b4e13-367a-465a-832c-a45d8d90b07d" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:16.822825 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Refreshing network info cache for port 64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:16.950443 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Ignoring supplied device name: /dev/vdb
Jun 27 04:15:17.275408 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "refresh_cache-634b4e13-367a-465a-832c-a45d8d90b07d" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:17.307613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.344s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:17.307941 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:15:17.324808 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:17.381605 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:17.453344 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:17.494406 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:15:17.495287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:15:17.495523 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Creating image(s)
Jun 27 04:15:17.495949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "/opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:17.496083 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "/opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:17.496525 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "/opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:17.497169 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:17.500144 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:17.501285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:17.528007 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:17.590359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:17.590805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:17.591305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:17.591775 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:17.594361 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:17.594682 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:17.698807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.104s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:17.699408 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:17.761816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk 1073741824" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:17.762475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:17.762935 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:17.796248 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:17.796394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:17.796505 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No VIF found with MAC fa:16:3e:d1:48:6e, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:17.797426 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Using config drive
Jun 27 04:15:17.816361 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:15:17.816621 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:15:17.818781 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:17.819167 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:17.865909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.103s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:17.866525 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:15:17.866716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:17.932804 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a2a8189b804630997728bfb949fba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c1eb5f65f0446eae1f4967af349cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:15:17.962741 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:17.963191 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Cannot resize image /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:15:17.963688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:15:17.963919 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Ensure instance console log exists: /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:15:17.964309 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:17.964462 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:17.964679 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:18.032521 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-43f88c56-0806-4224-bda0-2f025d317a93 req-37aadb11-595b-4d45-994b-43701341192d service nova] Releasing lock "refresh_cache-634b4e13-367a-465a-832c-a45d8d90b07d" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:18.035121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquired lock "refresh_cache-634b4e13-367a-465a-832c-a45d8d90b07d" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:18.035657 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:15:18.307020 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:18.323163 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:15:18.479955 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Creating config drive at /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.config
Jun 27 04:15:18.482467 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Successfully created port: bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:15:18.488356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6_73oip7 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:18.559421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6_73oip7" returned: 0 in 0.071s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:18.573905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:18.574106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:18.574983 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Attaching volume 1ee7c7d7-a681-4baf-a960-09dbad317c59 to /dev/vdb
Jun 27 04:15:18.614989 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:18.633663 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:15:18.646105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:15:18.667598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:18.720180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:15:18.720459 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:15:18.728551 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:15:18.729507 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fea5:4a1', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe35:4909', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fe5c:5876', 'fe80::80f0:94ff:feae:c312'] 
Jun 27 04:15:18.729628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:15:18.729724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:15:18.729923 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:15:18.730141 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Updating existing volume attachment record: 1d0c36e8-c019-4377-bdaa-9db813ded986 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:15:18.796477 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:18.828792 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:15:18.976309 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Updating instance_info_cache with network_info: [{"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:19.033621 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000518957999702252 future=<Future at 0x7ec518238c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:19.033731 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:19.034656 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.7728301540000757 future=<Future at 0x7ec53821bb90 state=cancelled>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:19.037640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.039569 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] Emitting event <LifecycleEvent: 1782533704.0329988, e3721d09-cca1-4d1d-81f5-7bc9759571cf => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:19.039838 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] VM Stopped (Lifecycle Event)
Jun 27 04:15:19.041749 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.764971143999901 future=<Future at 0x7ec53821bb90 state=cancelled>) was cancelled while queued, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:19.041917 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:19.073358 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.099112 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Successfully updated port: bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:15:19.170124 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Received event network-changed-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:19.170346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Refreshing instance network info cache due to event network-changed-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:19.170645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] Acquiring lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:19.171714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] Acquired lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:19.171882 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Refreshing network info cache for port bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:19.185787 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.280399 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cebbab10-4a10-4d6a-a686-04056ba9585a req-27c61127-b6be-44b2-9bdd-58c689eb304c service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Received event network-vif-plugged-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:19.280621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cebbab10-4a10-4d6a-a686-04056ba9585a req-27c61127-b6be-44b2-9bdd-58c689eb304c service nova] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:19.280756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cebbab10-4a10-4d6a-a686-04056ba9585a req-27c61127-b6be-44b2-9bdd-58c689eb304c service nova] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:19.280885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cebbab10-4a10-4d6a-a686-04056ba9585a req-27c61127-b6be-44b2-9bdd-58c689eb304c service nova] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:19.280984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cebbab10-4a10-4d6a-a686-04056ba9585a req-27c61127-b6be-44b2-9bdd-58c689eb304c service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Processing event network-vif-plugged-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:15:19.297998 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:15:19.298409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ee7c7d7-a681-4baf-a960-09dbad317c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:15:19.298598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:19.299126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:19.299228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ee7c7d7-a681-4baf-a960-09dbad317c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:15:19.318047 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:19.319115 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:19.320486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:19.320486 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:15:19.320486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:19.321164 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:15:19.334572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:15:19.334572 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:19.342561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:15:19.342561 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59] added
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:19.350171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:15:19.350419 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:15:19.350669 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59] added
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:19.354542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:15:19.354934 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:15:19.354934 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:15:19.453949 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.456200 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.458399 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.481718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Releasing lock "refresh_cache-634b4e13-367a-465a-832c-a45d8d90b07d" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:19.481986 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Instance network_info: |[{"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:15:19.484792 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Start _get_guest_xml network_info=[{"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:15:19.484966 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:19.490488 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:15:19.491894 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1315317086', uuid='634b4e13-367a-465a-832c-a45d8d90b07d'), owner=OwnerMeta(userid='13c2bc77d02a4c81b4c573a8044a95ee', username='tempest-VolumesActionsTest-463751719-project-member', projectid='bbc4bbb57b484481bf3cc234fdb870c7', projectname='tempest-VolumesActionsTest-463751719'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533719.4915316) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:15:19.493853 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:15:19.494213 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:15:19.495112 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:15:19.495303 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:15:19.496268 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:15:19.496607 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:15:19.496767 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:15:19.496897 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:15:19.497072 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:15:19.497235 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:15:19.497377 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:15:19.497585 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:15:19.497733 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:15:19.497874 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:15:19.498014 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:15:19.498236 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:15:19.511684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1315317086',display_name='tempest-VolumesActionsTest-instance-1315317086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-1315317086',id=47,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbc4bbb57b484481bf3cc234fdb870c7',ramdisk_id='',reservation_id='r-g2wg8noy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-463751719',owner_user_name='tempest-VolumesActionsTest-463751719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:17Z,user_data=None,user_id='13c2bc77d02a4c81b4c573a8044a95ee',uuid=634b4e13-367a-465a-832c-a45d8d90b07d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:15:19.511872 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converting VIF {"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:19.513784 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:19.515005 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lazy-loading 'pci_devices' on Instance uuid 634b4e13-367a-465a-832c-a45d8d90b07d {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:19.545016 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bea1ac42-c312-43e6-883f-d67499020622 tempest-ServerRescueNegativeTestJSON-1862600164 tempest-ServerRescueNegativeTestJSON-1862600164-project-member] [instance: e3721d09-cca1-4d1d-81f5-7bc9759571cf] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:19.603037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:19.617356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:19.617592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:19.674410 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:19.731846 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:19.844682 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:15:19.845596 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:15:19.845956 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Creating image(s)
Jun 27 04:15:19.846452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "/opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:19.846744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:19.847384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:19.850517 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:19.851171 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:19.852457 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:19.883196 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533719.8821833, 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:19.883443 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] VM Started (Lifecycle Event)
Jun 27 04:15:19.889509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:15:19.892950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:15:19.896683 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Instance spawned successfully.
Jun 27 04:15:19.897118 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:15:19.903461 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:19.940072 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:19.943513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:19.943513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:19.943513 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:19.945997 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:19.946484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <uuid>634b4e13-367a-465a-832c-a45d8d90b07d</uuid>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <name>instance-0000002f</name>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesActionsTest-instance-1315317086</nova:name>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:15:19</nova:creationTime>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:user uuid="13c2bc77d02a4c81b4c573a8044a95ee">tempest-VolumesActionsTest-463751719-project-member</nova:user>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:project uuid="bbc4bbb57b484481bf3cc234fdb870c7">tempest-VolumesActionsTest-463751719</nova:project>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         <nova:port uuid="64e4e4cb-6472-4813-9828-6391fa5d0517">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <entry name="serial">634b4e13-367a-465a-832c-a45d8d90b07d</entry>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <entry name="uuid">634b4e13-367a-465a-832c-a45d8d90b07d</entry>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.config"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:3a:35:97"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <target dev="tap64e4e4cb-64"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/console.log" append="off"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:15:20.021938 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:15:20.024612 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Preparing to wait for external event network-vif-plugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:15:20.024612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:20.025069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:20.025069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:20.026637 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1315317086',display_name='tempest-VolumesActionsTest-instance-1315317086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-1315317086',id=47,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbc4bbb57b484481bf3cc234fdb870c7',ramdisk_id='',reservation_id='r-g2wg8noy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-463751719',owner_user_name='tempest-VolumesActionsTest-463751719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:17Z,user_data=None,user_id='13c2bc77d02a4c81b4c573a8044a95ee',uuid=634b4e13-367a-465a-832c-a45d8d90b07d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:15:20.027043 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converting VIF {"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:20.028033 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:20.028435 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:15:20.029058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:20.029459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:20.029856 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:15:20.031049 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:20.031248 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '209a1936-c842-5167-a4c0-4aa98713e6dd', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:20.032077 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:20.032746 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:20.033814 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:20.036244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:20.036379 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64e4e4cb-64, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:20.036790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64e4e4cb-64, col_values=(('qos', UUID('c41b898f-8aed-493e-937c-c7a220820d4c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:20.036982 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64e4e4cb-64, col_values=(('external_ids', {'iface-id': '64e4e4cb-6472-4813-9828-6391fa5d0517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:35:97', 'vm-uuid': '634b4e13-367a-465a-832c-a45d8d90b07d'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:20.039290 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:20.041129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:20.045011 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:20.059597 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:20.067169 np0000003830 nova-compute[98984]: INFO os_vif [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64')
Jun 27 04:15:20.102391 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk 1073741824" returned: 0 in 0.061s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:20.105519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:20.105519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:20.125816 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:20.193993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:20.194834 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:15:20.194834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:20.286241 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:20.286829 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Cannot resize image /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:15:20.287397 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:15:20.287836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Ensure instance console log exists: /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:15:20.288329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:20.288718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:20.289041 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:20.351107 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:15:20.355234 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:15:20.363083 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:15:20.369853 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.377403 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.389188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.390957 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:20.394386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.394386 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.394386 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:20.394578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.394578 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.394578 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:20.398418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:20.403107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.403107 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.403107 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:20.403288 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.403288 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.403288 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:20.409001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fd859bd0-04f0-4e32-b0ec-c69a0adbe5f8 req-ccd2ca21-f101-4306-b936-d1230a7dd56e service nova] Releasing lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:20.409379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:20.409919 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:15:20.414212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:20.414390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:20.414914 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:20.415640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:20.416121 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:20.416582 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:20.424291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.40.100,3260]
Jun 27 04:15:20.424291 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.40.100,3260] successful.
Jun 27 04:15:20.424291 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.439979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.450460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.50.100,3260]
Jun 27 04:15:20.450460 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.50.100,3260] successful.
Jun 27 04:15:20.450460 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.458430 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.458430 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.458430 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.458430 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.458430 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:20.458791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.458791 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.458791 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.458791 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.458791 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:20.458953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:20.459677 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:15:20.459836 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] HCTL ('9', '-', '-', 0) found on session 108 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:15:20.460229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:15:20.470128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:20.482914 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching for a device in session 108 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:15:20.483122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ee7c7d7-a681-4baf-a960-09dbad317c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:15:20.489279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.489279 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.489279 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.489279 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.489279 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:20.489545 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.489545 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:20.489545 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.489545 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:20.489545 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:20.489761 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:20.489959 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:15:20.490663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] HCTL ('10', '-', '-', 0) found on session 109 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:15:20.490799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:15:20.508826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching for a device in session 109 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:15:20.901316 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:15:20.901671 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533720.9014661, 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:20.901826 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] VM Paused (Lifecycle Event)
Jun 27 04:15:20.921806 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Took 7.65 seconds to spawn the instance on the hypervisor.
Jun 27 04:15:20.921970 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:20.977527 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:21.125310 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:21.134143 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:21.275323 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Updating instance_info_cache with network_info: [{"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:21.362290 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-585a40fe-7350-4a93-a505-26a48acf2684 req-66563f82-4a93-4201-8a52-53fd1b2342e9 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Received event network-vif-plugged-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:21.362801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-585a40fe-7350-4a93-a505-26a48acf2684 req-66563f82-4a93-4201-8a52-53fd1b2342e9 service nova] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:21.362801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-585a40fe-7350-4a93-a505-26a48acf2684 req-66563f82-4a93-4201-8a52-53fd1b2342e9 service nova] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:21.362801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-585a40fe-7350-4a93-a505-26a48acf2684 req-66563f82-4a93-4201-8a52-53fd1b2342e9 service nova] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:21.362973 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-585a40fe-7350-4a93-a505-26a48acf2684 req-66563f82-4a93-4201-8a52-53fd1b2342e9 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] No waiting events found dispatching network-vif-plugged-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:21.363143 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-585a40fe-7350-4a93-a505-26a48acf2684 req-66563f82-4a93-4201-8a52-53fd1b2342e9 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Received unexpected event network-vif-plugged-948b7213-232b-4bbc-a30d-8b316076fd8b for instance with vm_state active and task_state None.
Jun 27 04:15:21.404101 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:21.405958 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533721.4056902, 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:21.406054 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] VM Resumed (Lifecycle Event)
Jun 27 04:15:21.430994 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Took 13.65 seconds to build instance.
Jun 27 04:15:21.509436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Searching for a device in session 109 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:15:21.509631 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1ee7c7d7-a681-4baf-a960-09dbad317c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:15:21.596634 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:21.596816 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:21.597179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] No VIF found with MAC fa:16:3e:3a:35:97, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:21.597469 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Using config drive
Jun 27 04:15:21.777310 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:21.777685 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Instance network_info: |[{"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:15:21.779720 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Start _get_guest_xml network_info=[{"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:15:21.782872 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:15:21.784302 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1317894829', uuid='8479537c-b3ab-47ec-8dbd-6f6c50b90728'), owner=OwnerMeta(userid='c0a2a8189b804630997728bfb949fba1', username='tempest-TestEncryptedCinderVolumes-1777393507-project-member', projectid='56c1eb5f65f0446eae1f4967af349cd1', projectname='tempest-TestEncryptedCinderVolumes-1777393507'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533721.7838438) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:15:21.785650 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:15:21.785997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:15:21.787302 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:15:21.787565 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:15:21.788483 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:15:21.788843 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:15:21.789565 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:15:21.789713 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:15:21.789882 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:15:21.789973 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:15:21.790137 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:15:21.790318 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:15:21.790454 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:15:21.790589 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:15:21.790742 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:15:21.790917 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:15:21.803007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1317894829',display_name='tempest-TestEncryptedCinderVolumes-server-1317894829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1317894829',id=48,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDoOiknDkFVlVNe8OFvap1XxgRWaMmAdbEaO4MC1tfIC+AgLzE7nPsRJjPROBlBdnOlL/lew9IY/b4HE9TBT+uyfwoV/MqSCiiGskpmo+gHlvvubUPeCz8XFA3AaMA7QQ==',key_name='tempest-keypair-406104935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-ru21q8tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=8479537c-b3ab-47ec-8dbd-6f6c50b90728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:15:21.803337 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:21.803947 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:21.804862 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'pci_devices' on Instance uuid 8479537c-b3ab-47ec-8dbd-6f6c50b90728 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:21.908476 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:21.912157 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:21.934513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.160s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:22.103291 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:22.242617 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:22.242617 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:22.242617 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Attaching volume f55f4c1b-8be0-4eae-b306-4a20205f0117 to /dev/vdb
Jun 27 04:15:22.257085 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Creating config drive at /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.config
Jun 27 04:15:22.264443 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj6lxnm7 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:22.302631 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <uuid>8479537c-b3ab-47ec-8dbd-6f6c50b90728</uuid>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <name>instance-00000030</name>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1317894829</nova:name>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:15:21</nova:creationTime>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:user uuid="c0a2a8189b804630997728bfb949fba1">tempest-TestEncryptedCinderVolumes-1777393507-project-member</nova:user>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:project uuid="56c1eb5f65f0446eae1f4967af349cd1">tempest-TestEncryptedCinderVolumes-1777393507</nova:project>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         <nova:port uuid="bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <entry name="serial">8479537c-b3ab-47ec-8dbd-6f6c50b90728</entry>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <entry name="uuid">8479537c-b3ab-47ec-8dbd-6f6c50b90728</entry>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.config"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:62:18:8d"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <target dev="tapbfa72f01-5b"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/console.log" append="off"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:15:22.308850 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Preparing to wait for external event network-vif-plugged-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1317894829',display_name='tempest-TestEncryptedCinderVolumes-server-1317894829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1317894829',id=48,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDoOiknDkFVlVNe8OFvap1XxgRWaMmAdbEaO4MC1tfIC+AgLzE7nPsRJjPROBlBdnOlL/lew9IY/b4HE9TBT+uyfwoV/MqSCiiGskpmo+gHlvvubUPeCz8XFA3AaMA7QQ==',key_name='tempest-keypair-406104935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-ru21q8tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=8479537c-b3ab-47ec-8dbd-6f6c50b90728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a932230d-297a-58f4-a8eb-8d83cb89d5ad', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:15:22.330229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.330925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj6lxnm7" returned: 0 in 0.066s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:22.335971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.336330 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfa72f01-5b, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:22.337325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfa72f01-5b, col_values=(('qos', UUID('1f6b600f-32eb-46d9-bba1-9084a5ec8e2c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:22.337325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfa72f01-5b, col_values=(('external_ids', {'iface-id': 'bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:18:8d', 'vm-uuid': '8479537c-b3ab-47ec-8dbd-6f6c50b90728'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:22.340522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Found WWN 330000000ae0e3998 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:15:22.340522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:22.340657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000ae0e3998', 'path': '/dev/dm-1', 'multipath_id': '330000000ae0e3998'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:15:22.340792 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ae0e3998', 'path': '/dev/dm-1', 'multipath_id': '330000000ae0e3998'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:15:22.342772 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.345142 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:22.348712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:22.370343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.378022 np0000003830 nova-compute[98984]: INFO os_vif [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b')
Jun 27 04:15:22.382517 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'flavor' on Instance uuid 6e74649b-6954-4503-88e8-3d819ef17d34 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:22.397521 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:15:22.407647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:15:22.407647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:15:22.409019 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fea5:4a1', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe35:4909', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fe5c:5876', 'fe80::80f0:94ff:feae:c312', 'fe80::fc16:3eff:fed1:486e', 'fe80::b0cb:92ff:fef0:4818'] 
Jun 27 04:15:22.409448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:15:22.409821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:15:22.410143 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:15:22.410405 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Updating existing volume attachment record: 470ae4f9-084e-42a8-94f1-9f2dff956ae2 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:15:22.848918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.860721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Received event network-changed-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:22.860721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Refreshing instance network info cache due to event network-changed-948b7213-232b-4bbc-a30d-8b316076fd8b. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:22.860721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] Acquiring lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:22.860721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] Acquired lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:22.860721 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Refreshing network info cache for port 948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:22.886335 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Attempting to attach volume 1ee7c7d7-a681-4baf-a960-09dbad317c59 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]:   <alias name="ua-1ee7c7d7-a681-4baf-a960-09dbad317c59"/>
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]:   <serial>1ee7c7d7-a681-4baf-a960-09dbad317c59</serial>
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:15:22.890073 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:15:22.893831 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.895600 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.960231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:22.999053 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:15:22.999491 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f55f4c1b-8be0-4eae-b306-4a20205f0117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:15:22.999705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:23.000116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:23.000380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f55f4c1b-8be0-4eae-b306-4a20205f0117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:15:23.012343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:23.013127 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:23.021448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:23.021659 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:15:23.022239 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:23.022433 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:15:23.032508 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:15:23.032508 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:23.038514 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:15:23.038514 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117] added
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:23.048347 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:23.048628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:15:23.048655 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:15:23.048785 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117] added
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:15:23.052674 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:23.053018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:15:23.053181 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:15:23.053563 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:15:23.263766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:23.263766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:23.267109 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:23.293242 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:23.305836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:23.362789 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:23.469628 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-plugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:23.469628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:23.469628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:23.469628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:23.470716 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Processing event network-vif-plugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:15:23.470716 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-plugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:23.470716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:23.470716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:23.470716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:23.470882 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] No waiting events found dispatching network-vif-plugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:23.471328 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-6ee6b0b6-0664-4319-a4c5-71433a75e9c0 req-e321d926-9200-467c-afae-a04774838cc4 service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received unexpected event network-vif-plugged-64e4e4cb-6472-4813-9828-6391fa5d0517 for instance with vm_state building and task_state spawning.
Jun 27 04:15:23.726439 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:23.884819 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Updated VIF entry in instance network info cache for port 948b7213-232b-4bbc-a30d-8b316076fd8b. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:15:23.885121 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Updating instance_info_cache with network_info: [{"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:23.925834 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:23.928163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:23.928163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:62:18:8d, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:23.928163 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Using config drive
Jun 27 04:15:24.008915 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:15:24.011193 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533724.0107763, 634b4e13-367a-465a-832c-a45d8d90b07d => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:24.011589 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] VM Started (Lifecycle Event)
Jun 27 04:15:24.012697 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:15:24.017037 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Instance spawned successfully.
Jun 27 04:15:24.017561 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:15:24.049200 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:15:24.053956 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:15:24.061782 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:15:24.068982 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.074026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.083854 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.091462 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.091462 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.091462 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.091462 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.091462 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:24.091813 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.091813 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.091813 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.091813 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.091813 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:24.100328 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.100328 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.100328 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.100328 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.100328 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:24.100568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.100568 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.100568 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.100568 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.100568 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:24.138730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.40.100,3260]
Jun 27 04:15:24.138730 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.40.100,3260] successful.
Jun 27 04:15:24.138730 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.152679 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.162733 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.50.100,3260]
Jun 27 04:15:24.162733 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.50.100,3260] successful.
Jun 27 04:15:24.162733 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.170811 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.171142 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:24.171335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:24.171411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:15:24.172361 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] HCTL ('11', '-', '-', 0) found on session 110 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:15:24.172763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:15:24.179883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:24.192652 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 110 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:15:24.192652 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f55f4c1b-8be0-4eae-b306-4a20205f0117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.200865 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:24.201099 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:24.201319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:24.201452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:15:24.202362 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] HCTL ('12', '-', '-', 0) found on session 111 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:15:24.202485 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:15:24.219602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 111 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:15:24.387566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fa5461d2-5740-4a65-964d-b7ea8159829c req-fb48ad3a-bc0e-4c79-ba58-301c59617c84 service nova] Releasing lock "refresh_cache-68efeba8-e1f9-421b-bcd0-a8a8116b4c80" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:24.435524 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:24.491579 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:24.514521 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:24.516630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:24.526297 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:24.526450 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:24.526791 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:24.527050 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:24.527320 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:24.527601 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:24.611678 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Creating config drive at /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.config
Jun 27 04:15:24.615719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpndsuljii {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:24.647077 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:24.647199 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:24.647388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:24.647540 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] No VIF found with MAC fa:16:3e:a5:04:a1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:24.684689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpndsuljii" returned: 0 in 0.069s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:25.019428 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:15:25.019802 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533725.019532, 634b4e13-367a-465a-832c-a45d8d90b07d => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:25.020009 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] VM Paused (Lifecycle Event)
Jun 27 04:15:25.037165 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Took 7.54 seconds to spawn the instance on the hypervisor.
Jun 27 04:15:25.037354 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:25.106852 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.143389 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.153975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.217419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 111 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:15:25.217641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f55f4c1b-8be0-4eae-b306-4a20205f0117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:15:25.247996 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.503093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.505257 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.506750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.522680 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:25.525441 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533725.5252202, 634b4e13-367a-465a-832c-a45d8d90b07d => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:25.525586 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] VM Resumed (Lifecycle Event)
Jun 27 04:15:25.530588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:25.549275 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Took 13.11 seconds to build instance.
Jun 27 04:15:25.555414 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04615f84-8c38-4846-b195-07671c351464 req-4f625375-549a-4537-8749-74067961d439 service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Received event network-vif-plugged-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:25.557016 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04615f84-8c38-4846-b195-07671c351464 req-4f625375-549a-4537-8749-74067961d439 service nova] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:25.558166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04615f84-8c38-4846-b195-07671c351464 req-4f625375-549a-4537-8749-74067961d439 service nova] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:25.558405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04615f84-8c38-4846-b195-07671c351464 req-4f625375-549a-4537-8749-74067961d439 service nova] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:25.558640 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04615f84-8c38-4846-b195-07671c351464 req-4f625375-549a-4537-8749-74067961d439 service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Processing event network-vif-plugged-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:15:26.028530 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:26.030537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found WWN 330000000737f4fd5 for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:15:26.035018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:26.035018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000737f4fd5', 'path': '/dev/dm-2', 'multipath_id': '330000000737f4fd5'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:15:26.035018 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000737f4fd5', 'path': '/dev/dm-2', 'multipath_id': '330000000737f4fd5'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:15:26.041608 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:26.046076 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:26.051646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.616s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:26.067749 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:15:26.070165 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:15:26.077615 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Instance spawned successfully.
Jun 27 04:15:26.079260 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:15:26.244793 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66ab3754-9e5a-4059-bd14-b7e80f6c50a6 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.670s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:26.545567 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533726.5436559, 8479537c-b3ab-47ec-8dbd-6f6c50b90728 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:26.545567 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] VM Started (Lifecycle Event)
Jun 27 04:15:26.548909 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Attempting to attach volume f55f4c1b-8be0-4eae-b306-4a20205f0117 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]:   <alias name="ua-f55f4c1b-8be0-4eae-b306-4a20205f0117"/>
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]:   <serial>f55f4c1b-8be0-4eae-b306-4a20205f0117</serial>
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:15:26.550590 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:15:26.588060 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:26.588225 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:26.588564 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:26.588802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:26.589103 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:26.589389 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:27.046581 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:27.048559 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:27.098407 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Took 7.25 seconds to spawn the instance on the hypervisor.
Jun 27 04:15:27.098612 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:27.340146 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:27.551030 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:15:27.551476 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533727.5511262, 8479537c-b3ab-47ec-8dbd-6f6c50b90728 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:27.551562 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] VM Paused (Lifecycle Event)
Jun 27 04:15:27.617359 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Took 14.85 seconds to build instance.
Jun 27 04:15:27.652287 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e6b5ede6-81ba-434e-afa0-cfccaebc7e62 req-081e94c7-4cfe-4798-a19b-1d0e986657df service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Received event network-vif-plugged-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:27.652598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6b5ede6-81ba-434e-afa0-cfccaebc7e62 req-081e94c7-4cfe-4798-a19b-1d0e986657df service nova] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:27.652799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6b5ede6-81ba-434e-afa0-cfccaebc7e62 req-081e94c7-4cfe-4798-a19b-1d0e986657df service nova] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:27.652921 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e6b5ede6-81ba-434e-afa0-cfccaebc7e62 req-081e94c7-4cfe-4798-a19b-1d0e986657df service nova] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:27.653084 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e6b5ede6-81ba-434e-afa0-cfccaebc7e62 req-081e94c7-4cfe-4798-a19b-1d0e986657df service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] No waiting events found dispatching network-vif-plugged-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:27.653223 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e6b5ede6-81ba-434e-afa0-cfccaebc7e62 req-081e94c7-4cfe-4798-a19b-1d0e986657df service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Received unexpected event network-vif-plugged-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 for instance with vm_state active and task_state None.
Jun 27 04:15:28.054507 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:28.057678 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533728.0573518, 8479537c-b3ab-47ec-8dbd-6f6c50b90728 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:28.057843 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] VM Resumed (Lifecycle Event)
Jun 27 04:15:28.119324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e16ef0b7-9a03-4e0c-97c4-4523106e7f43 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.361s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:28.235219 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:28.235405 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:28.235547 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:28.235690 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:35:49:09, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:28.561303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:28.563380 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:28.712247 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:28.712453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:28.712738 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:28.712921 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:28.713116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:28.715805 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Terminating instance
Jun 27 04:15:28.830586 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:28.831251 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:15:29.219927 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:15:29.243651 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:29.245939 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:29.273010 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:29.303784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:29.495240 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:29.588033 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999637051000263 future=<Future at 0x7ec538631280 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:29.589018 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.9992455900001 future=<Future at 0x7ec538631280 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:29.589018 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999130438000066 future=<Future at 0x7ec538631280 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:29.590663 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Instance destroyed successfully.
Jun 27 04:15:29.591091 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lazy-loading 'resources' on Instance uuid 634b4e13-367a-465a-832c-a45d8d90b07d {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:29.727753 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Received event network-changed-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:29.727753 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Refreshing instance network info cache due to event network-changed-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:29.727753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Acquiring lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:29.727753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Acquired lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:29.727753 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Refreshing network info cache for port bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:29.811608 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-68dbd0dc-773a-4b0a-8ae6-318ff5ac74c3 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.570s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:29.834881 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:29.834881 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:30.093800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1315317086',display_name='tempest-VolumesActionsTest-instance-1315317086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesactionstest-instance-1315317086',id=47,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:15:25Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbc4bbb57b484481bf3cc234fdb870c7',ramdisk_id='',reservation_id='r-g2wg8noy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-463751719',owner_user_name='tempest-VolumesActionsTest-463751719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:15:25Z,user_data=None,user_id='13c2bc77d02a4c81b4c573a8044a95ee',uuid=634b4e13-367a-465a-832c-a45d8d90b07d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:15:30.094012 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converting VIF {"id": "64e4e4cb-6472-4813-9828-6391fa5d0517", "address": "fa:16:3e:3a:35:97", "network": {"id": "b47d82b3-56c6-48e8-8bcd-0c378d886091", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1266694230-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bbc4bbb57b484481bf3cc234fdb870c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap64e4e4cb-64", "ovs_interfaceid": "64e4e4cb-6472-4813-9828-6391fa5d0517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:30.095116 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:30.095395 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:15:30.101001 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:30.101357 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64e4e4cb-64, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:30.102470 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:30.103362 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:30.103968 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:30.104920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:30.105145 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c41b898f-8aed-493e-937c-c7a220820d4c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:30.105707 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:30.106296 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:30.106634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:30.109706 np0000003830 nova-compute[98984]: INFO os_vif [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:35:97,bridge_name='br-int',has_traffic_filtering=True,id=64e4e4cb-6472-4813-9828-6391fa5d0517,network=Network(b47d82b3-56c6-48e8-8bcd-0c378d886091),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64e4e4cb-64')
Jun 27 04:15:30.110083 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Deleting instance files /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d_del
Jun 27 04:15:30.113604 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Deletion of /opt/stack/data/nova/instances/634b4e13-367a-465a-832c-a45d8d90b07d_del complete
Jun 27 04:15:30.232527 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:30.343868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:30.343868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:30.344582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:30.344582 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:15:30.625971 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 27 04:15:30.626847 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:15:30.627061 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:15:30.627157 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:15:30.627378 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:30.654748 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:30.705795 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:30.855694 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Updated VIF entry in instance network info cache for port bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:15:30.856204 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Updating instance_info_cache with network_info: [{"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:31.359559 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Releasing lock "refresh_cache-8479537c-b3ab-47ec-8dbd-6f6c50b90728" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:31.359693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-unplugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:31.359946 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:31.360142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:31.360249 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:31.360373 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] No waiting events found dispatching network-vif-unplugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:31.360448 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-unplugged-64e4e4cb-6472-4813-9828-6391fa5d0517 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:31.360609 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-unplugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:31.360759 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Acquiring lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:31.360906 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:31.361035 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] Lock "634b4e13-367a-465a-832c-a45d8d90b07d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:31.361148 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] No waiting events found dispatching network-vif-unplugged-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:31.361262 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0465f39f-2da8-408c-92b2-7dd146405c9f req-6a3e110a-d008-4078-954a-bf96dc9d2d6c service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-unplugged-64e4e4cb-6472-4813-9828-6391fa5d0517 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:31.391432 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:31.485809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:31.486829 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:31.562761 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:31.583208 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:31.583844 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:15:31.591024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:31.705764 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:31.706708 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:31.809764 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9b1c90b7-9d98-4dcb-8c50-4dab68a1e832 req-b9332571-9e2c-4332-8ac9-0efc54ac5407 service nova] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Received event network-vif-deleted-64e4e4cb-6472-4813-9828-6391fa5d0517 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:31.820517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:31.821434 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:15:31.826853 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:31.958945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:31.961085 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:32.055857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:32.061743 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:32.082887 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:15:32.181104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:32.182474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:32.307800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:32.308383 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:15:32.313853 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:32.413385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:32.414024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:32.503278 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:32.507284 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Error from libvirt while getting description of instance-0000002f: [Error Code 42] Domain not found: no domain with matching uuid '634b4e13-367a-465a-832c-a45d8d90b07d' (instance-0000002f): libvirt.libvirtError: Domain not found: no domain with matching uuid '634b4e13-367a-465a-832c-a45d8d90b07d' (instance-0000002f)
Jun 27 04:15:32.511479 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:15:32.512960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:32.562413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:32.564246 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50329MB free_disk=73.1509895324707GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:15:32.564461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:32.564795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:32.605407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:32.872136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:32.872654 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:33.375039 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:15:33.650923 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6e74649b-6954-4503-88e8-3d819ef17d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:15:33.651067 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:15:33.651287 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:15:33.651287 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:15:33.651429 np0000003830 nova-compute[98984]: WARNING nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 634b4e13-367a-465a-832c-a45d8d90b07d is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Jun 27 04:15:33.651570 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:15:33.966089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:34.153888 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 050c6413-cd32-4a23-ba74-c2dc2cb811ec has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
Jun 27 04:15:34.154123 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:15:34.154291 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:15:32 up 38 min,  2 users,  load average: 8.10, 8.70, 5.91\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_1121cceb6eae4ccb920a6e3123169bf9': '1', 'io_workload': '0', 'num_proj_ef6a6b08a14849038c79ff273d34be3f': '1', 'num_proj_cbd1ebe1144a427082b2a28cd85def6b': '1', 'num_proj_47d99f8411b741b2ae3a730bfefef27b': '1', 'num_proj_56c1eb5f65f0446eae1f4967af349cd1': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:15:34.495537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:34.591792 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:34.592063 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:35.095420 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:35.106609 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:35.602754 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:15:35.602957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.038s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:35.604456 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:15:35.604760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.999s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:35.606153 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:35.607673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.642s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:35.610482 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:15:35.610667 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Claim successful on node np0000003830
Jun 27 04:15:35.690507 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Deleted allocations for instance 634b4e13-367a-465a-832c-a45d8d90b07d
Jun 27 04:15:36.700505 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-34b6cd3f-145c-4812-9980-225ef731f306 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Lock "634b4e13-367a-465a-832c-a45d8d90b07d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.988s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:37.032630 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:37.058173 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:37.166023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:37.166304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:37.535466 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:37.597878 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:37.598233 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:37.599135 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:37.599946 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:37.600258 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:37.600436 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:15:37.600752 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.23 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:15:37.668487 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:15:37.829375 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:15:37.829791 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:15:38.043819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.436s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:38.044381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:15:38.226118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:38.227079 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:38.229986 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:15:38.230157 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Claim successful on node np0000003830
Jun 27 04:15:38.551621 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:15:38.552391 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:15:38.552391 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:38.552745 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:38.623026 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a614c2dbe3dc443cab3c16539edca35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd1ebe1144a427082b2a28cd85def6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:15:39.052547 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:15:39.175961 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Successfully created port: 21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:15:39.496990 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:39.557559 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:15:39.709614 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:39.709785 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:39.896679 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Successfully updated port: 21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:15:39.951024 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-changed-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:39.951318 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Refreshing instance network info cache due to event network-changed-21f3d665-3527-47eb-a666-0075ce486ff5. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:39.951430 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] Acquiring lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:39.952940 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] Acquired lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:39.952940 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Refreshing network info cache for port 21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:40.123344 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:40.212086 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:40.398480 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:40.454895 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:40.528665 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:40.565681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:15:40.567007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:15:40.567415 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Creating image(s)
Jun 27 04:15:40.568037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "/opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:40.568286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:40.568863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:40.569534 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:40.573814 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:40.575923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:40.667290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:40.667669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:40.668136 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:40.669652 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:40.674523 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:40.674523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:40.693588 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:40.720169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.494s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:40.721151 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:15:40.782451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:40.782882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:40.851816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk 1073741824" returned: 0 in 0.069s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:40.852334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:40.852758 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:40.949912 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:40.950485 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:15:40.950850 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:41.039884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:41.040326 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Cannot resize image /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:15:41.040809 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:15:41.040988 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Ensure instance console log exists: /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:15:41.041308 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:41.041534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:41.041685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:41.197653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9395cce4-3f05-4cba-a8dc-81af9d5da473 req-7ca62720-631a-47ba-911b-2dbe0ab70660 service nova] Releasing lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:41.198282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquired lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:41.198468 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:15:41.227911 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:15:41.228064 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:15:41.229021 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:41.229021 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:41.366905 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad2bb732cbb74829a56006c5c85eae1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe98e0a129a4b07b09babbcc5ce8d9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:15:41.734407 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:15:41.790075 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:41.948723 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:42.109441 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Updating instance_info_cache with network_info: [{"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:42.213756 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Successfully created port: 0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:15:42.237953 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:15:42.609055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Releasing lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:42.609402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Instance network_info: |[{"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:15:42.612777 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Start _get_guest_xml network_info=[{"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:15:42.616992 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:15:42.618917 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-927063783', uuid='050c6413-cd32-4a23-ba74-c2dc2cb811ec'), owner=OwnerMeta(userid='a614c2dbe3dc443cab3c16539edca35c', username='tempest-AttachVolumeNegativeTest-981489683-project-member', projectid='cbd1ebe1144a427082b2a28cd85def6b', projectname='tempest-AttachVolumeNegativeTest-981489683'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533742.6185255) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:15:42.620152 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:15:42.620684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:15:42.621759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:15:42.622012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:15:42.623525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:15:42.624042 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:15:42.624603 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:15:42.624843 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:15:42.625086 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:15:42.625272 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:15:42.626510 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:15:42.626510 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:15:42.626510 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:15:42.626510 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:15:42.626777 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:15:42.627235 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:15:42.638907 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-927063783',display_name='tempest-AttachVolumeNegativeTest-server-927063783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-927063783',id=49,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0tAOSMviR/3a1FGACccqo5xPDcLZ0EeiI2aiU6mBRED26F9RiB0pPEOn1TS8c86ClUUXmtwp9y1ql80wDUT8Q2gl26s8OE7QNGcGX3zDlqXnsq5az89M/bd6KrxTgXmQ==',key_name='tempest-keypair-965618758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-shfr81uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=050c6413-cd32-4a23-ba74-c2dc2cb811ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:15:42.640515 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:42.640515 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:42.641007 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'pci_devices' on Instance uuid 050c6413-cd32-4a23-ba74-c2dc2cb811ec {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:42.808306 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Successfully updated port: 0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:15:42.859747 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-changed-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:42.859905 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Refreshing instance network info cache due to event network-changed-0e46e5a0-70af-425d-b105-4889600ab4d9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:42.860023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] Acquiring lock "refresh_cache-601cd9c7-35ad-42fa-ad55-c7cd3df3deff" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:42.860131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] Acquired lock "refresh_cache-601cd9c7-35ad-42fa-ad55-c7cd3df3deff" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:42.860268 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Refreshing network info cache for port 0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <uuid>050c6413-cd32-4a23-ba74-c2dc2cb811ec</uuid>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <name>instance-00000031</name>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeNegativeTest-server-927063783</nova:name>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:15:42</nova:creationTime>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:user uuid="a614c2dbe3dc443cab3c16539edca35c">tempest-AttachVolumeNegativeTest-981489683-project-member</nova:user>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:project uuid="cbd1ebe1144a427082b2a28cd85def6b">tempest-AttachVolumeNegativeTest-981489683</nova:project>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         <nova:port uuid="21f3d665-3527-47eb-a666-0075ce486ff5">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <entry name="serial">050c6413-cd32-4a23-ba74-c2dc2cb811ec</entry>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <entry name="uuid">050c6413-cd32-4a23-ba74-c2dc2cb811ec</entry>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.config"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:89:4d:de"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <target dev="tap21f3d665-35"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/console.log" append="off"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:15:43.144089 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:15:43.146378 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Preparing to wait for external event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:15:43.146378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:43.146378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:43.146378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:43.146378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-927063783',display_name='tempest-AttachVolumeNegativeTest-server-927063783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-927063783',id=49,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0tAOSMviR/3a1FGACccqo5xPDcLZ0EeiI2aiU6mBRED26F9RiB0pPEOn1TS8c86ClUUXmtwp9y1ql80wDUT8Q2gl26s8OE7QNGcGX3zDlqXnsq5az89M/bd6KrxTgXmQ==',key_name='tempest-keypair-965618758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-shfr81uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=050c6413-cd32-4a23-ba74-c2dc2cb811ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:15:43.146378 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:43.146674 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:43.146782 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:15:43.147289 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:43.147737 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:43.148096 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:15:43.149205 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:43.149433 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5d447c5-6ba6-5147-9dfa-7f83eb066859', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:43.160528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:43.161816 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:43.163929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:43.164081 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21f3d665-35, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:43.164510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21f3d665-35, col_values=(('qos', UUID('d30549af-dd67-4407-9224-ec17b006da0c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:43.164846 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21f3d665-35, col_values=(('external_ids', {'iface-id': '21f3d665-3527-47eb-a666-0075ce486ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:4d:de', 'vm-uuid': '050c6413-cd32-4a23-ba74-c2dc2cb811ec'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:43.166597 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:43.168025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:43.172086 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:43.173834 np0000003830 nova-compute[98984]: INFO os_vif [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35')
Jun 27 04:15:43.245484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:15:43.246406 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:15:43.246656 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Creating image(s)
Jun 27 04:15:43.247071 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "/opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:43.247226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "/opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:43.247852 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "/opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:43.248532 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:43.254226 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:43.254226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:43.311396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "refresh_cache-601cd9c7-35ad-42fa-ad55-c7cd3df3deff" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:43.339744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:43.340245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:43.340646 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:43.341106 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:43.344569 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:15:43.345150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:43.364364 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:43.433383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:43.433863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:43.457766 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:43.530095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk 1073741824" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:43.530613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:43.530968 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:43.611647 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:43.618046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:43.618582 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Checking if we can resize image /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:15:43.618870 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:43.709455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:43.709935 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Cannot resize image /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:15:43.710279 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:15:43.710439 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Ensure instance console log exists: /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:15:43.711179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:43.711402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:43.711598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:44.114783 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b0ab1a4f-586e-4bfb-834e-dbc80e34ac49 req-a591e9b6-2d31-405c-8b7a-585bd062e888 service nova] Releasing lock "refresh_cache-601cd9c7-35ad-42fa-ad55-c7cd3df3deff" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:44.115709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquired lock "refresh_cache-601cd9c7-35ad-42fa-ad55-c7cd3df3deff" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:44.115973 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:15:44.502838 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:44.588227 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000459417999991274 future=<Future at 0x7ec538631280 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:44.588751 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Emitting event <LifecycleEvent: 1782533729.587451, 634b4e13-367a-465a-832c-a45d8d90b07d => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:44.588835 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:44.589228 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] VM Stopped (Lifecycle Event)
Jun 27 04:15:44.717600 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:44.717600 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:44.717832 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:89:4d:de, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:44.719521 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Using config drive
Jun 27 04:15:44.735381 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:15:44.940427 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:45.091738 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 634b4e13-367a-465a-832c-a45d8d90b07d] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:45.132963 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Updating instance_info_cache with network_info: [{"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:45.155440 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:45.155440 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing instance network info cache due to event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:45.155623 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:45.155733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:45.155900 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:45.228917 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:45.378979 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Creating config drive at /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.config
Jun 27 04:15:45.383689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzm02uno7 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:45.453389 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzm02uno7" returned: 0 in 0.070s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:45.636527 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Releasing lock "refresh_cache-601cd9c7-35ad-42fa-ad55-c7cd3df3deff" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:45.637133 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Instance network_info: |[{"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:15:45.644732 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Start _get_guest_xml network_info=[{"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:15:45.644732 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:15:45.650128 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-804122419', uuid='601cd9c7-35ad-42fa-ad55-c7cd3df3deff'), owner=OwnerMeta(userid='ad2bb732cbb74829a56006c5c85eae1d', username='tempest-VolumesNegativeTest-1493373594-project-member', projectid='dbe98e0a129a4b07b09babbcc5ce8d9c', projectname='tempest-VolumesNegativeTest-1493373594'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533745.6443908) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:15:45.650128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:15:45.650128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:15:45.651106 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:15:45.651333 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:15:45.652610 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:15:45.653020 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:15:45.653185 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:15:45.653317 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:15:45.654762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:15:45.663379 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:45.671117 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-804122419',display_name='tempest-VolumesNegativeTest-instance-804122419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesnegativetest-instance-804122419',id=50,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe98e0a129a4b07b09babbcc5ce8d9c',ramdisk_id='',reservation_id='r-epwden4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1493373594',owner_user_name='tempest-VolumesNegativeTest-1493373594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:42Z,user_data=None,user_id='ad2bb732cbb74829a56006c5c85eae1d',uuid=601cd9c7-35ad-42fa-ad55-c7cd3df3deff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:15:45.671725 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Converting VIF {"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:45.672406 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:45.673128 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lazy-loading 'pci_devices' on Instance uuid 601cd9c7-35ad-42fa-ad55-c7cd3df3deff {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:45.846144 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:45.846403 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing instance network info cache due to event network-changed-d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:45.846678 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] Acquiring lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:45.939906 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:45.977650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:45.987332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.081037 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.110471 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:46.154985 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.155774 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <uuid>601cd9c7-35ad-42fa-ad55-c7cd3df3deff</uuid>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <name>instance-00000032</name>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesNegativeTest-instance-804122419</nova:name>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:15:45</nova:creationTime>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:user uuid="ad2bb732cbb74829a56006c5c85eae1d">tempest-VolumesNegativeTest-1493373594-project-member</nova:user>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:project uuid="dbe98e0a129a4b07b09babbcc5ce8d9c">tempest-VolumesNegativeTest-1493373594</nova:project>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         <nova:port uuid="0e46e5a0-70af-425d-b105-4889600ab4d9">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="192.168.233.100" ipVersion="4"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <entry name="serial">601cd9c7-35ad-42fa-ad55-c7cd3df3deff</entry>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <entry name="uuid">601cd9c7-35ad-42fa-ad55-c7cd3df3deff</entry>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.config"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:ea:0b:a3"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <target dev="tap0e46e5a0-70"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/console.log" append="off"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:15:46.176370 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Preparing to wait for external event network-vif-plugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-804122419',display_name='tempest-VolumesNegativeTest-instance-804122419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesnegativetest-instance-804122419',id=50,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe98e0a129a4b07b09babbcc5ce8d9c',ramdisk_id='',reservation_id='r-epwden4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1493373594',owner_user_name='tempest-VolumesNegativeTest-1493373594-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:15:42Z,user_data=None,user_id='ad2bb732cbb74829a56006c5c85eae1d',uuid=601cd9c7-35ad-42fa-ad55-c7cd3df3deff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Converting VIF {"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:46.178815 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:46.181448 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:15:46.183017 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.183274 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:46.184404 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:15:46.185238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.185238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd39f253-ce37-54ef-a3d2-5c0b972bfab8', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:46.187566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.192613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:46.197428 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.197897 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e46e5a0-70, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:46.198058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e46e5a0-70, col_values=(('qos', UUID('d614c449-a087-4e8a-b06b-6cbd606b0295')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:46.200208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e46e5a0-70, col_values=(('external_ids', {'iface-id': '0e46e5a0-70af-425d-b105-4889600ab4d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:0b:a3', 'vm-uuid': '601cd9c7-35ad-42fa-ad55-c7cd3df3deff'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:46.205690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.205690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:46.209154 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:46.212479 np0000003830 nova-compute[98984]: INFO os_vif [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70')
Jun 27 04:15:46.353876 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updated VIF entry in instance network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:15:46.354244 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:46.466571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:46.467740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:46.856538 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b7035d0-ef19-4824-935e-ef500367fa89 req-3198956d-3bf5-4c1b-876e-317e22f7e3e8 service nova] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:46.857028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] Acquired lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:46.857297 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Refreshing network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:46.974029 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Detaching volume 12c169d3-3d80-4ec4-801a-c6543bcf8ad2
Jun 27 04:15:47.007063 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:15:47.030583 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Attempting to driver detach volume 12c169d3-3d80-4ec4-801a-c6543bcf8ad2 from mountpoint /dev/vdb
Jun 27 04:15:47.037987 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found disk vdb by alias ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:15:47.041516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Found disk vdb by alias ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:15:47.041649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Attempting to detach device vdb from instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:   <alias name="ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2"/>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:   <serial>12c169d3-3d80-4ec4-801a-c6543bcf8ad2</serial>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:15:47.041915 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:15:47.084249 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533747.0792038, 050c6413-cd32-4a23-ba74-c2dc2cb811ec => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:47.084249 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] VM Started (Lifecycle Event)
Jun 27 04:15:47.085081 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully detached device vdb from instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 from the persistent domain config.
Jun 27 04:15:47.085506 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] (1/8): Attempting to detach device vdb with device alias ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 from instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:   <alias name="ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2"/>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:   <serial>12c169d3-3d80-4ec4-801a-c6543bcf8ad2</serial>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:15:47.086009 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:15:47.359719 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:47.584360 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:47.588090 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533747.5877674, 050c6413-cd32-4a23-ba74-c2dc2cb811ec => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:47.588307 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] VM Paused (Lifecycle Event)
Jun 27 04:15:47.667011 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:47.720123 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 for instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:15:47.737837 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:47.738070 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:15:47.738157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] No VIF found with MAC fa:16:3e:ea:0b:a3, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:15:47.738743 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Using config drive
Jun 27 04:15:47.837832 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updated VIF entry in instance network info cache for port d311bb0b-e507-4ae4-8620-e98564a10081. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:15:47.838333 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [{"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:47.914614 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:47.915222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:47.915222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:47.915222 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:47.915368 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Processing event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:15:47.915534 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:47.918737 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:47.921333 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:15:47.921333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:47.922067 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:47.922067 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:47.922211 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-fc77cce2-2e5f-48b1-bfc9-6e44b6145a6a req-a73a610b-c707-43d9-8898-1dc28878b1ea service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received unexpected event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with vm_state building and task_state spawning.
Jun 27 04:15:47.927698 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:15:47.934033 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Instance spawned successfully.
Jun 27 04:15:47.934962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:15:48.091052 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:48.095484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533748.0948913, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => ua-12c169d3-3d80-4ec4-801a-c6543bcf8ad2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:15:48.095609 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533748.095307, 050c6413-cd32-4a23-ba74-c2dc2cb811ec => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:48.095766 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] VM Resumed (Lifecycle Event)
Jun 27 04:15:48.109382 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully detached device vdb from instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 from the live domain config.
Jun 27 04:15:48.115380 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:15:48.115812 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:15:48.116005 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:15:48.116789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:15:48.116860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:15:48.117049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8404733-7063-440a-8e1a-68a77ae5370f (non-flash)
Jun 27 04:15:48.158638 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c8404733-7063-440a-8e1a-68a77ae5370f (non-flash)
Jun 27 04:15:48.159136 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:15:48.159522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c8404733-7063-440a-8e1a-68a77ae5370f', '115')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:15:48.159522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', '102')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:15:48.163578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2', '103')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:15:48.163578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53819b060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:15:48.163578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:15:48.163578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Flush multipath device 33000000047380812 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:15:48.205811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:15:48.254979 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:48.288164 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:15:48.341415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3dc6f632-547a-4377-9aa3-dde47969c67c req-28e2865d-8aac-41ad-bd43-d4d224e991cc service nova] Releasing lock "refresh_cache-bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:48.348612 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:15:48.348612 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:15:48.348877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:15:48.362876 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:15:48.363151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:15:48.381618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:48.419176 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.40.100,3260]
Jun 27 04:15:48.419176 np0000003830 nova-compute[98984]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.40.100,3260] successful.
Jun 27 04:15:48.419176 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:48.443989 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Creating config drive at /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.config
Jun 27 04:15:48.445204 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:48.449520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpajhkvhru {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:15:48.464736 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:48.465019 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:48.468649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:48.470364 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:48.474165 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:48.475262 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:48.475638 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:48.510998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.50.100,3260]
Jun 27 04:15:48.510998 np0000003830 nova-compute[98984]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-12c169d3-3d80-4ec4-801a-c6543bcf8ad2, portal: 192.168.50.100,3260] successful.
Jun 27 04:15:48.510998 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:48.513819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpajhkvhru" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:15:48.534702 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:15:48.535260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:15:48.535508 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] <== disconnect_volume: return (419ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:15:48.537164 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:15:48.605141 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:48.618398 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:48.988596 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Took 8.42 seconds to spawn the instance on the hypervisor.
Jun 27 04:15:48.989357 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:49.121075 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:15:49.139300 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.165192 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'flavor' on Instance uuid bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:49.219727 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.291520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.508489 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.510828 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Took 15.63 seconds to build instance.
Jun 27 04:15:49.627813 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.628845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.633580 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:49.664923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-plugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Processing event network-vif-plugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-plugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:50.008488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:50.014304 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] No waiting events found dispatching network-vif-plugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:50.014787 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9016c5ca-e45e-4388-b6b3-106e04faed47 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.142s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:50.015056 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-eec2475b-17a0-47da-8de6-2fa766742156 req-70dc51ce-c8ee-4049-b4f6-1b92b3cd8ae6 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received unexpected event network-vif-plugged-0e46e5a0-70af-425d-b105-4889600ab4d9 for instance with vm_state building and task_state spawning.
Jun 27 04:15:50.183276 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ec907a5a-848d-4f60-a467-27998180be57 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.716s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:50.637852 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533750.6370723, 601cd9c7-35ad-42fa-ad55-c7cd3df3deff => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:50.638402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:15:50.640377 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] VM Started (Lifecycle Event)
Jun 27 04:15:50.643781 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:15:50.648350 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Instance spawned successfully.
Jun 27 04:15:50.649179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:15:50.832206 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-changed-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:50.832396 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Refreshing instance network info cache due to event network-changed-21f3d665-3527-47eb-a666-0075ce486ff5. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:15:50.832728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] Acquiring lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:15:50.832809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] Acquired lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:15:50.833029 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Refreshing network info cache for port 21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:15:51.143117 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:51.145762 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:51.157874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:51.157874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:51.158127 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:51.158452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:51.158640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:51.159511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:15:51.204749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:51.336833 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:51.649061 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:15:51.649061 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533751.647782, 601cd9c7-35ad-42fa-ad55-c7cd3df3deff => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:51.649061 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] VM Paused (Lifecycle Event)
Jun 27 04:15:51.666228 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Took 8.42 seconds to spawn the instance on the hypervisor.
Jun 27 04:15:51.666415 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:51.837123 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:52.028543 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Updated VIF entry in instance network info cache for port 21f3d665-3527-47eb-a666-0075ce486ff5. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:15:52.029580 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Updating instance_info_cache with network_info: [{"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:52.154822 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:52.170756 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533752.1703186, 601cd9c7-35ad-42fa-ad55-c7cd3df3deff => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:15:52.170970 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] VM Resumed (Lifecycle Event)
Jun 27 04:15:52.182801 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Took 14.01 seconds to build instance.
Jun 27 04:15:52.248157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:52.248407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:52.248716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:52.248861 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:52.248997 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:52.255626 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Terminating instance
Jun 27 04:15:52.533669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7416be5b-3e6c-4a18-96d8-704c1372d77e req-7631dc3f-96d8-4966-999a-92c24c45f9c5 service nova] Releasing lock "refresh_cache-050c6413-cd32-4a23-ba74-c2dc2cb811ec" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:15:52.675298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:15:52.681358 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:15:52.685341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.518s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:52.763358 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:15:52.800785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:52.807446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:52.836392 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:52.841228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:52.873702 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.022675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c42c44f7-d654-49d8-b293-4e0a8cb8e6ed req-3501b385-48ad-484f-b04d-d7dd87440191 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:53.022847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c42c44f7-d654-49d8-b293-4e0a8cb8e6ed req-3501b385-48ad-484f-b04d-d7dd87440191 service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:53.023085 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c42c44f7-d654-49d8-b293-4e0a8cb8e6ed req-3501b385-48ad-484f-b04d-d7dd87440191 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:53.024138 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c42c44f7-d654-49d8-b293-4e0a8cb8e6ed req-3501b385-48ad-484f-b04d-d7dd87440191 service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:53.024336 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c42c44f7-d654-49d8-b293-4e0a8cb8e6ed req-3501b385-48ad-484f-b04d-d7dd87440191 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:53.026750 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c42c44f7-d654-49d8-b293-4e0a8cb8e6ed req-3501b385-48ad-484f-b04d-d7dd87440191 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:53.266379 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999698936999721 future=<Future at 0x7ec5384a8110 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:53.266917 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999342069999784 future=<Future at 0x7ec5384a8110 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:53.267321 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998928218999936 future=<Future at 0x7ec5384a8110 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:53.273440 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Instance destroyed successfully.
Jun 27 04:15:53.274389 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lazy-loading 'resources' on Instance uuid bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:53.503815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:53.504121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:53.504395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:53.504685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:53.504893 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:53.509539 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Terminating instance
Jun 27 04:15:53.778040 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1661289853',display_name='tempest-TestMinimumBasicScenario-server-1661289853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testminimumbasicscenario-server-1661289853',id=43,image_ref='2ec8639d-f3e3-4949-8f3f-a5eb64821970',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC0UcXVulFkkNBn+fTBc5uG2TWKIIwPQ5d/+CRqAMWUrlVM6Oq97P/Liwt/sHQwcKVHhHM/Fn8XHjxWgBNqwk6jTYLg8RZLuZATPQFZTwAmfFi6b1bCQhRQY4JMRyGa8g==',key_name='tempest-TestMinimumBasicScenario-1306838645',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:14:24Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef6a6b08a14849038c79ff273d34be3f',ramdisk_id='',reservation_id='r-9kt0tn1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2ec8639d-f3e3-4949-8f3f-a5eb64821970',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1552363864',owner_user_name='tempest-TestMinimumBasicScenario-1552363864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:15:07Z,user_data=None,user_id='be52472c68cd47fe991efe4050788c09',uuid=bd98b468-fcaa-42e2-a1a3-bdc82a6e7538,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:15:53.778040 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converting VIF {"id": "d311bb0b-e507-4ae4-8620-e98564a10081", "address": "fa:16:3e:5c:58:76", "network": {"id": "75a7e6e2-98d8-4992-9239-3d807df7c3cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-141951871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ef6a6b08a14849038c79ff273d34be3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd311bb0b-e5", "ovs_interfaceid": "d311bb0b-e507-4ae4-8620-e98564a10081", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:53.779609 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:53.779976 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:15:53.781171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.781420 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd311bb0b-e5, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:53.783098 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.784014 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:53.784119 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.785170 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.785425 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1345a158-5aab-4581-b83d-6c52861b2030) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:53.786608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.786608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:53.787056 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:53.789951 np0000003830 nova-compute[98984]: INFO os_vif [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:58:76,bridge_name='br-int',has_traffic_filtering=True,id=d311bb0b-e507-4ae4-8620-e98564a10081,network=Network(75a7e6e2-98d8-4992-9239-3d807df7c3cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd311bb0b-e5')
Jun 27 04:15:53.790292 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Deleting instance files /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538_del
Jun 27 04:15:53.791281 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Deletion of /opt/stack/data/nova/instances/bd98b468-fcaa-42e2-a1a3-bdc82a6e7538_del complete
Jun 27 04:15:54.021004 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:15:54.053875 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.061845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.094159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.106796 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.136917 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.295564 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9aff7dbc-0a88-49dc-80a1-f9be405a70ad req-62f72ca8-96ba-458f-9641-b60dacfce360 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-unplugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:54.295564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9aff7dbc-0a88-49dc-80a1-f9be405a70ad req-62f72ca8-96ba-458f-9641-b60dacfce360 service nova] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:54.296192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9aff7dbc-0a88-49dc-80a1-f9be405a70ad req-62f72ca8-96ba-458f-9641-b60dacfce360 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:54.296192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9aff7dbc-0a88-49dc-80a1-f9be405a70ad req-62f72ca8-96ba-458f-9641-b60dacfce360 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:54.296192 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9aff7dbc-0a88-49dc-80a1-f9be405a70ad req-62f72ca8-96ba-458f-9641-b60dacfce360 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] No waiting events found dispatching network-vif-unplugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:54.296806 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9aff7dbc-0a88-49dc-80a1-f9be405a70ad req-62f72ca8-96ba-458f-9641-b60dacfce360 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-unplugged-0e46e5a0-70af-425d-b105-4889600ab4d9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:54.309352 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Took 1.55 seconds to destroy the instance on the hypervisor.
Jun 27 04:15:54.310290 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:15:54.310551 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:15:54.310692 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:15:54.310906 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:54.402674 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999618687999828 future=<Future at 0x7ec51820d5e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:15:54.406730 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Instance destroyed successfully.
Jun 27 04:15:54.407573 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lazy-loading 'resources' on Instance uuid 601cd9c7-35ad-42fa-ad55-c7cd3df3deff {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:54.509483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.571583 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:54.912046 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:15:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-804122419',display_name='tempest-VolumesNegativeTest-instance-804122419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesnegativetest-instance-804122419',id=50,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:15:51Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe98e0a129a4b07b09babbcc5ce8d9c',ramdisk_id='',reservation_id='r-epwden4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1493373594',owner_user_name='tempest-VolumesNegativeTest-1493373594-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:15:52Z,user_data=None,user_id='ad2bb732cbb74829a56006c5c85eae1d',uuid=601cd9c7-35ad-42fa-ad55-c7cd3df3deff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:15:54.912046 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Converting VIF {"id": "0e46e5a0-70af-425d-b105-4889600ab4d9", "address": "fa:16:3e:ea:0b:a3", "network": {"id": "b02197b7-b81b-4e9f-84fa-b56c03744abb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec663b0044224dec83cc0cdb7e399abd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e46e5a0-70", "ovs_interfaceid": "0e46e5a0-70af-425d-b105-4889600ab4d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:15:54.912046 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:15:54.912777 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:15:54.915828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.922223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e46e5a0-70, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:54.922223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.922223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:54.922223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.922223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.922223 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d614c449-a087-4e8a-b06b-6cbd606b0295) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:15:54.925648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:54.925648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:15:54.928068 np0000003830 nova-compute[98984]: INFO os_vif [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:0b:a3,bridge_name='br-int',has_traffic_filtering=True,id=0e46e5a0-70af-425d-b105-4889600ab4d9,network=Network(b02197b7-b81b-4e9f-84fa-b56c03744abb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e46e5a0-70')
Jun 27 04:15:54.928068 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Deleting instance files /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff_del
Jun 27 04:15:54.928750 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Deletion of /opt/stack/data/nova/instances/601cd9c7-35ad-42fa-ad55-c7cd3df3deff_del complete
Jun 27 04:15:55.014596 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-169f4df2-20f2-426e-8f3e-8bbdb74dfe94 req-3cf058cf-9a05-44c4-b4da-524b6b994221 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-deleted-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:55.014864 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-169f4df2-20f2-426e-8f3e-8bbdb74dfe94 req-3cf058cf-9a05-44c4-b4da-524b6b994221 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Neutron deleted interface d311bb0b-e507-4ae4-8620-e98564a10081; detaching it from the instance and deleting it from the info cache
Jun 27 04:15:55.017005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-169f4df2-20f2-426e-8f3e-8bbdb74dfe94 req-3cf058cf-9a05-44c4-b4da-524b6b994221 service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Detach interface failed, port_id=d311bb0b-e507-4ae4-8620-e98564a10081, reason: Instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:15:55.121960 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-038b7fe3-3f00-4bc4-beb8-a1d2d4763f40 req-90cb4587-5657-4099-bbc1-e503eb30ea3b service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:55.121960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-038b7fe3-3f00-4bc4-beb8-a1d2d4763f40 req-90cb4587-5657-4099-bbc1-e503eb30ea3b service nova] Acquiring lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:55.121960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-038b7fe3-3f00-4bc4-beb8-a1d2d4763f40 req-90cb4587-5657-4099-bbc1-e503eb30ea3b service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:55.121960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-038b7fe3-3f00-4bc4-beb8-a1d2d4763f40 req-90cb4587-5657-4099-bbc1-e503eb30ea3b service nova] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:55.121960 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-038b7fe3-3f00-4bc4-beb8-a1d2d4763f40 req-90cb4587-5657-4099-bbc1-e503eb30ea3b service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] No waiting events found dispatching network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:55.121960 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-038b7fe3-3f00-4bc4-beb8-a1d2d4763f40 req-90cb4587-5657-4099-bbc1-e503eb30ea3b service nova] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Received event network-vif-unplugged-d311bb0b-e507-4ae4-8620-e98564a10081 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:55.439953 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Took 1.42 seconds to destroy the instance on the hypervisor.
Jun 27 04:15:55.440650 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:15:55.441044 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:15:55.441187 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:15:55.441481 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:55.468987 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:55.551799 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:15:55.971659 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Took 1.66 seconds to deallocate network for instance.
Jun 27 04:15:56.329922 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:15:56.356340 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-unplugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:56.356628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] Acquiring lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:56.356835 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:56.357018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:56.357185 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] No waiting events found dispatching network-vif-unplugged-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:15:56.357879 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-unplugged-0e46e5a0-70af-425d-b105-4889600ab4d9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:15:56.358040 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7d73b818-8868-4e79-9125-db264ca3887c req-1a55aaba-0214-4dba-9d47-d34eea317815 service nova] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Received event network-vif-deleted-0e46e5a0-70af-425d-b105-4889600ab4d9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:15:56.479292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:56.479931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:56.831435 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:56.831673 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:56.833249 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Took 1.39 seconds to deallocate network for instance.
Jun 27 04:15:57.334368 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:57.343707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:57.842955 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.363s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:57.844519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.501s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:57.913353 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Deleted allocations for instance bd98b468-fcaa-42e2-a1a3-bdc82a6e7538
Jun 27 04:15:58.318037 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:15:58.318241 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:15:58.822519 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:15:58.924843 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-21e19166-bee0-42d9-8c0c-02a947fb3141 tempest-TestMinimumBasicScenario-1552363864 tempest-TestMinimumBasicScenario-1552363864-project-member] Lock "bd98b468-fcaa-42e2-a1a3-bdc82a6e7538" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.676s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:59.035775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:15:59.036237 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:15:59.332456 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.488s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:15:59.391316 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Deleted allocations for instance 601cd9c7-35ad-42fa-ad55-c7cd3df3deff
Jun 27 04:15:59.516435 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:15:59.539581 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'flavor' on Instance uuid 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:15:59.923208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:00.400401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-38c15864-e9e2-4a52-87f8-3ae2ac8dca51 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Lock "601cd9c7-35ad-42fa-ad55-c7cd3df3deff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.896s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:00.545486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:01.458891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:01.520530 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:01.772214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:01.772214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:01.772214 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Attaching volume 2f9bd136-d636-4c4c-b1ba-149841cd7911 to /dev/vdb
Jun 27 04:16:01.832379 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:01.857091 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:16:01.883416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:01.942975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:16:01.944427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:16:01.955252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:16:01.956871 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fea5:4a1', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe35:4909', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fed1:486e', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:fe62:188d', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe89:4dde'] 
Jun 27 04:16:01.957082 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:16:01.957151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:16:01.957528 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:01.957878 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Updating existing volume attachment record: f35022f0-2636-4098-bb89-87164b47822c {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:16:02.632474 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '68efeba8-e1f9-421b-bcd0-a8a8116b4c80', 'attached_at': '', 'detached_at': '', 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'serial': '2f9bd136-d636-4c4c-b1ba-149841cd7911'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:16:02.638066 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:16:02.638685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:02.638906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:02.641459 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:02.641836 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:16:02.665513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:02.666096 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:02.668054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:02.668054 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:16:02.668054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:02.668399 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:16:02.683478 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:16:02.683478 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:02.683478 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:16:02.683478 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911] added
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:02.700120 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:02.700338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:16:02.700566 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:16:02.700736 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911] added
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:02.701488 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:02.701742 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:16:02.702003 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:16:02.702175 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:16:03.701231 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:16:03.702761 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:16:03.721915 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:16:03.734315 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:03.740112 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:03.750609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:03.769953 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:03.770315 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:03.780322 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:03.780575 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:03.825860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.40.100,3260]
Jun 27 04:16:03.825860 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:03.825860 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:03.843980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:03.862218 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:03.862996 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:03.863686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:03.863686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:16:03.866769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] HCTL ('14', '-', '-', 0) found on session 119 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:16:03.866769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:16:03.901370 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 119 and hctl ['14', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:03.981804 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:04.517683 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:04.822881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.50.100,3260]
Jun 27 04:16:04.822881 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:04.822881 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:04.836803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:04.858564 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ea7646a-b378-47a3-be99-a8bbd921fb25 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:04.859059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.191s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:04.859640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:16:04.861426 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] HCTL ('15', '-', '-', 0) found on session 120 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:16:04.861426 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:16:04.888558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 120 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:04.888558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:16:04.901537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 119 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:04.901730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:16:04.925841 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:05.538471 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:05.539063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:05.669060 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:16:06.046275 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 8479537c-b3ab-47ec-8dbd-6f6c50b90728 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:06.692855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799061 for multipath device dm-3 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:16:06.693391 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.052s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:06.695647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== connect_volume: return (4056ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799061', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799061'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:06.695881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799061', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799061'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:16:06.698437 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:16:06.699511 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:06.699511 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:06.716986 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:16:06.716986 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:16:06.716986 np0000003830 nova-compute[98984]:     <volume>2f9bd136-d636-4c4c-b1ba-149841cd7911</volume>
Jun 27 04:16:06.716986 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:16:06.716986 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:16:06.716986 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:16:06.736725 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'flavor' on Instance uuid 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:07.061695 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.523s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:07.240695 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Attempting to attach volume 2f9bd136-d636-4c4c-b1ba-149841cd7911 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   <alias name="ua-2f9bd136-d636-4c4c-b1ba-149841cd7911"/>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   <serial>2f9bd136-d636-4c4c-b1ba-149841cd7911</serial>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="e2341bdd-9628-4794-997c-beb6eb556528"/>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:07.243018 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:16:08.167123 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:08.168847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:08.168847 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Attaching volume 6145c208-4e98-437d-8ab9-128d90920e28 to /dev/vdb
Jun 27 04:16:08.232216 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:08.245549 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:16:08.266615 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000532406000274932 future=<Future at 0x7ec5384a8110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:08.266759 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:08.266881 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.1354329059995507 future=<Future at 0x7ec51820d5e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:08.266881 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.1353616939995845 future=<Future at 0x7ec51820d5e0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:08.267250 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Emitting event <LifecycleEvent: 1782533753.265971, bd98b468-fcaa-42e2-a1a3-bdc82a6e7538 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:08.267482 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] VM Stopped (Lifecycle Event)
Jun 27 04:16:08.273846 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:08.325019 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:16:08.325404 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:16:08.338139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:16:08.342168 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fea5:4a1', 'fe80::490:a7ff:fe4e:392b', 'fe80::fc16:3eff:fe35:4909', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fed1:486e', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:fe62:188d', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe89:4dde'] 
Jun 27 04:16:08.343273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:16:08.343273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:16:08.343412 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:08.344141 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Updating existing volume attachment record: 4d6886cf-f027-4d12-964f-4e395b4dbfbc {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:16:08.771583 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: bd98b468-fcaa-42e2-a1a3-bdc82a6e7538] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:08.974900 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8479537c-b3ab-47ec-8dbd-6f6c50b90728', 'attached_at': '', 'detached_at': '', 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'serial': '6145c208-4e98-437d-8ab9-128d90920e28'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:16:08.979315 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:16:08.979315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:08.979315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:08.979315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:08.979315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:16:09.002850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:09.004154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:09.004154 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:16:09.004781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:09.005828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:09.005973 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:16:09.025247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:16:09.025247 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:09.034107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:16:09.034107 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28] added
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:16:09.045960 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28] added
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:09.054976 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:09.055218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:16:09.055262 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0493(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:16:09.055424 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:16:09.403560 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0009709079999993264 future=<Future at 0x7ec51820d5e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:09.403560 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:09.404970 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] Emitting event <LifecycleEvent: 1782533754.4021907, 601cd9c7-35ad-42fa-ad55-c7cd3df3deff => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:09.404970 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] VM Stopped (Lifecycle Event)
Jun 27 04:16:09.518588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:09.813671 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:09.813810 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:09.813934 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:09.814109 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No VIF found with MAC fa:16:3e:d1:48:6e, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:16:09.906772 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2c2721c6-f632-4d39-92c6-0fa9c42a2c11 tempest-VolumesActionsTest-463751719 tempest-VolumesActionsTest-463751719-project-member] [instance: 601cd9c7-35ad-42fa-ad55-c7cd3df3deff] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:09.927051 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:10.043423 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:16:10.055939 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:16:10.057351 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:16:10.071753 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.077358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.085572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.096763 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.097002 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.107415 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:10.146355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.40.100,3260]
Jun 27 04:16:10.146355 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:10.146355 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.161685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.161685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.50.100,3260]
Jun 27 04:16:10.161685 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:10.161685 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.181678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.182247 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.182675 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:10.182932 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:10.183044 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:16:10.184295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('7', '-', '-', 0) found on session 121 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:16:10.184435 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.198907 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d085e740-ee3b-4307-aab6-d7e1d47cc5b0 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:10.199346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:10.199708 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:16:10.200408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('8', '-', '-', 0) found on session 122 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:16:10.200523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:16:10.207401 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 121 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:10.207523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:16:10.217419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 122 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:11.218208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 122 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:11.218692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:16:11.435490 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eeb92334-3558-433e-81d3-de770aa44c3b tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.664s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:11.875017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:11.875017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:12.024350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found WWN 330000000c7ad53c6 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:16:12.024714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:12.026325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000c7ad53c6', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000c7ad53c6'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:12.026473 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c7ad53c6', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000c7ad53c6'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:16:12.028459 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:16:12.028716 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:12.028885 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:12.053243 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.luks [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 27 04:16:12.053677 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:16:12.054248 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:12.054248 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:12.054747 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7ec51820d010>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '8479537c-b3ab-47ec-8dbd-6f6c50b90728', 'attached_at': '', 'detached_at': '', 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'serial': '6145c208-4e98-437d-8ab9-128d90920e28'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:16:12.054920 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98984) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Detaching volume 2f9bd136-d636-4c4c-b1ba-149841cd7911
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Attempting to driver detach volume 2f9bd136-d636-4c4c-b1ba-149841cd7911 from mountpoint /dev/vdb
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '68efeba8-e1f9-421b-bcd0-a8a8116b4c80', 'attached_at': '', 'detached_at': '', 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'serial': '2f9bd136-d636-4c4c-b1ba-149841cd7911'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Found disk vdb by alias ua-2f9bd136-d636-4c4c-b1ba-149841cd7911 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Found disk vdb by alias ua-2f9bd136-d636-4c4c-b1ba-149841cd7911 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Attempting to detach device vdb from instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <alias name="ua-2f9bd136-d636-4c4c-b1ba-149841cd7911"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <serial>2f9bd136-d636-4c4c-b1ba-149841cd7911</serial>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="e2341bdd-9628-4794-997c-beb6eb556528"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully detached device vdb from instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 from the persistent domain config.
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] (1/8): Attempting to detach device vdb with device alias ua-2f9bd136-d636-4c4c-b1ba-149841cd7911 from instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <alias name="ua-2f9bd136-d636-4c4c-b1ba-149841cd7911"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <serial>2f9bd136-d636-4c4c-b1ba-149841cd7911</serial>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="e2341bdd-9628-4794-997c-beb6eb556528"/>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533773.149622, 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 => ua-2f9bd136-d636-4c4c-b1ba-149841cd7911> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2f9bd136-d636-4c4c-b1ba-149841cd7911 for instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully detached device vdb from instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 from the live domain config.
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2f9bd136-d636-4c4c-b1ba-149841cd7911', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:13.209354 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:13.213874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '122')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:16:13.213874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', '119')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:13.213874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911', '120')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:13.213874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53813b880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'): ({'sdj'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:16:13.213874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Removing multipathed devices sdj, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:16:13.213874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flush multipath device 3300000009eda6313 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:16:13.229059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:13.285343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:13.326262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:16:13.326262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:16:13.327479 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:16:13.340068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:16:13.340568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:16:13.362485 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:13.390657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.40.100,3260]
Jun 27 04:16:13.390657 np0000003830 nova-compute[98984]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:13.390657 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:13.423890 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:13.435667 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:13.469615 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.50.100,3260]
Jun 27 04:16:13.469615 np0000003830 nova-compute[98984]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-2f9bd136-d636-4c4c-b1ba-149841cd7911, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:13.469615 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:13.496000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:13.496785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:13.496938 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== disconnect_volume: return (337ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:13.497259 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:16:13.535093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:14.187772 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'flavor' on Instance uuid 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:14.520045 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:14.907790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:14.927983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:15.193645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5112eb7a-4943-4cf2-9764-1f3181a5f4ad tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.326s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:16.344329 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:16:16.344329 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:16:16.344329 np0000003830 nova-compute[98984]:     <volume>6145c208-4e98-437d-8ab9-128d90920e28</volume>
Jun 27 04:16:16.344329 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:16:16.344329 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:16:16.344329 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:16:16.355164 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 8479537c-b3ab-47ec-8dbd-6f6c50b90728 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:16.393301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:16.393301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:16.393301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:16.393301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:16.393301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:16.394784 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Terminating instance
Jun 27 04:16:16.858373 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Attempting to attach volume 6145c208-4e98-437d-8ab9-128d90920e28 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   <alias name="ua-6145c208-4e98-437d-8ab9-128d90920e28"/>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   <serial>6145c208-4e98-437d-8ab9-128d90920e28</serial>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="c9c50324-e51b-4eb8-bb61-e39d15f12ba3"/>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:16.859674 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:16:16.898702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:16:16.922682 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:16.926224 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:16.948720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:16.951095 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:16.985693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:17.153571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:17.153746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:17.238566 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999708863999786 future=<Future at 0x7ec5381fce30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:17.238566 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998738692000188 future=<Future at 0x7ec5381fce30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:17.238566 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998521181999877 future=<Future at 0x7ec5381fce30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:17.240077 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Instance destroyed successfully.
Jun 27 04:16:17.240604 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'resources' on Instance uuid 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:17.658215 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Detaching volume 1ee7c7d7-a681-4baf-a960-09dbad317c59
Jun 27 04:16:17.722766 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Attempting to driver detach volume 1ee7c7d7-a681-4baf-a960-09dbad317c59 from mountpoint /dev/vdb
Jun 27 04:16:17.736564 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Found disk vdb by alias ua-1ee7c7d7-a681-4baf-a960-09dbad317c59 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:17.737999 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Found disk vdb by alias ua-1ee7c7d7-a681-4baf-a960-09dbad317c59 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:17.738165 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Attempting to detach device vdb from instance 6e74649b-6954-4503-88e8-3d819ef17d34 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:   <alias name="ua-1ee7c7d7-a681-4baf-a960-09dbad317c59"/>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:   <serial>1ee7c7d7-a681-4baf-a960-09dbad317c59</serial>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:17.738421 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:17.744255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-681704950',display_name='tempest-TestEncryptedCinderVolumes-server-681704950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-681704950',id=46,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEItdecCAgggdpBWVtYsXEmK4IUyyeeqKhg23wISR9k4TSa/jQ64Q8L8jMCZvo8zmEB66Y/n5P00KJLI8m2M90k5Jwjzdo+ktJBrbhQFwvHbS4g208YMDgHEcEKB7uA3Bw==',key_name='tempest-keypair-593816567',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:15:20Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-tbxzxiat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db2d0b5572c9405aafaa0091643121a6',uuid=68efeba8-e1f9-421b-bcd0-a8a8116b4c80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:16:17.744438 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "948b7213-232b-4bbc-a30d-8b316076fd8b", "address": "fa:16:3e:d1:48:6e", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b7213-23", "ovs_interfaceid": "948b7213-232b-4bbc-a30d-8b316076fd8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:17.746676 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:17.746676 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:16:17.747555 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:17.747784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap948b7213-23, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:17.750657 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully detached device vdb from instance 6e74649b-6954-4503-88e8-3d819ef17d34 from the persistent domain config.
Jun 27 04:16:17.750843 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] (1/8): Attempting to detach device vdb with device alias ua-1ee7c7d7-a681-4baf-a960-09dbad317c59 from instance 6e74649b-6954-4503-88e8-3d819ef17d34 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:   <alias name="ua-1ee7c7d7-a681-4baf-a960-09dbad317c59"/>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:   <serial>1ee7c7d7-a681-4baf-a960-09dbad317c59</serial>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:17.751151 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:17.752665 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:17.753640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:17.754250 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:17.754374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c191a2cb-ee69-43b9-850d-b6f330a94d98) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:17.755030 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:17.755595 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:17.756012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:17.757973 np0000003830 nova-compute[98984]: INFO os_vif [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:48:6e,bridge_name='br-int',has_traffic_filtering=True,id=948b7213-232b-4bbc-a30d-8b316076fd8b,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b7213-23')
Jun 27 04:16:17.758441 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Deleting instance files /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80_del
Jun 27 04:16:17.759268 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Deletion of /opt/stack/data/nova/instances/68efeba8-e1f9-421b-bcd0-a8a8116b4c80_del complete
Jun 27 04:16:18.237286 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533778.2369673, 6e74649b-6954-4503-88e8-3d819ef17d34 => ua-1ee7c7d7-a681-4baf-a960-09dbad317c59> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:16:18.238954 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-1ee7c7d7-a681-4baf-a960-09dbad317c59 for instance 6e74649b-6954-4503-88e8-3d819ef17d34 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:16:18.241536 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully detached device vdb from instance 6e74649b-6954-4503-88e8-3d819ef17d34 from the live domain config.
Jun 27 04:16:18.242689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:16:18.242975 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ee7c7d7-a681-4baf-a960-09dbad317c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:18.243119 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:18.243460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:18.243785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1ee7c7d7-a681-4baf-a960-09dbad317c59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:16:18.243946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:16:18.266172 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 27 04:16:18.266769 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:16:18.267026 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:16:18.267153 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:16:18.267876 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:18.272364 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsi session list stdout=tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59 (non-flash)
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:18.272712 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:18.272918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '122')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:16:18.272918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '108')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:18.274230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59', '109')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:18.275249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538295bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:16:18.275454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:16:18.279016 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Flush multipath device 330000000ae0e3998 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:16:18.320587 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:18.365387 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:18.376626 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:18.423079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:16:18.423325 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:16:18.424368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:16:18.437344 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:16:18.437548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:16:18.447859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:18.479617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.40.100,3260]
Jun 27 04:16:18.479617 np0000003830 nova-compute[98984]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:18.479617 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:18.494383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:18.508517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:18.535771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.50.100,3260]
Jun 27 04:16:18.535771 np0000003830 nova-compute[98984]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-1ee7c7d7-a681-4baf-a960-09dbad317c59, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:18.535771 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:18.550405 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:18.550625 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:18.550722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] <== disconnect_volume: return (308ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:18.550836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:16:18.866169 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-daba5840-c074-4250-8aa1-00403b3aa8d7 req-be9c97ea-2901-4413-94d1-789620088907 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Received event network-vif-deleted-948b7213-232b-4bbc-a30d-8b316076fd8b {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:18.866757 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-daba5840-c074-4250-8aa1-00403b3aa8d7 req-be9c97ea-2901-4413-94d1-789620088907 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Neutron deleted interface 948b7213-232b-4bbc-a30d-8b316076fd8b; detaching it from the instance and deleting it from the info cache
Jun 27 04:16:18.868375 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-daba5840-c074-4250-8aa1-00403b3aa8d7 req-be9c97ea-2901-4413-94d1-789620088907 service nova] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Detach interface failed, port_id=948b7213-232b-4bbc-a30d-8b316076fd8b, reason: Instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:16:19.117481 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'flavor' on Instance uuid 6e74649b-6954-4503-88e8-3d819ef17d34 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:19.319731 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:19.497057 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:19.497204 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:19.497341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:19.497444 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:62:18:8d, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:16:19.521316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:19.821812 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Took 1.55 seconds to deallocate network for instance.
Jun 27 04:16:20.122928 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-452f9984-fe3a-48ae-80ff-d5013f75c6cc tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.969s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:20.327185 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:20.327364 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:20.381969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:20.381969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:20.381969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:20.381969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:20.381969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:20.384113 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Terminating instance
Jun 27 04:16:20.668427 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:20.668679 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:20.888478 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:16:20.911214 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:20.914075 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:20.940739 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:20.945714 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:20.976005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.061151 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b82dd3be-c3b3-409b-b3f2-0a40cb82f4d9 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.894s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:21.171654 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:21.219614 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.229365 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.254439 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99966726799994 future=<Future at 0x7ec5384a1af0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:21.259068 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Instance destroyed successfully.
Jun 27 04:16:21.260201 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lazy-loading 'resources' on Instance uuid 6e74649b-6954-4503-88e8-3d819ef17d34 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:21.545944 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:21.546135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:21.681741 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.354s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:21.683714 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.757942 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Deleted allocations for instance 68efeba8-e1f9-421b-bcd0-a8a8116b4c80
Jun 27 04:16:21.762966 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:14:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-379239479',display_name='tempest-VolumesBackupsTest-instance-379239479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumesbackupstest-instance-379239479',id=42,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1GppAjEFM5D8ZcCEYd51cmkpoko7JXLYXZv59caB2S0eLe/z+zFpDsAbGDHzez11zHDIsOy9bJa7CDMPN4tX5+iFVjlcpFUvEVvK2/qe0WBD1KscTWOdCzQO9L2aYg0w==',key_name='tempest-keypair-1759897499',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:14:22Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1121cceb6eae4ccb920a6e3123169bf9',ramdisk_id='',reservation_id='r-bwsz05u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1314634333',owner_user_name='tempest-VolumesBackupsTest-1314634333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:14:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cf90b3e43344e76aa1e04e16824517a',uuid=6e74649b-6954-4503-88e8-3d819ef17d34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:16:21.765477 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converting VIF {"id": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "address": "fa:16:3e:a5:04:a1", "network": {"id": "79f57f1c-eaa4-4a20-a0df-b30d762136e8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-97768574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1121cceb6eae4ccb920a6e3123169bf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bf81426-3f", "ovs_interfaceid": "9bf81426-3f68-4cb0-b70d-efcdec2bf131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:21.765477 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:21.765477 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:16:21.766919 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.767710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bf81426-3f, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:21.769626 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.771331 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:21.773069 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.773284 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3c01176-8c10-4aff-ba41-97f93e57ed15) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:21.775044 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:21.776121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:21.778671 np0000003830 nova-compute[98984]: INFO os_vif [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:04:a1,bridge_name='br-int',has_traffic_filtering=True,id=9bf81426-3f68-4cb0-b70d-efcdec2bf131,network=Network(79f57f1c-eaa4-4a20-a0df-b30d762136e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bf81426-3f')
Jun 27 04:16:21.782518 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Deleting instance files /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34_del
Jun 27 04:16:21.782518 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Deletion of /opt/stack/data/nova/instances/6e74649b-6954-4503-88e8-3d819ef17d34_del complete
Jun 27 04:16:22.048466 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Detaching volume 6145c208-4e98-437d-8ab9-128d90920e28
Jun 27 04:16:22.108787 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Attempting to driver detach volume 6145c208-4e98-437d-8ab9-128d90920e28 from mountpoint /dev/vdb
Jun 27 04:16:22.156629 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '8479537c-b3ab-47ec-8dbd-6f6c50b90728', 'attached_at': '', 'detached_at': '', 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'serial': '6145c208-4e98-437d-8ab9-128d90920e28'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:16:22.161484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-6145c208-4e98-437d-8ab9-128d90920e28 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:22.161667 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-6145c208-4e98-437d-8ab9-128d90920e28 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:22.161770 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Attempting to detach device vdb from instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <alias name="ua-6145c208-4e98-437d-8ab9-128d90920e28"/>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <serial>6145c208-4e98-437d-8ab9-128d90920e28</serial>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="c9c50324-e51b-4eb8-bb61-e39d15f12ba3"/>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:22.162190 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:22.174960 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 from the persistent domain config.
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] (1/8): Attempting to detach device vdb with device alias ua-6145c208-4e98-437d-8ab9-128d90920e28 from instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <alias name="ua-6145c208-4e98-437d-8ab9-128d90920e28"/>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <serial>6145c208-4e98-437d-8ab9-128d90920e28</serial>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="c9c50324-e51b-4eb8-bb61-e39d15f12ba3"/>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:22.175432 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:22.295853 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 27 04:16:22.296509 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:16:22.296780 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:16:22.296900 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:16:22.297110 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:22.466012 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:22.756975 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533782.753521, 8479537c-b3ab-47ec-8dbd-6f6c50b90728 => ua-6145c208-4e98-437d-8ab9-128d90920e28> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:16:22.758186 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6145c208-4e98-437d-8ab9-128d90920e28 for instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:16:22.761941 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 from the live domain config.
Jun 27 04:16:22.770903 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:16:22.770903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:22.771424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:22.771960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:22.771960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6145c208-4e98-437d-8ab9-128d90920e28', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:16:22.771960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:16:22.772770 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55f2c49d-4f94-4d90-85e4-75596376e785 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "68efeba8-e1f9-421b-bcd0-a8a8116b4c80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.381s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:22.804179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:22.804179 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:22.804179 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:22.804179 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:22.804179 np0000003830 nova-compute[98984]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f34f0599-2063-41d8-8b01-00cfdcd7eaa7 (non-flash)
Jun 27 04:16:22.804179 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:22.804349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:22.804349 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:22.804349 np0000003830 nova-compute[98984]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:22.804349 np0000003830 nova-compute[98984]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28 (non-flash)
Jun 27 04:16:22.804349 np0000003830 nova-compute[98984]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f34f0599-2063-41d8-8b01-00cfdcd7eaa7 (non-flash)
Jun 27 04:16:22.804349 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:22.804525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f34f0599-2063-41d8-8b01-00cfdcd7eaa7', '123')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:16:22.804525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '121')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:22.805740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28', '122')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:22.806699 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538296ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:16:22.806893 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:16:22.807069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flush multipath device 330000000c7ad53c6 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:16:22.843042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:22.891286 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:22.946650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:16:22.946986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:16:22.947728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:16:22.960695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:16:22.961022 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:16:22.974563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:22.998522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3910cc08-19b1-4f83-bda3-2f8b5f39dab8 req-4876077e-6b3e-4546-b245-cdcf3f89fbc0 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Received event network-vif-deleted-9bf81426-3f68-4cb0-b70d-efcdec2bf131 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:22.998734 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-3910cc08-19b1-4f83-bda3-2f8b5f39dab8 req-4876077e-6b3e-4546-b245-cdcf3f89fbc0 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Neutron deleted interface 9bf81426-3f68-4cb0-b70d-efcdec2bf131; detaching it from the instance and deleting it from the info cache
Jun 27 04:16:23.002686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3910cc08-19b1-4f83-bda3-2f8b5f39dab8 req-4876077e-6b3e-4546-b245-cdcf3f89fbc0 service nova] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Detach interface failed, port_id=9bf81426-3f68-4cb0-b70d-efcdec2bf131, reason: Instance 6e74649b-6954-4503-88e8-3d819ef17d34 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:16:23.010242 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.40.100,3260]
Jun 27 04:16:23.010242 np0000003830 nova-compute[98984]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:23.010242 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:23.034476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:23.047583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:23.087990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.50.100,3260]
Jun 27 04:16:23.087990 np0000003830 nova-compute[98984]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-6145c208-4e98-437d-8ab9-128d90920e28, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:23.087990 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:23.103572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:23.105349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:23.105461 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== disconnect_volume: return (334ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:23.105616 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:16:23.444629 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:23.669019 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 8479537c-b3ab-47ec-8dbd-6f6c50b90728 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:23.946757 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Took 1.65 seconds to deallocate network for instance.
Jun 27 04:16:24.453469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:24.453926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:24.523571 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:24.675010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3311b160-d752-44f2-a9b3-b9c4142f9064 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.129s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:24.737813 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:24.738093 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:24.946414 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:24.946634 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:24.946900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:24.947204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:24.947318 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:24.949182 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Terminating instance
Jun 27 04:16:25.244143 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:25.266549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.452488 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:16:25.481897 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.484042 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.501826 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.507002 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.525026 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.530904 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.750209 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.296s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:25.775613 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.803706 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999736396000117 future=<Future at 0x7ec5384a9580 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:25.805808 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Instance destroyed successfully.
Jun 27 04:16:25.806224 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'resources' on Instance uuid 8479537c-b3ab-47ec-8dbd-6f6c50b90728 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:25.813522 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.818595 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:25.834653 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Deleted allocations for instance 6e74649b-6954-4503-88e8-3d819ef17d34
Jun 27 04:16:25.842601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.161220 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.169380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.172245 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.198940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.296653 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.309424 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1317894829',display_name='tempest-TestEncryptedCinderVolumes-server-1317894829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1317894829',id=48,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDoOiknDkFVlVNe8OFvap1XxgRWaMmAdbEaO4MC1tfIC+AgLzE7nPsRJjPROBlBdnOlL/lew9IY/b4HE9TBT+uyfwoV/MqSCiiGskpmo+gHlvvubUPeCz8XFA3AaMA7QQ==',key_name='tempest-keypair-406104935',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:15:27Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-ru21q8tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=8479537c-b3ab-47ec-8dbd-6f6c50b90728,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:16:26.309424 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "address": "fa:16:3e:62:18:8d", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa72f01-5b", "ovs_interfaceid": "bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:26.309424 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:26.309424 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:16:26.310826 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.311154 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfa72f01-5b, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:26.312919 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.313347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:26.323293 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.323778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.325860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.326060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f6b600f-32eb-46d9-bba1-9084a5ec8e2c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:26.326569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.327428 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:26.331024 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:26.345479 np0000003830 nova-compute[98984]: INFO os_vif [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:18:8d,bridge_name='br-int',has_traffic_filtering=True,id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa72f01-5b')
Jun 27 04:16:26.345479 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Deleting instance files /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728_del
Jun 27 04:16:26.350292 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Deletion of /opt/stack/data/nova/instances/8479537c-b3ab-47ec-8dbd-6f6c50b90728_del complete
Jun 27 04:16:26.833559 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:26.833559 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=98984) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 27 04:16:26.843376 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f7c479c6-5b09-452e-8fa8-088e71a07480 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Lock "6e74649b-6954-4503-88e8-3d819ef17d34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.463s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:26.859062 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 27 04:16:26.859847 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:16:26.860123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:16:26.860123 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:16:26.860340 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:26.932433 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:27.334639 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:16:27.345549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:27.638807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:27.638807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:27.638807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:27.638807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:27.638807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:27.639821 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Terminating instance
Jun 27 04:16:27.793483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-749be377-6b4a-49a4-865b-08168ea6901c req-340e082a-1b91-448f-bcc4-6cb044fede4b service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Received event network-vif-deleted-bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:27.793734 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-749be377-6b4a-49a4-865b-08168ea6901c req-340e082a-1b91-448f-bcc4-6cb044fede4b service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Neutron deleted interface bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0; detaching it from the instance and deleting it from the info cache
Jun 27 04:16:27.796835 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-749be377-6b4a-49a4-865b-08168ea6901c req-340e082a-1b91-448f-bcc4-6cb044fede4b service nova] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Detach interface failed, port_id=bfa72f01-5ba0-4d41-b8ce-155f4a2ceda0, reason: Instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:16:28.143761 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:16:28.162050 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.188723 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.214819 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:28.336567 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.341669 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.416402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b9915cb-66a4-45f2-816b-626f679923ff req-00569690-a1da-49f4-8a37-40939d6134ba service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:28.416402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b9915cb-66a4-45f2-816b-626f679923ff req-00569690-a1da-49f4-8a37-40939d6134ba service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:28.416601 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b9915cb-66a4-45f2-816b-626f679923ff req-00569690-a1da-49f4-8a37-40939d6134ba service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:28.417133 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b9915cb-66a4-45f2-816b-626f679923ff req-00569690-a1da-49f4-8a37-40939d6134ba service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:28.419361 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b9915cb-66a4-45f2-816b-626f679923ff req-00569690-a1da-49f4-8a37-40939d6134ba service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:28.419711 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b9915cb-66a4-45f2-816b-626f679923ff req-00569690-a1da-49f4-8a37-40939d6134ba service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:28.450432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.489322 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999557226999968 future=<Future at 0x7ec51877ac30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:28.489937 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Instance destroyed successfully.
Jun 27 04:16:28.490536 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'resources' on Instance uuid 050c6413-cd32-4a23-ba74-c2dc2cb811ec {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:28.495576 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.518726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.633662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.639001 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.717781 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Took 1.86 seconds to deallocate network for instance.
Jun 27 04:16:28.794474 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.800211 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:28.998698 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:15:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-927063783',display_name='tempest-AttachVolumeNegativeTest-server-927063783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-927063783',id=49,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0tAOSMviR/3a1FGACccqo5xPDcLZ0EeiI2aiU6mBRED26F9RiB0pPEOn1TS8c86ClUUXmtwp9y1ql80wDUT8Q2gl26s8OE7QNGcGX3zDlqXnsq5az89M/bd6KrxTgXmQ==',key_name='tempest-keypair-965618758',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:15:48Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-shfr81uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=050c6413-cd32-4a23-ba74-c2dc2cb811ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:16:28.998698 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "21f3d665-3527-47eb-a666-0075ce486ff5", "address": "fa:16:3e:89:4d:de", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f3d665-35", "ovs_interfaceid": "21f3d665-3527-47eb-a666-0075ce486ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:28.999386 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:28.999769 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:16:29.002616 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:29.002616 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21f3d665-35, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:29.004260 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:29.005314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:29.005314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d30549af-dd67-4407-9224-ec17b006da0c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:29.006016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:29.006147 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:29.006663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:29.007991 np0000003830 nova-compute[98984]: INFO os_vif [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4d:de,bridge_name='br-int',has_traffic_filtering=True,id=21f3d665-3527-47eb-a666-0075ce486ff5,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f3d665-35')
Jun 27 04:16:29.008327 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Deleting instance files /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec_del
Jun 27 04:16:29.009257 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Deletion of /opt/stack/data/nova/instances/050c6413-cd32-4a23-ba74-c2dc2cb811ec_del complete
Jun 27 04:16:29.224424 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:29.225080 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:29.474290 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:29.474443 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:29.516173 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 27 04:16:29.517102 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:16:29.517222 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:16:29.517694 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:16:29.517694 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:29.524158 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:29.595387 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:29.985837 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:30.271342 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-330b7b40-b770-4c42-a634-713f7e70d1dc req-32012eed-c985-468b-b31c-7cc95dec3027 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-deleted-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:30.271920 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-330b7b40-b770-4c42-a634-713f7e70d1dc req-32012eed-c985-468b-b31c-7cc95dec3027 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Neutron deleted interface 21f3d665-3527-47eb-a666-0075ce486ff5; detaching it from the instance and deleting it from the info cache
Jun 27 04:16:30.275460 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-330b7b40-b770-4c42-a634-713f7e70d1dc req-32012eed-c985-468b-b31c-7cc95dec3027 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Detach interface failed, port_id=21f3d665-3527-47eb-a666-0075ce486ff5, reason: Instance 050c6413-cd32-4a23-ba74-c2dc2cb811ec could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:16:30.332941 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:30.333260 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:30.484871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.260s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.499927 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:30.502046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:30.502234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:30.502370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.502564 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:30.502759 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:30.503050 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:30.503197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:30.503342 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:30.503461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.503734 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:30.503872 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received unexpected event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with vm_state active and task_state deleting.
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received unexpected event network-vif-plugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with vm_state active and task_state deleting.
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Acquiring lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:30.505930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:30.506730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.506730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] No waiting events found dispatching network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:30.506730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e112c404-5942-4c6e-ac81-43bed77c4a02 req-39192c7a-eaab-4f5c-8e17-9fb778c43443 service nova] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Received event network-vif-unplugged-21f3d665-3527-47eb-a666-0075ce486ff5 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:30.575305 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deleted allocations for instance 8479537c-b3ab-47ec-8dbd-6f6c50b90728
Jun 27 04:16:30.709534 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:30.839017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:30.839385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:30.839385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:30.839908 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:16:31.212193 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Took 1.69 seconds to deallocate network for instance.
Jun 27 04:16:31.584475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-81d1471f-c047-414a-b4a3-bbc7cd39115d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "8479537c-b3ab-47ec-8dbd-6f6c50b90728" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.637s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:31.695778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:31.720067 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:31.720273 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:31.862445 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:31.894271 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:31.894634 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:31.971833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:31.972296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:32.072094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:32.072094 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:16:32.079124 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:16:32.080116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:32.134796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:32.135452 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51347MB free_disk=72.24195861816406GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:16:32.135766 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:32.237523 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005605320002359804 future=<Future at 0x7ec5381fce30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:32.238093 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] Emitting event <LifecycleEvent: 1782533777.2365878, 68efeba8-e1f9-421b-bcd0-a8a8116b4c80 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:32.238256 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:32.238558 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] VM Stopped (Lifecycle Event)
Jun 27 04:16:32.240377 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.013669305999883 future=<Future at 0x7ec5384a1af0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:32.240649 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.0134225419997165 future=<Future at 0x7ec5384a1af0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:32.400442 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:32.742219 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7da24d8c-420e-434c-ae1b-415a574d5142 tempest-VolumesBackupsTest-1314634333 tempest-VolumesBackupsTest-1314634333-project-member] [instance: 68efeba8-e1f9-421b-bcd0-a8a8116b4c80] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:32.910228 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.190s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:32.913224 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.777s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:32.969811 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Deleted allocations for instance 050c6413-cd32-4a23-ba74-c2dc2cb811ec
Jun 27 04:16:32.979707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:32.979942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:33.482527 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:33.978907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-92d4ec71-8cbc-4df2-b0bb-f15fe92582b7 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "050c6413-cd32-4a23-ba74-c2dc2cb811ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.342s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:33.986094 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:16:34.005885 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:34.043384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:34.488812 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a9f98c83-dbd6-4189-8292-4a14792117d2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
Jun 27 04:16:34.489144 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 1 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:16:34.489357 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=16 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:16:32 up 39 min,  2 users,  load average: 8.61, 8.73, 6.10\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_cbd1ebe1144a427082b2a28cd85def6b': '1', 'io_workload': '0'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:16:34.526417 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:34.688694 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:34.689087 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:34.723332 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:34.723547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:35.191796 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:35.227210 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Detaching volume f55f4c1b-8be0-4eae-b306-4a20205f0117
Jun 27 04:16:35.283894 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Attempting to driver detach volume f55f4c1b-8be0-4eae-b306-4a20205f0117 from mountpoint /dev/vdb
Jun 27 04:16:35.290441 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found disk vdb by alias ua-f55f4c1b-8be0-4eae-b306-4a20205f0117 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:35.292064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found disk vdb by alias ua-f55f4c1b-8be0-4eae-b306-4a20205f0117 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:16:35.292259 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Attempting to detach device vdb from instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:   <alias name="ua-f55f4c1b-8be0-4eae-b306-4a20205f0117"/>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:   <serial>f55f4c1b-8be0-4eae-b306-4a20205f0117</serial>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:35.292464 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:35.303213 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully detached device vdb from instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e from the persistent domain config.
Jun 27 04:16:35.303363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] (1/8): Attempting to detach device vdb with device alias ua-f55f4c1b-8be0-4eae-b306-4a20205f0117 from instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:   <alias name="ua-f55f4c1b-8be0-4eae-b306-4a20205f0117"/>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:   <serial>f55f4c1b-8be0-4eae-b306-4a20205f0117</serial>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:16:35.303691 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:16:35.699959 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:16:35.699959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.787s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:35.700660 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:16:35.700950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.658s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:35.710506 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:35.712536 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Claim successful on node np0000003830
Jun 27 04:16:35.885988 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533795.8854833, 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e => ua-f55f4c1b-8be0-4eae-b306-4a20205f0117> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:16:35.892464 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f55f4c1b-8be0-4eae-b306-4a20205f0117 for instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:16:35.896626 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully detached device vdb from instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e from the live domain config.
Jun 27 04:16:35.898024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:16:35.898485 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f55f4c1b-8be0-4eae-b306-4a20205f0117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:35.898735 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:35.899241 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:35.899740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f55f4c1b-8be0-4eae-b306-4a20205f0117', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:16:35.900432 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:16:35.902716 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:35.928193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:35.928193 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:35.928193 np0000003830 nova-compute[98984]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:35.928193 np0000003830 nova-compute[98984]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:35.928193 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:35.928533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:35.928533 np0000003830 nova-compute[98984]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117 (non-flash)
Jun 27 04:16:35.928533 np0000003830 nova-compute[98984]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:35.928533 np0000003830 nova-compute[98984]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:35.928533 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:35.928715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '125')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:16:35.928796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '110')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:35.929895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117', '111')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:16:35.930858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538138ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:16:35.931117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:16:35.931413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flush multipath device 330000000737f4fd5 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:16:35.968540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:36.030029 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:16:36.087069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:16:36.087285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:16:36.088385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:16:36.104942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:16:36.105210 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:16:36.118194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:36.159603 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.40.100,3260]
Jun 27 04:16:36.159603 np0000003830 nova-compute[98984]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:36.159603 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:36.175671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:36.189970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:36.198004 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:36.198458 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:36.198720 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:36.198951 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:36.199101 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:16:36.199531 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.63 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:16:36.228356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.50.100,3260]
Jun 27 04:16:36.228356 np0000003830 nova-compute[98984]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-f55f4c1b-8be0-4eae-b306-4a20205f0117, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:36.228356 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:36.245532 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:36.245532 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:36.245532 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== disconnect_volume: return (344ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:36.245532 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:16:36.254484 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003802640003414126 future=<Future at 0x7ec5384a1af0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:36.255107 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Emitting event <LifecycleEvent: 1782533781.253956, 6e74649b-6954-4503-88e8-3d819ef17d34 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:36.255258 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] VM Stopped (Lifecycle Event)
Jun 27 04:16:36.255787 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:36.256613 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.546821085999909 future=<Future at 0x7ec5384a9580 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:36.256882 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.546690024999862 future=<Future at 0x7ec5384a9580 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:36.760949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 6e74649b-6954-4503-88e8-3d819ef17d34] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:36.830992 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:36.831463 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:16:36.918944 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:36.976109 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:36.976407 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:37.478983 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:37.827130 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:37.827608 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:16:37.930533 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cb28c8b5-3a3d-4b6a-9a90-0747dab4895f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.207s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:37.985263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.284s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:37.985720 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:37.991894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:37.992405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:38.184845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:38.493409 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:16:38.493409 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:16:38.493409 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:38.493409 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:38.503982 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:38.603071 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49b9832df5614177bdd2c91a1ecc6390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebd24b443df4c99bc3cc60c079c474b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:16:38.996647 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:16:39.010600 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:39.139704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:39.139996 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:39.157881 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:39.157881 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Claim successful on node np0000003830
Jun 27 04:16:39.260346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:39.260346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:39.260346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:39.260346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:39.260346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:39.260346 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Terminating instance
Jun 27 04:16:39.505088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:16:39.527485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:39.757753 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:16:39.792990 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:39.798455 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:39.835580 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:39.839095 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:39.873046 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.014175 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-47d8d5ef-7a50-4192-9c6a-71e4060a9061 req-a906cce3-47b0-4e93-a85e-8679a6095e41 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:40.014373 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-47d8d5ef-7a50-4192-9c6a-71e4060a9061 req-a906cce3-47b0-4e93-a85e-8679a6095e41 service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:40.014672 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-47d8d5ef-7a50-4192-9c6a-71e4060a9061 req-a906cce3-47b0-4e93-a85e-8679a6095e41 service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:40.014882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-47d8d5ef-7a50-4192-9c6a-71e4060a9061 req-a906cce3-47b0-4e93-a85e-8679a6095e41 service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:40.015015 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-47d8d5ef-7a50-4192-9c6a-71e4060a9061 req-a906cce3-47b0-4e93-a85e-8679a6095e41 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:40.015086 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-47d8d5ef-7a50-4192-9c6a-71e4060a9061 req-a906cce3-47b0-4e93-a85e-8679a6095e41 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:40.053240 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Successfully created port: fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:16:40.110994 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.149607 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99970476899989 future=<Future at 0x7ec538409010 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:40.154321 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.157939 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Instance destroyed successfully.
Jun 27 04:16:40.159539 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'resources' on Instance uuid 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:40.183691 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.488127 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:40.488416 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:40.513531 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:16:40.514794 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:16:40.516539 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Creating image(s)
Jun 27 04:16:40.516539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:40.516539 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "/opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:40.519668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "/opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:40.520536 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:40.524143 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:40.526270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:40.600857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.610375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.619447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.650986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.121s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:40.650986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:40.650986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:40.650986 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:40.664732 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:40.664732 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.664732 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:40.675490 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:14:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-771838564',display_name='tempest-AttachVolumeNegativeTest-server-771838564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-771838564',id=44,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKdkqV93OoYTBGzDX0Vcudc6DDotrKTPOkPHIspi9haXBmWJN6b6dkvAXBJ1yxIZnAfARu5prdhHOUsGrHYMgKDPtQWgaBf5w+cU523wpAb767rYj1/rNRnfW9YemZZaw==',key_name='tempest-keypair-2127817202',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:14:40Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-ay4o0b27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:16:40.676469 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "14401e48-b7c6-4b89-9062-607cb966d96e", "address": "fa:16:3e:35:49:09", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap14401e48-b7", "ovs_interfaceid": "14401e48-b7c6-4b89-9062-607cb966d96e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:40.679463 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:40.680646 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:16:40.688786 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.689427 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14401e48-b7, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:40.690316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.691691 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:40.692668 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.692668 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f611bc7-0f3d-4b6e-9e69-623f358cd486) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:40.693285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.693870 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:40.694789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.697708 np0000003830 nova-compute[98984]: INFO os_vif [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:49:09,bridge_name='br-int',has_traffic_filtering=True,id=14401e48-b7c6-4b89-9062-607cb966d96e,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14401e48-b7')
Jun 27 04:16:40.698186 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Deleting instance files /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e_del
Jun 27 04:16:40.704808 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Deletion of /opt/stack/data/nova/instances/4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e_del complete
Jun 27 04:16:40.748863 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:40.749637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:40.778885 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.800326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:40.803886 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004321999999774562 future=<Future at 0x7ec5384a9580 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:40.804861 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Emitting event <LifecycleEvent: 1782533785.8033445, 8479537c-b3ab-47ec-8dbd-6f6c50b90728 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:40.805031 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:40.805741 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] VM Stopped (Lifecycle Event)
Jun 27 04:16:40.807533 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.6771813860000293 future=<Future at 0x7ec51877ac30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:40.807741 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.676937106999958 future=<Future at 0x7ec51877ac30 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:40.846627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk 1073741824" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:40.846627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:40.846627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:40.947610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:40.948130 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:16:40.948420 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:40.993095 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:41.041137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:41.041660 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Cannot resize image /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:16:41.042280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:16:41.042507 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Ensure instance console log exists: /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:16:41.042871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:41.043103 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:41.043286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:41.101903 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Successfully updated port: fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:16:41.157259 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-changed-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:41.157259 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Refreshing instance network info cache due to event network-changed-fe71007a-262f-4792-9fda-3690719ffbd2. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:41.157259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] Acquiring lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:41.157259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] Acquired lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:41.157259 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Refreshing network info cache for port fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:41.216744 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Took 1.46 seconds to destroy the instance on the hypervisor.
Jun 27 04:16:41.216744 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:16:41.216744 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:16:41.216744 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:16:41.216744 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:41.309355 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-bab28877-9974-4bc4-a3c5-8a62bb8c93d1 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 8479537c-b3ab-47ec-8dbd-6f6c50b90728] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:41.508458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.366s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:41.508458 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:41.597700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:41.657773 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:41.744466 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:41.771458 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:41.983305 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:42.018524 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:16:42.018524 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:16:42.018524 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:42.018524 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:42.093402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:42.094284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:42.094284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:42.094664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:42.094664 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:42.094857 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:42.095010 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:42.095183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:42.095458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:42.095590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:42.095733 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:42.095886 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received unexpected event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with vm_state active and task_state deleting.
Jun 27 04:16:42.096087 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:42.096213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:42.096410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:42.096586 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:42.096752 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:42.096902 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received unexpected event network-vif-plugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with vm_state active and task_state deleting.
Jun 27 04:16:42.097155 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:42.097512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:42.098488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:42.099508 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:42.099673 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:42.099851 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:42.100005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:42.100188 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Acquiring lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:42.100466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:42.100680 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:42.100857 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] No waiting events found dispatching network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:42.100939 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-36c9701f-ec5e-46f3-95f1-d1c1b806b90f req-d98bce29-b5b6-4ea0-8384-117b3a581b8c service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-unplugged-14401e48-b7c6-4b89-9062-607cb966d96e for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:16:42.153913 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a2a8189b804630997728bfb949fba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c1eb5f65f0446eae1f4967af349cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:16:42.485743 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1803a798-a22f-4266-a47a-06ffe626a0f3 req-0b5c4a4c-c1cb-4704-b21c-8e78e9719731 service nova] Releasing lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:42.487298 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquired lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:42.487298 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:16:42.520168 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:16:42.722059 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Successfully created port: 2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:16:42.786871 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:42.830601 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:42.830767 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 27 04:16:43.024017 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:16:43.221831 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:43.240030 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e506d552-f76a-49fd-b862-87318c21b50c req-3430b8b6-08ca-4f24-b931-3241714b7848 service nova] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Received event network-vif-deleted-14401e48-b7c6-4b89-9062-607cb966d96e {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:43.288909 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Took 2.07 seconds to deallocate network for instance.
Jun 27 04:16:43.333778 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] There are 0 instances to clean {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 27 04:16:43.333778 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:16:43.485985 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.001243731000158732 future=<Future at 0x7ec51877ac30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:43.486873 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782533788.4846132, 050c6413-cd32-4a23-ba74-c2dc2cb811ec => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:43.487231 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:43.487532 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] VM Stopped (Lifecycle Event)
Jun 27 04:16:43.489656 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.660018557999592 future=<Future at 0x7ec538409010 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:43.489656 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.65969776799966 future=<Future at 0x7ec538409010 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:43.538698 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:43.658999 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Successfully updated port: 2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:16:43.795722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:43.796234 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:43.836351 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:16:43.868348 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:43.879612 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:43.992606 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 050c6413-cd32-4a23-ba74-c2dc2cb811ec] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:44.033815 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:16:44.034857 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:16:44.035278 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Creating image(s)
Jun 27 04:16:44.035665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "/opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:44.035872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:44.036544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:44.036936 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:44.042274 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:44.043749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:44.090529 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating instance_info_cache with network_info: [{"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:44.096099 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:44.096383 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:44.143753 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:44.144213 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:44.144904 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:44.145676 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:44.148639 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:44.149886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:44.166147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:44.166431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:44.167149 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:16:44.175111 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-changed-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:44.176431 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Refreshing instance network info cache due to event network-changed-2512a5e4-7b48-4f42-99b7-fad75e3f7494. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:44.176615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] Acquiring lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:44.251994 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.102s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:44.253135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:44.321791 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk 1073741824" returned: 0 in 0.069s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:44.322250 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:44.323013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:44.417781 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:44.418612 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:16:44.419049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:44.527141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:44.527755 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Cannot resize image /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:16:44.528085 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:16:44.528451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Ensure instance console log exists: /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:16:44.528806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:44.528977 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:44.529128 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:44.529774 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:44.593483 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Releasing lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:44.594003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Instance network_info: |[{"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:16:44.597330 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Start _get_guest_xml network_info=[{"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:16:44.601814 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:44.610706 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:16:44.612791 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-32098929', uuid='a9f98c83-dbd6-4189-8292-4a14792117d2'), owner=OwnerMeta(userid='49b9832df5614177bdd2c91a1ecc6390', username='tempest-SnapshotDataIntegrityTests-1395059374-project-member', projectid='4ebd24b443df4c99bc3cc60c079c474b', projectname='tempest-SnapshotDataIntegrityTests-1395059374'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533804.6120555) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:16:44.614605 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:16:44.615031 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:16:44.617488 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:16:44.617488 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:16:44.618337 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:16:44.618842 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:16:44.619251 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:16:44.619251 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:16:44.619251 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:16:44.619914 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:16:44.619914 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:16:44.619914 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:16:44.620409 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:16:44.620409 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:16:44.620409 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:16:44.621702 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:16:44.640428 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-32098929',display_name='tempest-SnapshotDataIntegrityTests-server-32098929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-snapshotdataintegritytests-server-32098929',id=51,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAhUWa+dUyzNQvXEnqrzz58LA4fkrE1bHzTf8AdZg7ZkbvZhhafj6EoQG+sH+qqUrY3T5mqQ3lKLoL/0ek3lVHwngaI7/31tU9+9POgsCTAcUyN51s6KwkHExlCiGDnOA==',key_name='tempest-keypair-273654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ebd24b443df4c99bc3cc60c079c474b',ramdisk_id='',reservation_id='r-bqc0pv74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1395059374',owner_user_name='tempest-SnapshotDataIntegrityTests-1395059374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49b9832df5614177bdd2c91a1ecc6390',uuid=a9f98c83-dbd6-4189-8292-4a14792117d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:16:44.641074 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Converting VIF {"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:44.642329 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:44.643259 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'pci_devices' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:44.752646 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:44.925959 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:45.066995 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updating instance_info_cache with network_info: [{"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:45.109473 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.313s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:45.121552 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2f07d6b8-1bbf-4956-bd60-d7973dd3c714 req-ddb976a9-fa27-4bff-a30b-aa7b95937699 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:45.121822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f07d6b8-1bbf-4956-bd60-d7973dd3c714 req-ddb976a9-fa27-4bff-a30b-aa7b95937699 service nova] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:45.121999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f07d6b8-1bbf-4956-bd60-d7973dd3c714 req-ddb976a9-fa27-4bff-a30b-aa7b95937699 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:45.122124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f07d6b8-1bbf-4956-bd60-d7973dd3c714 req-ddb976a9-fa27-4bff-a30b-aa7b95937699 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:45.122242 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2f07d6b8-1bbf-4956-bd60-d7973dd3c714 req-ddb976a9-fa27-4bff-a30b-aa7b95937699 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] No waiting events found dispatching network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:45.122381 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2f07d6b8-1bbf-4956-bd60-d7973dd3c714 req-ddb976a9-fa27-4bff-a30b-aa7b95937699 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received unexpected event network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 for instance with vm_state building and task_state spawning.
Jun 27 04:16:45.148230 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:45.148589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <uuid>a9f98c83-dbd6-4189-8292-4a14792117d2</uuid>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <name>instance-00000033</name>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-32098929</nova:name>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:16:44</nova:creationTime>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:user uuid="49b9832df5614177bdd2c91a1ecc6390">tempest-SnapshotDataIntegrityTests-1395059374-project-member</nova:user>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:project uuid="4ebd24b443df4c99bc3cc60c079c474b">tempest-SnapshotDataIntegrityTests-1395059374</nova:project>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         <nova:port uuid="fe71007a-262f-4792-9fda-3690719ffbd2">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <entry name="serial">a9f98c83-dbd6-4189-8292-4a14792117d2</entry>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <entry name="uuid">a9f98c83-dbd6-4189-8292-4a14792117d2</entry>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.config"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fe:92:3a"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <target dev="tapfe71007a-26"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/console.log" append="off"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:16:45.150525 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:16:45.152613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Preparing to wait for external event network-vif-plugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:16:45.152613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:45.152613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:45.152613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:45.152613 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-32098929',display_name='tempest-SnapshotDataIntegrityTests-server-32098929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-snapshotdataintegritytests-server-32098929',id=51,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAhUWa+dUyzNQvXEnqrzz58LA4fkrE1bHzTf8AdZg7ZkbvZhhafj6EoQG+sH+qqUrY3T5mqQ3lKLoL/0ek3lVHwngaI7/31tU9+9POgsCTAcUyN51s6KwkHExlCiGDnOA==',key_name='tempest-keypair-273654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ebd24b443df4c99bc3cc60c079c474b',ramdisk_id='',reservation_id='r-bqc0pv74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1395059374',owner_user_name='tempest-SnapshotDataIntegrityTests-1395059374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49b9832df5614177bdd2c91a1ecc6390',uuid=a9f98c83-dbd6-4189-8292-4a14792117d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:16:45.152613 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Converting VIF {"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:45.153288 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:45.153577 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:16:45.154535 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:45.155462 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:45.155966 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:16:45.156839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:45.157069 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3190db5e-dac9-5302-bb86-42ea289c12ce', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:45.159802 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:45.160588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:45.162410 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:45.162485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe71007a-26, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:45.162756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe71007a-26, col_values=(('qos', UUID('a9e3f3f8-b335-474d-ad16-6ef26903b3cf')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:45.162918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe71007a-26, col_values=(('external_ids', {'iface-id': 'fe71007a-262f-4792-9fda-3690719ffbd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:92:3a', 'vm-uuid': 'a9f98c83-dbd6-4189-8292-4a14792117d2'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:45.165101 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:45.169421 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Deleted allocations for instance 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e
Jun 27 04:16:45.171995 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:45.172935 np0000003830 nova-compute[98984]: INFO os_vif [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26')
Jun 27 04:16:45.275904 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:45.569417 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:45.569783 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Instance network_info: |[{"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:16:45.570042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] Acquired lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:45.570280 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Refreshing network info cache for port 2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:45.574008 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Start _get_guest_xml network_info=[{"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:16:45.579182 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:16:45.580420 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-575092653', uuid='01c43b2c-e0c8-4759-b0be-43fdf4356911'), owner=OwnerMeta(userid='c0a2a8189b804630997728bfb949fba1', username='tempest-TestEncryptedCinderVolumes-1777393507-project-member', projectid='56c1eb5f65f0446eae1f4967af349cd1', projectname='tempest-TestEncryptedCinderVolumes-1777393507'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533805.5800698) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:16:45.583061 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:16:45.583511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:16:45.584911 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:16:45.585467 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:16:45.586395 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:16:45.586793 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:16:45.587019 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:16:45.587117 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:16:45.587318 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:16:45.587318 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:16:45.587404 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:16:45.587619 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:16:45.587831 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:16:45.588345 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:16:45.588345 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:16:45.588345 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:16:45.599839 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-575092653',display_name='tempest-TestEncryptedCinderVolumes-server-575092653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-575092653',id=52,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKonQFZZuALjRegfcFsTUwoYvYrDMeqFPstmK4jK5wt0k0VCBKemXN0qorFHphwiBwXqSoWlLx0eOvZk4evDMhryQZGidVaeEHivOEB84DXt1TV7NMawzjJBojISTjxdw==',key_name='tempest-keypair-1446209593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-d8bdvigr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=01c43b2c-e0c8-4759-b0be-43fdf4356911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:16:45.600096 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:45.600651 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:45.601194 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'pci_devices' on Instance uuid 01c43b2c-e0c8-4759-b0be-43fdf4356911 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:45.654890 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:46.075770 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <uuid>01c43b2c-e0c8-4759-b0be-43fdf4356911</uuid>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <name>instance-00000034</name>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-575092653</nova:name>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:16:45</nova:creationTime>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:user uuid="c0a2a8189b804630997728bfb949fba1">tempest-TestEncryptedCinderVolumes-1777393507-project-member</nova:user>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:project uuid="56c1eb5f65f0446eae1f4967af349cd1">tempest-TestEncryptedCinderVolumes-1777393507</nova:project>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         <nova:port uuid="2512a5e4-7b48-4f42-99b7-fad75e3f7494">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <entry name="serial">01c43b2c-e0c8-4759-b0be-43fdf4356911</entry>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <entry name="uuid">01c43b2c-e0c8-4759-b0be-43fdf4356911</entry>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.config"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:17:fd:e1"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <target dev="tap2512a5e4-7b"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/console.log" append="off"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:16:46.103975 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Preparing to wait for external event network-vif-plugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-575092653',display_name='tempest-TestEncryptedCinderVolumes-server-575092653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-575092653',id=52,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKonQFZZuALjRegfcFsTUwoYvYrDMeqFPstmK4jK5wt0k0VCBKemXN0qorFHphwiBwXqSoWlLx0eOvZk4evDMhryQZGidVaeEHivOEB84DXt1TV7NMawzjJBojISTjxdw==',key_name='tempest-keypair-1446209593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-d8bdvigr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=01c43b2c-e0c8-4759-b0be-43fdf4356911,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:46.105901 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:46.106220 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:16:46.106549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.106549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:46.106697 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:16:46.107051 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.107182 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdf9be64-c7d6-5f52-8158-10d42a343562', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:46.108035 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.108878 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.109207 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:46.114218 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.116150 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.116320 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2512a5e4-7b, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:46.116648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2512a5e4-7b, col_values=(('qos', UUID('2086fbf6-fedb-4127-8c54-fc9531a9ba77')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:46.116783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2512a5e4-7b, col_values=(('external_ids', {'iface-id': '2512a5e4-7b48-4f42-99b7-fad75e3f7494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:fd:e1', 'vm-uuid': '01c43b2c-e0c8-4759-b0be-43fdf4356911'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:46.117880 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.119108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:46.128013 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:46.128997 np0000003830 nova-compute[98984]: INFO os_vif [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b')
Jun 27 04:16:46.181348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b145bdf0-58f1-4d9c-b996-26c23a8d7288 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.929s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:46.236631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:46.237345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:46.240025 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:46.240741 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Claim successful on node np0000003830
Jun 27 04:16:46.437547 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:46.617942 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updated VIF entry in instance network info cache for port 2512a5e4-7b48-4f42-99b7-fad75e3f7494. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:16:46.618205 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updating instance_info_cache with network_info: [{"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:46.697111 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:46.697299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:46.697419 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No VIF found with MAC fa:16:3e:fe:92:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:16:46.697965 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Using config drive
Jun 27 04:16:46.952733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:46.952894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:47.120318 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d6355dd1-479c-4213-b8ae-c8078db17a81 req-1cbaf66d-f5be-4f1a-9fc0-45f05edbeff3 service nova] Releasing lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:47.204074 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:47.211639 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b98f48a-0c71-4e1e-8e60-78a3a1f22457 req-5e4feab7-daf4-446c-b0ac-fa01f5729be8 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:47.211639 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b98f48a-0c71-4e1e-8e60-78a3a1f22457 req-5e4feab7-daf4-446c-b0ac-fa01f5729be8 service nova] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:47.211757 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b98f48a-0c71-4e1e-8e60-78a3a1f22457 req-5e4feab7-daf4-446c-b0ac-fa01f5729be8 service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:47.211930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8b98f48a-0c71-4e1e-8e60-78a3a1f22457 req-5e4feab7-daf4-446c-b0ac-fa01f5729be8 service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:47.212068 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8b98f48a-0c71-4e1e-8e60-78a3a1f22457 req-5e4feab7-daf4-446c-b0ac-fa01f5729be8 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] No event matching network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 in dict_keys([('network-vif-plugged', '2512a5e4-7b48-4f42-99b7-fad75e3f7494')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:16:47.212205 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8b98f48a-0c71-4e1e-8e60-78a3a1f22457 req-5e4feab7-daf4-446c-b0ac-fa01f5729be8 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received unexpected event network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 for instance with vm_state building and task_state spawning.
Jun 27 04:16:47.359764 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Creating config drive at /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.config
Jun 27 04:16:47.365184 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz2jn_1j6 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:47.380757 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:47.424772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz2jn_1j6" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:47.455008 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:47.530781 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:47.531105 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:47.645914 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:47.645974 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:47.646094 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:17:fd:e1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:16:47.646647 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Using config drive
Jun 27 04:16:47.899995 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:47.933695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:47.970329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:47.970627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:48.028619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.031987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:48.036581 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:48.045321 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.152012 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:48.249314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.256111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.260341 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.282256 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.289830 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.303091 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Creating config drive at /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.config
Jun 27 04:16:48.308383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3mi2ohpd {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:48.372432 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3mi2ohpd" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:48.473298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:48.548381 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.311s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:48.549361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.517s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:48.549622 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:48.555634 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:48.555862 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Claim successful on node np0000003830
Jun 27 04:16:48.754979 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533808.7544339, a9f98c83-dbd6-4189-8292-4a14792117d2 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:48.755582 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] VM Started (Lifecycle Event)
Jun 27 04:16:48.767182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:48.767526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:48.803842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.826867 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.830160 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:48.915678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.045730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:49.072387 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:16:49.072781 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:16:49.073249 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:49.073389 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:49.165023 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b37634a5befb4243a59d1ea76d47aa7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98005db8eb3947d8b16d88f66930edd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:16:49.203969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.205579 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.208207 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.210667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.231407 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.262695 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:49.270034 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:49.274058 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533809.2736304, a9f98c83-dbd6-4189-8292-4a14792117d2 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:49.274303 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] VM Paused (Lifecycle Event)
Jun 27 04:16:49.530660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:49.572673 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:16:49.686803 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Successfully created port: 6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:16:49.779850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:49.783040 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:16:49.827169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:49.937666 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:49.937925 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:50.076464 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:16:50.233644 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Successfully updated port: 6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:16:50.280242 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-changed-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:50.280441 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Refreshing instance network info cache due to event network-changed-6198baf1-42bb-44f8-8b5b-c6062458d252. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:50.280777 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] Acquiring lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:50.280925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] Acquired lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:50.281078 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Refreshing network info cache for port 6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:50.285529 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:16:50.285765 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533810.2856076, 01c43b2c-e0c8-4759-b0be-43fdf4356911 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:50.285874 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] VM Started (Lifecycle Event)
Jun 27 04:16:50.441018 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:50.480054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:50.735631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:50.783738 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:50.800800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:50.800800 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533810.789259, 01c43b2c-e0c8-4759-b0be-43fdf4356911 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:50.800800 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] VM Paused (Lifecycle Event)
Jun 27 04:16:50.878316 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:50.949596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.401s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:50.950280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.905s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:50.952698 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:50.967003 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:50.967003 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Claim successful on node np0000003830
Jun 27 04:16:51.085593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:16:51.086483 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:16:51.087283 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Creating image(s)
Jun 27 04:16:51.089223 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:51.090504 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "/opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:51.090504 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "/opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:51.091811 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "/opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:51.093252 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:51.099208 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:51.100685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:51.122206 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:51.195517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:51.204531 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:51.204531 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:51.204531 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:51.204531 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:51.204531 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:51.294795 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:51.295606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:51.296118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:51.318227 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:16:51.391603 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk 1073741824" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:51.392053 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:51.392371 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:51.460683 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:16:51.460952 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:16:51.463522 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:51.464158 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:51.492652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:51.493365 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:16:51.494239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:51.580011 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db2d0b5572c9405aafaa0091643121a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d99f8411b741b2ae3a730bfefef27b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:16:51.587564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:51.589561 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Cannot resize image /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:16:51.589561 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:16:51.589561 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Ensure instance console log exists: /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:16:51.589561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:51.589561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:51.589561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:51.592050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3a30a73a-a840-4a72-9bd9-74c20b13c5a4 req-d660da11-bdc7-4b09-8edf-fc014cdda0ef service nova] Releasing lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:51.592712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquired lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:51.592868 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:16:51.822382 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:16:51.966311 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:16:52.093620 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:52.212032 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:52.226437 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Successfully created port: 56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:16:52.421430 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:52.469999 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:16:52.589327 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Updating instance_info_cache with network_info: [{"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:52.608952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:52.609289 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:52.831957 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Successfully updated port: 56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:16:52.882384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-changed-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:52.882576 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Refreshing instance network info cache due to event network-changed-56c27299-ff0b-4543-b205-dda1b4dc7351. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:52.882817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] Acquiring lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:52.882817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] Acquired lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:52.882995 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Refreshing network info cache for port 56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:52.976183 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Booting with volume fca51200-145e-40d0-b861-0cdb504cd581 at /dev/vda
Jun 27 04:16:53.030040 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:53.036013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:16:53.059854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:53.092653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Releasing lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:53.093355 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Instance network_info: |[{"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:16:53.095453 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Start _get_guest_xml network_info=[{"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:16:53.099640 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:16:53.101002 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-927472873', uuid='f415ca02-1d20-44e3-a262-35a1f2b735b3'), owner=OwnerMeta(userid='b37634a5befb4243a59d1ea76d47aa7a', username='tempest-VolumesSnapshotTestJSON-2040432487-project-member', projectid='98005db8eb3947d8b16d88f66930edd4', projectname='tempest-VolumesSnapshotTestJSON-2040432487'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533813.100645) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:16:53.102166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:16:53.102396 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:16:53.102602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:16:53.103676 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:16:53.104708 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:16:53.104869 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:16:53.105809 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:16:53.106116 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:16:53.106225 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:16:53.106319 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:16:53.106427 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:16:53.106553 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:16:53.106650 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:16:53.106827 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:16:53.106921 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:16:53.107023 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:16:53.107156 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:16:53.107264 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:16:53.115061 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:53.121523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:16:53.123303 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35'] 
Jun 27 04:16:53.123435 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:16:53.123641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:16:53.132421 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:53.132421 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Updating existing volume attachment record: 5446b2cc-1c60-4ec7-8725-a9c82680f755 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:16:53.132421 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-927472873',display_name='tempest-VolumesSnapshotTestJSON-instance-927472873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumessnapshottestjson-instance-927472873',id=53,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeSf9KTUbed6XmD8XMVWxYJ14JgV2oIlk+geO6z5t6+sVLBEn1ar3pulcI7V/n2xesy55en2S24Rk1VoeSEOl4lP3crR16RfKUoIjiXxy8rtRUy8apOv2cpyhJ+3eT9/A==',key_name='tempest-keypair-1942717209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98005db8eb3947d8b16d88f66930edd4',ramdisk_id='',reservation_id='r-0it14w0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040432487',owner_user_name='tempest-VolumesSnapshotTestJSON-2040432487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37634a5befb4243a59d1ea76d47aa7a',uuid=f415ca02-1d20-44e3-a262-35a1f2b735b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:16:53.132421 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converting VIF {"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:53.132421 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:53.132421 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'pci_devices' on Instance uuid f415ca02-1d20-44e3-a262-35a1f2b735b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:53.244562 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4814b02f-4132-490b-90f9-af1ade60e376 req-d784f337-80af-4b93-b9ff-610ba8a704d1 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-plugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:53.245024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4814b02f-4132-490b-90f9-af1ade60e376 req-d784f337-80af-4b93-b9ff-610ba8a704d1 service nova] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:53.245024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4814b02f-4132-490b-90f9-af1ade60e376 req-d784f337-80af-4b93-b9ff-610ba8a704d1 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:53.245173 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4814b02f-4132-490b-90f9-af1ade60e376 req-d784f337-80af-4b93-b9ff-610ba8a704d1 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4814b02f-4132-490b-90f9-af1ade60e376 req-d784f337-80af-4b93-b9ff-610ba8a704d1 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Processing event network-vif-plugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533813.2485309, a9f98c83-dbd6-4189-8292-4a14792117d2 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] VM Resumed (Lifecycle Event)
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Instance spawned successfully.
Jun 27 04:16:53.254005 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:16:53.335869 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:53.386602 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:53.547138 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:53.625324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.675s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:53.625884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.798s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:53.626042 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <uuid>f415ca02-1d20-44e3-a262-35a1f2b735b3</uuid>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <name>instance-00000035</name>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-927472873</nova:name>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:16:53</nova:creationTime>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:user uuid="b37634a5befb4243a59d1ea76d47aa7a">tempest-VolumesSnapshotTestJSON-2040432487-project-member</nova:user>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:project uuid="98005db8eb3947d8b16d88f66930edd4">tempest-VolumesSnapshotTestJSON-2040432487</nova:project>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         <nova:port uuid="6198baf1-42bb-44f8-8b5b-c6062458d252">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <entry name="serial">f415ca02-1d20-44e3-a262-35a1f2b735b3</entry>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <entry name="uuid">f415ca02-1d20-44e3-a262-35a1f2b735b3</entry>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.config"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:07:7c:13"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <target dev="tap6198baf1-42"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/console.log" append="off"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:16:53.633698 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Preparing to wait for external event network-vif-plugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-927472873',display_name='tempest-VolumesSnapshotTestJSON-instance-927472873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumessnapshottestjson-instance-927472873',id=53,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeSf9KTUbed6XmD8XMVWxYJ14JgV2oIlk+geO6z5t6+sVLBEn1ar3pulcI7V/n2xesy55en2S24Rk1VoeSEOl4lP3crR16RfKUoIjiXxy8rtRUy8apOv2cpyhJ+3eT9/A==',key_name='tempest-keypair-1942717209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98005db8eb3947d8b16d88f66930edd4',ramdisk_id='',reservation_id='r-0it14w0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040432487',owner_user_name='tempest-VolumesSnapshotTestJSON-2040432487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37634a5befb4243a59d1ea76d47aa7a',uuid=f415ca02-1d20-44e3-a262-35a1f2b735b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converting VIF {"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbded971-1e49-5c5c-9159-4470edc51613', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6198baf1-42, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6198baf1-42, col_values=(('qos', UUID('41449344-d7ca-4e2a-ae48-c183e07acac0')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6198baf1-42, col_values=(('external_ids', {'iface-id': '6198baf1-42bb-44f8-8b5b-c6062458d252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:7c:13', 'vm-uuid': 'f415ca02-1d20-44e3-a262-35a1f2b735b3'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Claim successful on node np0000003830
Jun 27 04:16:53.657485 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:53.666573 np0000003830 nova-compute[98984]: INFO os_vif [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42')
Jun 27 04:16:53.751401 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:53.752674 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:53.760816 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:16:53.766762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:53.766923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:53.767368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:53.767687 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:53.769338 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:53.770772 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:54.139585 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:16:54.139585 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:16:54.139585 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:54.139585 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:54.238703 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3f1fed1d8584fd5814abbbba5e5c858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dfd39ec000947d9bb452cc7eebfb0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:16:54.253405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8df12539-9192-4e8e-a5b2-1de534d9360c req-0d065595-7f8a-453f-99b1-0e75b2fd7658 service nova] Releasing lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:54.254055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquired lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:54.254414 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:16:54.263735 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:16:54.280510 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Took 13.76 seconds to spawn the instance on the hypervisor.
Jun 27 04:16:54.280510 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:54.313165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-06e8f620-a15c-4964-aafd-c250c7a9a9a2 req-c70e7746-d342-4568-9112-00569f79edc7 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:54.313902 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-06e8f620-a15c-4964-aafd-c250c7a9a9a2 req-c70e7746-d342-4568-9112-00569f79edc7 service nova] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:54.313902 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-06e8f620-a15c-4964-aafd-c250c7a9a9a2 req-c70e7746-d342-4568-9112-00569f79edc7 service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:54.314108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-06e8f620-a15c-4964-aafd-c250c7a9a9a2 req-c70e7746-d342-4568-9112-00569f79edc7 service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:54.314164 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-06e8f620-a15c-4964-aafd-c250c7a9a9a2 req-c70e7746-d342-4568-9112-00569f79edc7 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] No waiting events found dispatching network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:54.314335 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-06e8f620-a15c-4964-aafd-c250c7a9a9a2 req-c70e7746-d342-4568-9112-00569f79edc7 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received unexpected event network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 for instance with vm_state building and task_state block_device_mapping.
Jun 27 04:16:54.534726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:54.634546 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:16:54.722199 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Refreshing inventories for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 27 04:16:54.769484 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Updating ProviderTree inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 27 04:16:54.769771 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:16:54.792095 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Took 20.80 seconds to build instance.
Jun 27 04:16:54.801514 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Successfully created port: 7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:16:54.856126 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Refreshing aggregate associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, aggregates: None {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 27 04:16:54.872098 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:54.940554 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Refreshing trait associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, traits: HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_PPC64LE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NODE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 27 04:16:55.114221 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:55.141261 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:16:55.149735 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00039973800039661 future=<Future at 0x7ec538409010 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:55.149877 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:16:55.151526 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] Emitting event <LifecycleEvent: 1782533800.1492302, 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:55.151526 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] VM Stopped (Lifecycle Event)
Jun 27 04:16:55.187617 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:55.187761 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:55.187885 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No VIF found with MAC fa:16:3e:07:7c:13, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:16:55.188383 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Using config drive
Jun 27 04:16:55.304223 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7105e409-4201-430a-91b0-b01449652da4 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.324s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:55.336309 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Updating instance_info_cache with network_info: [{"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:55.341550 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-plugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] No waiting events found dispatching network-vif-plugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received unexpected event network-vif-plugged-fe71007a-262f-4792-9fda-3690719ffbd2 for instance with vm_state active and task_state None.
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-plugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Processing event network-vif-plugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-plugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] No waiting events found dispatching network-vif-plugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ec43c3a7-db73-4f0d-9404-0d15523543e4 req-07a7328a-883f-497f-9ce0-28f79f399d61 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received unexpected event network-vif-plugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 for instance with vm_state building and task_state spawning.
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533815.3538074, 01c43b2c-e0c8-4759-b0be-43fdf4356911 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:16:55.356140 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] VM Resumed (Lifecycle Event)
Jun 27 04:16:55.360688 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Instance spawned successfully.
Jun 27 04:16:55.361390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:16:55.384140 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:55.384360 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:55.387559 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:16:55.388711 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:16:55.389174 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Creating image(s)
Jun 27 04:16:55.389483 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:16:55.389756 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Ensure instance console log exists: /opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:16:55.389888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:55.390073 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:55.390187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:55.654645 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8d42981e-b4bb-47a0-ae2b-6b30bce00851 tempest-VolumesNegativeTest-1493373594 tempest-VolumesNegativeTest-1493373594-project-member] [instance: 4ca2bfcb-10b9-4947-a6b0-d0b3e2d1d18e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:55.680441 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Successfully updated port: 7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:16:55.694855 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:55.838338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Releasing lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:55.838614 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Instance network_info: |[{"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:16:55.839175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Start _get_guest_xml network_info=[{"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5446b2cc-1c60-4ec7-8725-a9c82680f755', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c0043076-a0d2-4446-bfb5-f22121ec128f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'serial': 'fca51200-145e-40d0-b861-0cdb504cd581'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:16:55.841095 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:16:55.841947 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1279583720', uuid='c0043076-a0d2-4446-bfb5-f22121ec128f'), owner=OwnerMeta(userid='db2d0b5572c9405aafaa0091643121a6', username='tempest-TestEncryptedCinderVolumes-1089025697-project-member', projectid='47d99f8411b741b2ae3a730bfefef27b', projectname='tempest-TestEncryptedCinderVolumes-1089025697'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533815.8417306) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:16:55.842789 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:16:55.843129 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:16:55.843830 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:16:55.843994 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:16:55.844664 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:16:55.844917 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:16:55.845094 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:16:55.845208 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:16:55.845352 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:16:55.845462 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:16:55.845618 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:16:55.845778 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:16:55.845904 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:16:55.846049 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:16:55.846178 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:16:55.846424 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:16:55.855055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:16:55.855369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:16:55.855536 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:55.855861 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:55.856090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:16:55.859024 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:55.860898 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:16:55.869415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:55.870202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:16:55.871047 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:55.871300 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:16:55.871829 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:16:55.872406 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:16:55.872895 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:55.874114 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:55.874114 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:55.874489 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:55.874820 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:55.875233 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:55.882758 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:16:55.882758 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:55.887753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:16:55.887753 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:55.889664 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581] added
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:55.896334 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:55.904054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:16:55.904054 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:16:55.904054 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581] added
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:16:55.906113 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:55.906256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:16:55.906397 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:16:55.906553 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:16:56.029777 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:56.029981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:56.050332 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Creating config drive at /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.config
Jun 27 04:16:56.055533 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1d3itjvd {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:56.145578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1d3itjvd" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:56.146884 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:16:56.148471 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:16:56.148990 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Creating image(s)
Jun 27 04:16:56.149616 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "/opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:56.175200 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "/opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:56.175200 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "/opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:56.175200 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:56.175200 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:56.175200 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:56.188175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:56.192109 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquired lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:56.192109 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:16:56.281172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.108s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:56.281867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:56.282429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:56.282909 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:56.285768 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:56.286206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:56.308431 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-changed-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:56.308850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Refreshing instance network info cache due to event network-changed-fe71007a-262f-4792-9fda-3690719ffbd2. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:56.309204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] Acquiring lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:56.309455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] Acquired lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:56.309584 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Refreshing network info cache for port fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:56.373759 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:16:56.380926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-changed-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:56.381724 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Took 12.35 seconds to spawn the instance on the hypervisor.
Jun 27 04:16:56.382043 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Refreshing instance network info cache due to event network-changed-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:56.382458 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:56.382653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] Acquiring lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:56.386505 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:56.387106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:56.411700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.785s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:56.412968 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:56.492775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk 1073741824" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:56.493412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:56.493851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:56.535091 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:16:56.600263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.106s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:56.601785 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:16:56.601785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:56.681105 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:56.710157 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:56.711666 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:56.717629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:56.718935 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Cannot resize image /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:16:56.718935 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:16:56.719585 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Ensure instance console log exists: /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:16:56.719585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:56.720236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:56.720236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:56.776786 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:56.805976 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:56.817299 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:56.897411 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:16:56.929075 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:16:56.929075 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:16:56.942789 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:16:56.948371 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:56.955925 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Took 17.95 seconds to build instance.
Jun 27 04:16:56.966446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:56.974387 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:16:56.974387 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:56.974387 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:16:56.974387 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:56.974387 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:16:56.974387 np0000003830 nova-compute[98984]: 
Jun 27 04:16:56.980965 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:56.980965 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:56.992642 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:16:56.992642 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:56.993715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:16:56.993715 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:56.993715 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:16:56.993715 np0000003830 nova-compute[98984]: 
Jun 27 04:16:57.031555 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a614c2dbe3dc443cab3c16539edca35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd1ebe1144a427082b2a28cd85def6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:16:57.088611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:57.089981 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:57.095016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:57.119465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:57.147572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:57.147572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:57.154712 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:16:57.154878 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Claim successful on node np0000003830
Jun 27 04:16:57.261546 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updating instance_info_cache with network_info: [{"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:57.315947 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:57.441812 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:16:57.451789 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dd5142b9-e861-4377-a4d1-298a41b26c80 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.459s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:57.490912 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updated VIF entry in instance network info cache for port fe71007a-262f-4792-9fda-3690719ffbd2. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:16:57.491287 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating instance_info_cache with network_info: [{"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:57.761662 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Successfully created port: f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:16:57.767426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Releasing lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:57.767426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Instance network_info: |[{"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:16:57.767426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] Acquired lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:57.767426 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Refreshing network info cache for port 7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:57.768151 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Start _get_guest_xml network_info=[{"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:16:57.784512 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:16:57.785991 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413', uuid='a223eb51-4b77-4bf2-bb91-6b8dd3c337a9'), owner=OwnerMeta(userid='b3f1fed1d8584fd5814abbbba5e5c858', username='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member', projectid='0dfd39ec000947d9bb452cc7eebfb0c8', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533817.7853777) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:16:57.788274 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:16:57.788753 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:16:57.790847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:16:57.791069 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:16:57.792385 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:16:57.792827 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:16:57.793096 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:16:57.793233 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:16:57.793393 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:16:57.793532 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:16:57.793670 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:16:57.794339 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:16:57.794339 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:16:57.795035 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:16:57.795035 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:16:57.795178 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:16:57.818438 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testservervolumeattachscenariooldversion-server-1491390',id=55,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsqs8FE0Hsszfl70vkEasg9Wih4c3DE3rH32GZkZIWMd1wVUVnifNWo+BwN/FcR2c3Cp+sbJZYTvAbj9ADRWkG7uPH+WigDb6fJWiKgiuW+dnpEfFSYupo89DtUEmNwrQ==',key_name='tempest-keypair-1383274682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfd39ec000947d9bb452cc7eebfb0c8',ramdisk_id='',reservation_id='r-t3dldixn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3f1fed1d8584fd5814abbbba5e5c858',uuid=a223eb51-4b77-4bf2-bb91-6b8dd3c337a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:16:57.818697 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Converting VIF {"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:57.820223 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:57.820690 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lazy-loading 'pci_devices' on Instance uuid a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:16:57.846567 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533817.8460522, f415ca02-1d20-44e3-a262-35a1f2b735b3 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:57.847048 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] VM Started (Lifecycle Event)
Jun 27 04:16:57.948022 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:16:57.994987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e989a173-ff84-4632-a088-05c3e96ef124 req-0ae73654-41a8-441f-a10c-5d7559e6a3a2 service nova] Releasing lock "refresh_cache-a9f98c83-dbd6-4189-8292-4a14792117d2" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:58.030010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.50.100,3260]
Jun 27 04:16:58.030010 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.50.100,3260] successful.
Jun 27 04:16:58.030010 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:58.032658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.40.100,3260]
Jun 27 04:16:58.032658 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.40.100,3260] successful.
Jun 27 04:16:58.032658 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:58.041883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:58.047458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:16:58.056824 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.056824 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.056824 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.186s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] HCTL ('7', '-', '-', 0) found on session 126 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:16:58.059356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:16:58.069464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.069464 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.069464 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:16:58.069650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.069650 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:16:58.069650 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:16:58.069905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.198s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:58.070053 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:16:58.070788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] HCTL ('8', '-', '-', 0) found on session 127 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:16:58.070788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:16:58.097921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 126 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:58.097921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:16:58.097921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 127 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:58.270464 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <uuid>a223eb51-4b77-4bf2-bb91-6b8dd3c337a9</uuid>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <name>instance-00000037</name>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413</nova:name>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:16:57</nova:creationTime>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:user uuid="b3f1fed1d8584fd5814abbbba5e5c858">tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member</nova:user>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:project uuid="0dfd39ec000947d9bb452cc7eebfb0c8">tempest-TestServerVolumeAttachScenarioOldVersion-1215799983</nova:project>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         <nova:port uuid="7e9d8f02-8b3e-4bb2-a2f7-10726682ba45">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <entry name="serial">a223eb51-4b77-4bf2-bb91-6b8dd3c337a9</entry>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <entry name="uuid">a223eb51-4b77-4bf2-bb91-6b8dd3c337a9</entry>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.config"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:3a:ff:4d"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <target dev="tap7e9d8f02-8b"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/console.log" append="off"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:16:58.323874 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:16:58.326009 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Preparing to wait for external event network-vif-plugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:16:58.326009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:58.326009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:58.326009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:58.326009 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testservervolumeattachscenariooldversion-server-1491390',id=55,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsqs8FE0Hsszfl70vkEasg9Wih4c3DE3rH32GZkZIWMd1wVUVnifNWo+BwN/FcR2c3Cp+sbJZYTvAbj9ADRWkG7uPH+WigDb6fJWiKgiuW+dnpEfFSYupo89DtUEmNwrQ==',key_name='tempest-keypair-1383274682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dfd39ec000947d9bb452cc7eebfb0c8',ramdisk_id='',reservation_id='r-t3dldixn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3f1fed1d8584fd5814abbbba5e5c858',uuid=a223eb51-4b77-4bf2-bb91-6b8dd3c337a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:16:58.326009 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Converting VIF {"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:16:58.326370 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:16:58.326706 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '027ca858-8901-5c84-ba0d-accb792eb763', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:58.335084 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:58.335398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:58.335618 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e9d8f02-8b, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:58.335978 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e9d8f02-8b, col_values=(('qos', UUID('2cc15a36-0339-4afe-90f3-1e8676517b32')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:58.336187 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e9d8f02-8b, col_values=(('external_ids', {'iface-id': '7e9d8f02-8b3e-4bb2-a2f7-10726682ba45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ff:4d', 'vm-uuid': 'a223eb51-4b77-4bf2-bb91-6b8dd3c337a9'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:16:58.337111 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:58.340822 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:16:58.348231 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:58.349350 np0000003830 nova-compute[98984]: INFO os_vif [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b')
Jun 27 04:16:58.350624 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:58.359770 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533818.3591278, f415ca02-1d20-44e3-a262-35a1f2b735b3 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:58.360039 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] VM Paused (Lifecycle Event)
Jun 27 04:16:58.404132 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:58.404291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:58.404453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:58.404623 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:58.404770 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] No event matching network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 in dict_keys([('network-vif-plugged', '7e9d8f02-8b3e-4bb2-a2f7-10726682ba45')]) {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
Jun 27 04:16:58.404928 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received unexpected event network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 for instance with vm_state building and task_state spawning.
Jun 27 04:16:58.405648 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-plugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:58.406166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Processing event network-vif-plugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-plugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] No waiting events found dispatching network-vif-plugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a048e4a3-53fb-4d0d-a5b0-4fc75d9d4c61 req-dd5da33e-f0f1-417f-bd54-4ecec96dfe65 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received unexpected event network-vif-plugged-6198baf1-42bb-44f8-8b5b-c6062458d252 for instance with vm_state building and task_state spawning.
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:16:58.414060 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:16:58.416245 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Instance spawned successfully.
Jun 27 04:16:58.416903 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:16:58.631468 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Successfully updated port: f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:16:58.684543 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:16:58.684849 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:16:58.716109 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:58.870178 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:58.873958 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533818.8736856, f415ca02-1d20-44e3-a262-35a1f2b735b3 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:16:58.874088 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] VM Resumed (Lifecycle Event)
Jun 27 04:16:58.896860 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updated VIF entry in instance network info cache for port 7e9d8f02-8b3e-4bb2-a2f7-10726682ba45. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:16:58.897188 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updating instance_info_cache with network_info: [{"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:16:58.924036 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:58.924206 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:58.924513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:58.925065 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:58.925337 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:58.925616 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:16:58.958404 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-changed-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:16:58.958404 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Refreshing instance network info cache due to event network-changed-2512a5e4-7b48-4f42-99b7-fad75e3f7494. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:16:58.961231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] Acquiring lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:58.962020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] Acquired lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:58.962165 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Refreshing network info cache for port 2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:16:58.964865 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:16:58.966778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:16:58.967325 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Creating image(s)
Jun 27 04:16:58.968128 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:58.968294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:58.968740 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:58.970917 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:58.979206 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:58.980847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:59.082078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:59.082765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:59.083482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:59.083973 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:59.087538 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:16:59.088124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:59.102513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 127 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:16:59.102936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:16:59.132881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:16:59.133080 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquired lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:16:59.133308 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:16:59.182165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:59.182608 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:59.201717 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:16:59.245195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk 1073741824" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:59.245595 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:59.245890 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:59.338242 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:59.338700 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:16:59.339007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:16:59.379206 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:59.386794 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:16:59.399631 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-febd459b-e23c-4a93-b9e3-f888cf6ba7ac req-692fa4a2-da73-4577-8ab1-dcdac3ca81ab service nova] Releasing lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:16:59.430591 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Took 8.34 seconds to spawn the instance on the hypervisor.
Jun 27 04:16:59.430808 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:16:59.437387 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:16:59.437983 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Cannot resize image /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:16:59.438364 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:16:59.438616 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Ensure instance console log exists: /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:16:59.438907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:16:59.439127 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:16:59.439259 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:59.466609 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:59.538873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:16:59.708740 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:16:59.712974 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.565s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:16:59.713278 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:16:59.838717 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:59.882038 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:59.882412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:16:59.882412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No VIF found with MAC fa:16:3e:3a:ff:4d, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:16:59.882729 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Using config drive
Jun 27 04:16:59.890203 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:16:59.892354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Found WWN 330000000b08b7288 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:16:59.892833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:16:59.894472 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '330000000b08b7288', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b08b7288'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:16:59.894643 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b08b7288', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b08b7288'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:16:59.917890 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:16:59.940226 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Took 13.78 seconds to build instance.
Jun 27 04:16:59.944215 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'c0043076-a0d2-4446-bfb5-f22121ec128f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'serial': 'fca51200-145e-40d0-b861-0cdb504cd581'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:16:59.944804 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:16:59.945190 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:59.945351 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:16:59.961451 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:16:59.961451 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:16:59.961451 np0000003830 nova-compute[98984]:     <volume>fca51200-145e-40d0-b861-0cdb504cd581</volume>
Jun 27 04:16:59.961451 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:16:59.961451 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:16:59.961451 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:17:00.027634 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updated VIF entry in instance network info cache for port 2512a5e4-7b48-4f42-99b7-fad75e3f7494. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:17:00.027950 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updating instance_info_cache with network_info: [{"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:00.082514 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updating instance_info_cache with network_info: [{"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:00.221248 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:17:00.221248 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:17:00.221248 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:00.221248 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:00.296787 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:17:00.395684 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:00.441705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-eb74492d-d830-4fd5-acc1-e374f10c884b tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.293s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:00.473564 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-changed-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:00.473725 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Refreshing instance network info cache due to event network-changed-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:00.473917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] Acquiring lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:00.488903 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1279583720',display_name='tempest-TestEncryptedCinderVolumes-server-1279583720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1279583720',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGuYAtkCdSCeUm1e9x/7IhI6dv1gxiRaf6f4/jUexIJOkLhPSANlh1EzXGMPP3YjTRnxQcb46OkyH9pc9NE32yzfyqOtfMAGLmxJ1JA/q2963Zqpc/xOBe5tzTDFM8Dg==',key_name='tempest-TestEncryptedCinderVolumes-131351821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-cneekiwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:53Z,user_data=None,user_id='db2d0b5572c9405aafaa0091643121a6',uuid=c0043076-a0d2-4446-bfb5-f22121ec128f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:17:00.489147 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:00.489904 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:00.492156 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'pci_devices' on Instance uuid c0043076-a0d2-4446-bfb5-f22121ec128f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:00.530358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5f790b93-9944-4ffb-b936-10d1e40ec132 req-b7981d6c-4dca-4965-bf1d-e3e5eefcb227 service nova] Releasing lock "refresh_cache-01c43b2c-e0c8-4759-b0be-43fdf4356911" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:00.566791 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Creating config drive at /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.config
Jun 27 04:17:00.573675 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxkx4iah1 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:00.591509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Releasing lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:00.592688 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Instance network_info: |[{"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:17:00.593633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] Acquired lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:00.596162 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Start _get_guest_xml network_info=[{"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:17:00.597391 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Refreshing network info cache for port f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:00.608437 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:17:00.610454 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1081306008', uuid='ac8cc9d9-308f-4b81-8397-f5692c1e8495'), owner=OwnerMeta(userid='a614c2dbe3dc443cab3c16539edca35c', username='tempest-AttachVolumeNegativeTest-981489683-project-member', projectid='cbd1ebe1144a427082b2a28cd85def6b', projectname='tempest-AttachVolumeNegativeTest-981489683'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533820.609948) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:17:00.613156 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:17:00.614244 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:17:00.615322 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:17:00.615536 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:17:00.616832 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:17:00.618225 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:17:00.618225 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:17:00.618225 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:17:00.618630 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:17:00.619147 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:17:00.619147 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:17:00.619371 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:17:00.619654 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:17:00.619856 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:17:00.620057 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:17:00.620264 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:17:00.634728 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1081306008',display_name='tempest-AttachVolumeNegativeTest-server-1081306008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-1081306008',id=56,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLogNYokEBmDyExeAaD1VKBJz6xySO8I0CB+33yAnc1ovjMJ/YwXcqaiShjYpwKMC6C7G8ce7AZqH0meqgRbrd308os46LwXgFT56c7R7qF9NpFbBjKDDKxBO0yqezdNSQ==',key_name='tempest-keypair-688762495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-j27s40eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=ac8cc9d9-308f-4b81-8397-f5692c1e8495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:17:00.635044 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:00.635611 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:00.636214 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'pci_devices' on Instance uuid ac8cc9d9-308f-4b81-8397-f5692c1e8495 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:00.638324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxkx4iah1" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:00.722595 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:17:00.825747 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Successfully created port: e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <uuid>c0043076-a0d2-4446-bfb5-f22121ec128f</uuid>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <name>instance-00000036</name>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1279583720</nova:name>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:16:55</nova:creationTime>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:user uuid="db2d0b5572c9405aafaa0091643121a6">tempest-TestEncryptedCinderVolumes-1089025697-project-member</nova:user>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:project uuid="47d99f8411b741b2ae3a730bfefef27b">tempest-TestEncryptedCinderVolumes-1089025697</nova:project>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <nova:port uuid="56c27299-ff0b-4543-b205-dda1b4dc7351">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <entry name="serial">c0043076-a0d2-4446-bfb5-f22121ec128f</entry>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <entry name="uuid">c0043076-a0d2-4446-bfb5-f22121ec128f</entry>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f/disk.config"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <alias name="ua-fca51200-145e-40d0-b861-0cdb504cd581"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <serial>fca51200-145e-40d0-b861-0cdb504cd581</serial>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <encryption format="luks">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:         <secret type="passphrase" uuid="8e10910f-e981-4177-8a8b-035f580188fd"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       </encryption>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:13:2a:e1"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <target dev="tap56c27299-ff"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f/console.log" append="off"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:17:01.004110 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:17:01.007622 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Preparing to wait for external event network-vif-plugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:17:01.007622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:01.007622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:01.007622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:01.007622 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1279583720',display_name='tempest-TestEncryptedCinderVolumes-server-1279583720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1279583720',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGuYAtkCdSCeUm1e9x/7IhI6dv1gxiRaf6f4/jUexIJOkLhPSANlh1EzXGMPP3YjTRnxQcb46OkyH9pc9NE32yzfyqOtfMAGLmxJ1JA/q2963Zqpc/xOBe5tzTDFM8Dg==',key_name='tempest-TestEncryptedCinderVolumes-131351821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-cneekiwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:53Z,user_data=None,user_id='db2d0b5572c9405aafaa0091643121a6',uuid=c0043076-a0d2-4446-bfb5-f22121ec128f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:17:01.007622 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:01.009763 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:01.010177 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:17:01.011731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.011731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.011731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:17:01.014382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.014382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f041d2da-6e45-5bbf-8a2d-13540b994673', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.014944 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.015863 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:01.021907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.027091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.027091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56c27299-ff, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.027091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56c27299-ff, col_values=(('qos', UUID('cfa71e22-e700-4bd1-9d96-67be0ecd33cf')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.027091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56c27299-ff, col_values=(('external_ids', {'iface-id': '56c27299-ff0b-4543-b205-dda1b4dc7351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:2a:e1', 'vm-uuid': 'c0043076-a0d2-4446-bfb5-f22121ec128f'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.029060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.029060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:01.046797 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.047139 np0000003830 nova-compute[98984]: INFO os_vif [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff')
Jun 27 04:17:01.102483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.107143 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:01.142215 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <uuid>ac8cc9d9-308f-4b81-8397-f5692c1e8495</uuid>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <name>instance-00000038</name>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1081306008</nova:name>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:17:00</nova:creationTime>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:user uuid="a614c2dbe3dc443cab3c16539edca35c">tempest-AttachVolumeNegativeTest-981489683-project-member</nova:user>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:project uuid="cbd1ebe1144a427082b2a28cd85def6b">tempest-AttachVolumeNegativeTest-981489683</nova:project>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         <nova:port uuid="f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <entry name="serial">ac8cc9d9-308f-4b81-8397-f5692c1e8495</entry>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <entry name="uuid">ac8cc9d9-308f-4b81-8397-f5692c1e8495</entry>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.config"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:ab:21:dc"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <target dev="tapf7bf4c7a-cc"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/console.log" append="off"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Preparing to wait for external event network-vif-plugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1081306008',display_name='tempest-AttachVolumeNegativeTest-server-1081306008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-1081306008',id=56,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLogNYokEBmDyExeAaD1VKBJz6xySO8I0CB+33yAnc1ovjMJ/YwXcqaiShjYpwKMC6C7G8ce7AZqH0meqgRbrd308os46LwXgFT56c7R7qF9NpFbBjKDDKxBO0yqezdNSQ==',key_name='tempest-keypair-688762495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-j27s40eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=ac8cc9d9-308f-4b81-8397-f5692c1e8495,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:01.146039 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:17:01.152060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.152060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.152060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:17:01.152060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.152060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b81ed6e-3c02-5f01-b113-4f1c5cad3847', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.152801 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.153326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:01.164162 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.167644 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.169247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7bf4c7a-cc, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.169247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7bf4c7a-cc, col_values=(('qos', UUID('d826d77d-b317-4db5-b88a-a4b0ac92a8e8')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.169247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7bf4c7a-cc, col_values=(('external_ids', {'iface-id': 'f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:21:dc', 'vm-uuid': 'ac8cc9d9-308f-4b81-8397-f5692c1e8495'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:01.171608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.174031 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:01.187633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.188202 np0000003830 nova-compute[98984]: INFO os_vif [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc')
Jun 27 04:17:01.236751 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:17:01.262902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.546980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.554300 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.557330 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.567221 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Successfully updated port: e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:17:01.597946 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.612082 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.647121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:01.651561 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-changed-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:01.651561 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Refreshing instance network info cache due to event network-changed-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:01.651561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] Acquiring lock "refresh_cache-88fcaef5-39d9-4994-b3da-3b9ae5742a3e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:01.651561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] Acquired lock "refresh_cache-88fcaef5-39d9-4994-b3da-3b9ae5742a3e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:01.654412 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Refreshing network info cache for port e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:01.689761 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:01.752649 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Booting with volume 71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 at /dev/vda
Jun 27 04:17:01.807200 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:01.818388 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:01.840522 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updated VIF entry in instance network info cache for port f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:17:01.841132 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updating instance_info_cache with network_info: [{"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:01.843547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:01.888155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:01.888513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:01.898331 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:01.900065 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673'] 
Jun 27 04:17:01.900065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:01.900270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:01.900643 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:01.900976 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Updating existing volume attachment record: f5e0d940-891a-4bb7-bd50-704ebcb99860 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:02.063765 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-changed-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:02.067720 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Refreshing instance network info cache due to event network-changed-6198baf1-42bb-44f8-8b5b-c6062458d252. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:02.068026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] Acquiring lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:02.068164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] Acquired lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:02.068344 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Refreshing network info cache for port 6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:02.072694 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-88fcaef5-39d9-4994-b3da-3b9ae5742a3e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:02.156549 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:02.187177 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533822.1866467, a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:02.188555 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] VM Started (Lifecycle Event)
Jun 27 04:17:02.225938 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:17:02.357087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8531f8f0-d0fe-45bb-bd54-571be71a23d9 req-e59f4120-3486-4fe8-b85a-dd578ed610b5 service nova] Releasing lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:02.370814 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:02.530147 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-plugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:02.530678 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:02.530898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:02.531075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:02.531253 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Processing event network-vif-plugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:17:02.531483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-plugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:02.531689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:02.532336 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:17:02.532875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:02.533245 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:02.533245 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] No waiting events found dispatching network-vif-plugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:02.533380 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-44acef89-6f7d-4982-8c36-d7686a2c3164 req-d9461dc7-4ea1-4b04-a55f-45e70fb3b128 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received unexpected event network-vif-plugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 for instance with vm_state building and task_state spawning.
Jun 27 04:17:02.535240 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:17:02.538135 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Instance spawned successfully.
Jun 27 04:17:02.538562 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:17:02.570691 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:02.586820 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:02.586988 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:02.587133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No VIF found with MAC fa:16:3e:13:2a:e1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:02.587678 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Using config drive
Jun 27 04:17:02.690868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:02.693043 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:02.760575 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:02.760671 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:02.760771 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:ab:21:dc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:02.761176 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Using config drive
Jun 27 04:17:02.874688 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f412c15d-5646-48c5-9ce0-ac2601e067b1 req-51b05902-7c8e-4dfd-a85e-5f44ac280002 service nova] Releasing lock "refresh_cache-88fcaef5-39d9-4994-b3da-3b9ae5742a3e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:02.875610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-88fcaef5-39d9-4994-b3da-3b9ae5742a3e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:02.875963 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:17:02.935125 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:03.048381 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:03.048565 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:03.049055 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:03.049411 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:03.049745 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:03.050093 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:03.096561 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:03.132572 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Updated VIF entry in instance network info cache for port 6198baf1-42bb-44f8-8b5b-c6062458d252. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:17:03.132931 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Updating instance_info_cache with network_info: [{"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:03.195220 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:17:03.195600 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533823.195329, a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:03.195791 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] VM Paused (Lifecycle Event)
Jun 27 04:17:03.267405 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:03.273265 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Creating config drive at /opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f/disk.config
Jun 27 04:17:03.281039 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpedyx1xd1 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:03.333605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpedyx1xd1" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:03.457575 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Creating config drive at /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.config
Jun 27 04:17:03.463334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqn0gwhn4 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:03.488518 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:17:03.525249 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqn0gwhn4" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:03.558800 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Took 7.41 seconds to spawn the instance on the hypervisor.
Jun 27 04:17:03.559214 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:03.635659 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ed8bdda5-fc3e-4fcc-a68f-230ea0ec17f8 req-8bc9797a-81a6-4a5b-a85a-d10a951f31a1 service nova] Releasing lock "refresh_cache-f415ca02-1d20-44e3-a262-35a1f2b735b3" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:03.699398 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:03.702241 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:03.705751 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533823.7053397, a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:03.705933 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] VM Resumed (Lifecycle Event)
Jun 27 04:17:03.879160 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Updating instance_info_cache with network_info: [{"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:03.885064 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:03.923623 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:03.925397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.070870 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:17:04.071925 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:17:04.072137 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Creating image(s)
Jun 27 04:17:04.072506 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:17:04.072662 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:17:04.072910 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:04.073106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:04.073209 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:04.084200 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Took 15.11 seconds to build instance.
Jun 27 04:17:04.129752 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.141365 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-595e9552-096a-43aa-acc6-a3d93d33f25a req-539685b2-7d93-44cb-a723-202685568725 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-plugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:04.141837 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-595e9552-096a-43aa-acc6-a3d93d33f25a req-539685b2-7d93-44cb-a723-202685568725 service nova] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:04.142105 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-595e9552-096a-43aa-acc6-a3d93d33f25a req-539685b2-7d93-44cb-a723-202685568725 service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:04.142105 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-595e9552-096a-43aa-acc6-a3d93d33f25a req-539685b2-7d93-44cb-a723-202685568725 service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:04.142192 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-595e9552-096a-43aa-acc6-a3d93d33f25a req-539685b2-7d93-44cb-a723-202685568725 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Processing event network-vif-plugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:17:04.208699 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:04.212132 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:04.281991 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.289686 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.292237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.318990 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.376924 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.381825 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-88fcaef5-39d9-4994-b3da-3b9ae5742a3e" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:04.382050 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Instance network_info: |[{"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:17:04.396661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Start _get_guest_xml network_info=[{"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'f5e0d940-891a-4bb7-bd50-704ebcb99860', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '88fcaef5-39d9-4994-b3da-3b9ae5742a3e', 'attached_at': '', 'detached_at': '', 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'serial': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:17:04.396661 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:17:04.396661 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-742798489', uuid='88fcaef5-39d9-4994-b3da-3b9ae5742a3e'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533824.3919718) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:17:04.396661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:17:04.396661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:17:04.399715 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:17:04.403760 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:17:04.417423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.426337 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:04.426337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:04.426337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:04.426337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:04.426873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:04.442004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:04.442778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:04.443523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:04.443822 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:04.444611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:04.444960 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:04.462744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:04.462744 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:04.474039 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:04.474039 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174] added
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:04.483909 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:04.484266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:04.484402 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0405(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:04.484508 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174] added
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:04.494048 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:04.494388 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:04.494466 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0496(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:04.494714 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:04.517264 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.539012 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.586174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-66280654-4af7-47b4-9828-82c71f796cda tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.615s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:04.700365 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c3e42478-b2e1-4232-b3cc-4f3f069ddcde req-9f209ed9-a09e-48cc-a743-fc2d315210c4 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-plugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:04.700911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3e42478-b2e1-4232-b3cc-4f3f069ddcde req-9f209ed9-a09e-48cc-a743-fc2d315210c4 service nova] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:04.701509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3e42478-b2e1-4232-b3cc-4f3f069ddcde req-9f209ed9-a09e-48cc-a743-fc2d315210c4 service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:04.701509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3e42478-b2e1-4232-b3cc-4f3f069ddcde req-9f209ed9-a09e-48cc-a743-fc2d315210c4 service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:04.701509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c3e42478-b2e1-4232-b3cc-4f3f069ddcde req-9f209ed9-a09e-48cc-a743-fc2d315210c4 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Processing event network-vif-plugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:17:04.829966 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.842191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:04.862273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:05.377052 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:17:05.377560 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533825.37703, ac8cc9d9-308f-4b81-8397-f5692c1e8495 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:05.377738 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] VM Started (Lifecycle Event)
Jun 27 04:17:05.381716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:17:05.389046 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Instance spawned successfully.
Jun 27 04:17:05.389682 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:17:05.484898 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:05.495236 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:05.501139 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:05.512360 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.517886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.525212 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.531161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.531161 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.531161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:05.531386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.531386 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.531386 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:05.541530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.541530 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.541530 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:05.541530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.541530 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.541530 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:05.582188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.40.100,3260]
Jun 27 04:17:05.582188 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:05.582188 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.588787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.50.100,3260]
Jun 27 04:17:05.588787 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:05.588787 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.596488 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.607693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:05.623801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:05.624294 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:05.625191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('9', '-', '-', 0) found on session 128 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:05.625191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:05.632125 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.632125 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.632125 np0000003830 nova-compute[98984]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.632125 np0000003830 nova-compute[98984]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.632125 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:05.632297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.632297 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:05.632297 np0000003830 nova-compute[98984]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.632297 np0000003830 nova-compute[98984]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:05.632297 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:05.632485 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:05.632609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:05.633272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('10', '-', '-', 0) found on session 129 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:05.633272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:05.644870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 128 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:05.644870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:05.655971 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 129 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:05.656278 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:05.881186 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:05.886986 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:05.897349 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:05.897349 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:05.897485 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:05.897947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:05.898119 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:05.898445 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:05.914537 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-changed-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:05.914684 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Refreshing instance network info cache due to event network-changed-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:05.914874 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] Acquiring lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:05.914994 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] Acquired lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:05.915128 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Refreshing network info cache for port 7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:06.120286 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:17:06.125409 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:17:06.127218 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Instance spawned successfully.
Jun 27 04:17:06.127539 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:17:06.174842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:06.223623 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3f214b70-533d-484b-83c7-0589f4bfc170 req-05e9d38b-4b8d-4240-a99f-b3dd5ff9231b service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-plugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:06.224428 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3f214b70-533d-484b-83c7-0589f4bfc170 req-05e9d38b-4b8d-4240-a99f-b3dd5ff9231b service nova] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:06.224581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3f214b70-533d-484b-83c7-0589f4bfc170 req-05e9d38b-4b8d-4240-a99f-b3dd5ff9231b service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:06.224656 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3f214b70-533d-484b-83c7-0589f4bfc170 req-05e9d38b-4b8d-4240-a99f-b3dd5ff9231b service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:06.224832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3f214b70-533d-484b-83c7-0589f4bfc170 req-05e9d38b-4b8d-4240-a99f-b3dd5ff9231b service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] No waiting events found dispatching network-vif-plugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:06.226357 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-3f214b70-533d-484b-83c7-0589f4bfc170 req-05e9d38b-4b8d-4240-a99f-b3dd5ff9231b service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received unexpected event network-vif-plugged-56c27299-ff0b-4543-b205-dda1b4dc7351 for instance with vm_state building and task_state spawning.
Jun 27 04:17:06.391255 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:17:06.391580 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533826.391274, ac8cc9d9-308f-4b81-8397-f5692c1e8495 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:06.391580 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] VM Paused (Lifecycle Event)
Jun 27 04:17:06.406151 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Took 7.44 seconds to spawn the instance on the hypervisor.
Jun 27 04:17:06.406483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:06.421479 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:06.445748 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:17:06.635753 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:06.635959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:06.636299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:06.636603 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:06.637042 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:06.637235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:06.771401 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c2169451-a557-4075-89e7-3754105c1e87 req-522ab1e0-3507-4de1-af49-05061e07e44b service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-plugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:06.771702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c2169451-a557-4075-89e7-3754105c1e87 req-522ab1e0-3507-4de1-af49-05061e07e44b service nova] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:06.771824 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c2169451-a557-4075-89e7-3754105c1e87 req-522ab1e0-3507-4de1-af49-05061e07e44b service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:06.771938 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c2169451-a557-4075-89e7-3754105c1e87 req-522ab1e0-3507-4de1-af49-05061e07e44b service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:06.772109 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c2169451-a557-4075-89e7-3754105c1e87 req-522ab1e0-3507-4de1-af49-05061e07e44b service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] No waiting events found dispatching network-vif-plugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:06.772239 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c2169451-a557-4075-89e7-3754105c1e87 req-522ab1e0-3507-4de1-af49-05061e07e44b service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received unexpected event network-vif-plugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 for instance with vm_state active and task_state None.
Jun 27 04:17:06.806974 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:06.894145 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:06.896989 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533826.8966222, ac8cc9d9-308f-4b81-8397-f5692c1e8495 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:06.897171 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] VM Resumed (Lifecycle Event)
Jun 27 04:17:06.919865 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Took 17.14 seconds to build instance.
Jun 27 04:17:06.948219 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updated VIF entry in instance network info cache for port 7e9d8f02-8b3e-4bb2-a2f7-10726682ba45. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:17:06.950549 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updating instance_info_cache with network_info: [{"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:07.143151 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Took 11.76 seconds to spawn the instance on the hypervisor.
Jun 27 04:17:07.143332 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:07.399935 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:07.403186 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:07.421687 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.654s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:07.452329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fbb3827d-5983-4aa2-8313-fd66446548d9 req-c132626d-19b0-4959-b514-4cce45554ea7 service nova] Releasing lock "refresh_cache-a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:07.465610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 3300000007cdd7905 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:07.465766 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:07.466910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000007cdd7905', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000007cdd7905'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:07.467047 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007cdd7905', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000007cdd7905'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:07.511640 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '88fcaef5-39d9-4994-b3da-3b9ae5742a3e', 'attached_at': '', 'detached_at': '', 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'serial': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:17:07.512673 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:17:07.512990 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:07.513230 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:07.537584 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.luks [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 27 04:17:07.537584 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:17:07.537584 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:07.537584 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:07.537584 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7ec538460c80>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '88fcaef5-39d9-4994-b3da-3b9ae5742a3e', 'attached_at': '', 'detached_at': '', 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'serial': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:17:07.537584 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98984) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 27 04:17:07.657031 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Took 19.69 seconds to build instance.
Jun 27 04:17:07.905884 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533827.9053526, c0043076-a0d2-4446-bfb5-f22121ec128f => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:07.906043 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] VM Started (Lifecycle Event)
Jun 27 04:17:08.158775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.206s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:08.290861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-changed-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:08.292856 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Refreshing instance network info cache due to event network-changed-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:08.293060 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] Acquiring lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:08.293180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] Acquired lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:08.293306 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Refreshing network info cache for port f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:08.411319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:08.413434 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:08.795974 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:08.915808 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533828.9154406, c0043076-a0d2-4446-bfb5-f22121ec128f => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:08.916033 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] VM Paused (Lifecycle Event)
Jun 27 04:17:09.210054 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:09.328692 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-changed-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:09.328894 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Refreshing instance network info cache due to event network-changed-56c27299-ff0b-4543-b205-dda1b4dc7351. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:09.329107 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] Acquiring lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:09.329227 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] Acquired lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:09.329389 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Refreshing network info cache for port 56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:09.408130 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updated VIF entry in instance network info cache for port f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:17:09.408372 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updating instance_info_cache with network_info: [{"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:09.419511 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:09.422725 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533829.4222844, c0043076-a0d2-4446-bfb5-f22121ec128f => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:09.422900 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] VM Resumed (Lifecycle Event)
Jun 27 04:17:09.540794 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:09.832160 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:09.911095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f54d3577-80fc-4652-8ccd-12f3c45c77e5 req-3983ba40-8fe1-4e05-b958-69bb2fa4bbef service nova] Releasing lock "refresh_cache-ac8cc9d9-308f-4b81-8397-f5692c1e8495" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:09.928538 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:09.930738 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:10.194274 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:10.360394 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Updated VIF entry in instance network info cache for port 56c27299-ff0b-4543-b205-dda1b4dc7351. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:17:10.360909 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Updating instance_info_cache with network_info: [{"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:10.863731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-85e18fe8-9c05-4870-8ae6-04124a72e4c0 req-dab1ea97-e918-486f-9f70-a88b250884fc service nova] Releasing lock "refresh_cache-c0043076-a0d2-4446-bfb5-f22121ec128f" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:11.176113 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:11.701227 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:17:11.701227 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:17:11.701227 np0000003830 nova-compute[98984]:     <volume>71ee8fe3-27fd-4c20-bf1a-5a07f1a34174</volume>
Jun 27 04:17:11.701227 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:17:11.701227 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:17:11.701227 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:17:12.211983 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-742798489',display_name='tempest-TestVolumeBootPattern-server-742798489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-742798489',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-jh70tiut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:17:01Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=88fcaef5-39d9-4994-b3da-3b9ae5742a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:17:12.211983 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:12.211983 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:12.214484 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 88fcaef5-39d9-4994-b3da-3b9ae5742a3e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <uuid>88fcaef5-39d9-4994-b3da-3b9ae5742a3e</uuid>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <name>instance-00000039</name>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-742798489</nova:name>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:17:04</nova:creationTime>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:properties/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <nova:port uuid="e48032f3-022c-402d-8f4d-fe5e5ee9fbbc">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <entry name="serial">88fcaef5-39d9-4994-b3da-3b9ae5742a3e</entry>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <entry name="uuid">88fcaef5-39d9-4994-b3da-3b9ae5742a3e</entry>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e/disk.config"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <alias name="ua-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <serial>71ee8fe3-27fd-4c20-bf1a-5a07f1a34174</serial>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <encryption format="luks">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:         <secret type="passphrase" uuid="a2d9abf3-47d9-4626-89cf-607a38fa4739"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       </encryption>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:21:ad:3b"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <target dev="tape48032f3-02"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e/console.log" append="off"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Preparing to wait for external event network-vif-plugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-742798489',display_name='tempest-TestVolumeBootPattern-server-742798489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-742798489',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-jh70tiut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:17:01Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=88fcaef5-39d9-4994-b3da-3b9ae5742a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:17:12.718765 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:12.723762 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:12.723762 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:17:12.723961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.724166 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:12.724460 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:17:12.725462 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.725702 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33d84844-d61b-55d1-bc72-54791b344e6c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:12.726633 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.727267 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:12.727663 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.730038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.730260 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape48032f3-02, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:12.730660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape48032f3-02, col_values=(('qos', UUID('6b5966e5-f21c-482f-8435-db202b8de32a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:12.730864 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape48032f3-02, col_values=(('external_ids', {'iface-id': 'e48032f3-022c-402d-8f4d-fe5e5ee9fbbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:ad:3b', 'vm-uuid': '88fcaef5-39d9-4994-b3da-3b9ae5742a3e'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:12.731813 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.733401 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:12.737863 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:12.739999 np0000003830 nova-compute[98984]: INFO os_vif [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02')
Jun 27 04:17:14.258822 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:14.259558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:14.259558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:21:ad:3b, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:14.259678 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Using config drive
Jun 27 04:17:14.544337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:14.765219 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:14.879347 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Creating config drive at /opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e/disk.config
Jun 27 04:17:14.882773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpok_hdyf2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:14.952912 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpok_hdyf2" returned: 0 in 0.070s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:15.421453 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.456899 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.463370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.571022 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.658879 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5d150803-53fe-40b2-9511-108c48291056 req-3444e664-9f78-4881-8f8f-e5c5b4734bb8 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-plugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:15.659638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5d150803-53fe-40b2-9511-108c48291056 req-3444e664-9f78-4881-8f8f-e5c5b4734bb8 service nova] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:15.659638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5d150803-53fe-40b2-9511-108c48291056 req-3444e664-9f78-4881-8f8f-e5c5b4734bb8 service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:15.659638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5d150803-53fe-40b2-9511-108c48291056 req-3444e664-9f78-4881-8f8f-e5c5b4734bb8 service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:15.659885 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5d150803-53fe-40b2-9511-108c48291056 req-3444e664-9f78-4881-8f8f-e5c5b4734bb8 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Processing event network-vif-plugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:17:15.817398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.820067 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.821339 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.843638 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:15.845756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:17.033748 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:17:17.034164 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533837.0338757, 88fcaef5-39d9-4994-b3da-3b9ae5742a3e => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:17.034313 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] VM Started (Lifecycle Event)
Jun 27 04:17:17.036470 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:17:17.039602 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Instance spawned successfully.
Jun 27 04:17:17.040039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:17:17.537951 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:17.539878 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:17.548516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:17.548779 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:17.549174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:17.549512 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:17.549887 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:17.550214 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:17:17.729552 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a7b4fd0-0bf2-43ef-a158-e346dbcaebd4 req-34bc7945-3bf8-40e3-aec1-7ec6a8de42ed service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-plugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:17.729719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a7b4fd0-0bf2-43ef-a158-e346dbcaebd4 req-34bc7945-3bf8-40e3-aec1-7ec6a8de42ed service nova] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:17.729952 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a7b4fd0-0bf2-43ef-a158-e346dbcaebd4 req-34bc7945-3bf8-40e3-aec1-7ec6a8de42ed service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:17.730013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a7b4fd0-0bf2-43ef-a158-e346dbcaebd4 req-34bc7945-3bf8-40e3-aec1-7ec6a8de42ed service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:17.730115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a7b4fd0-0bf2-43ef-a158-e346dbcaebd4 req-34bc7945-3bf8-40e3-aec1-7ec6a8de42ed service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] No waiting events found dispatching network-vif-plugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:17.730206 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8a7b4fd0-0bf2-43ef-a158-e346dbcaebd4 req-34bc7945-3bf8-40e3-aec1-7ec6a8de42ed service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received unexpected event network-vif-plugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc for instance with vm_state building and task_state spawning.
Jun 27 04:17:17.733040 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:18.044711 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:17:18.045145 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533838.0447886, 88fcaef5-39d9-4994-b3da-3b9ae5742a3e => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:18.045145 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] VM Paused (Lifecycle Event)
Jun 27 04:17:18.058265 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Took 13.99 seconds to spawn the instance on the hypervisor.
Jun 27 04:17:18.058965 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:18.547310 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:18.549295 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533838.5490472, 88fcaef5-39d9-4994-b3da-3b9ae5742a3e => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:18.549523 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] VM Resumed (Lifecycle Event)
Jun 27 04:17:18.574330 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Took 21.52 seconds to build instance.
Jun 27 04:17:19.052619 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:19.054439 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:17:19.075886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.046s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:19.547199 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:20.327983 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:20.328642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:20.328642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:20.328642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:20.328642 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:20.330984 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Terminating instance
Jun 27 04:17:20.834995 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:17:20.861322 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:20.865013 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:20.888217 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:20.890972 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:20.914106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.044982 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f90b252c-1a17-4c2b-8692-fca466d1abbf req-a8856941-59c8-42aa-adcc-4663bcc41fc0 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-unplugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:21.045161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f90b252c-1a17-4c2b-8692-fca466d1abbf req-a8856941-59c8-42aa-adcc-4663bcc41fc0 service nova] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:21.045358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f90b252c-1a17-4c2b-8692-fca466d1abbf req-a8856941-59c8-42aa-adcc-4663bcc41fc0 service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:21.045528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f90b252c-1a17-4c2b-8692-fca466d1abbf req-a8856941-59c8-42aa-adcc-4663bcc41fc0 service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:21.045701 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f90b252c-1a17-4c2b-8692-fca466d1abbf req-a8856941-59c8-42aa-adcc-4663bcc41fc0 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] No waiting events found dispatching network-vif-unplugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:21.045797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f90b252c-1a17-4c2b-8692-fca466d1abbf req-a8856941-59c8-42aa-adcc-4663bcc41fc0 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-unplugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:17:21.136395 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.148197 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.163876 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99888207899994 future=<Future at 0x7ec5386166c0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:21.166455 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.995967293999911 future=<Future at 0x7ec5386166c0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:21.166611 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.995796720999806 future=<Future at 0x7ec5386166c0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:21.169237 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Instance destroyed successfully.
Jun 27 04:17:21.169822 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 88fcaef5-39d9-4994-b3da-3b9ae5742a3e {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:21.674304 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-742798489',display_name='tempest-TestVolumeBootPattern-server-742798489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-742798489',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:17:18Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-jh70tiut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:17:18Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=88fcaef5-39d9-4994-b3da-3b9ae5742a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:17:21.675002 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "address": "fa:16:3e:21:ad:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape48032f3-02", "ovs_interfaceid": "e48032f3-022c-402d-8f4d-fe5e5ee9fbbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:21.675248 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:21.675637 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:17:21.676954 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.677188 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape48032f3-02, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:21.678372 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.679481 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:21.680463 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.681301 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.681517 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b5966e5-f21c-482f-8435-db202b8de32a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:21.681999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.682619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:21.683361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:21.685188 np0000003830 nova-compute[98984]: INFO os_vif [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ad:3b,bridge_name='br-int',has_traffic_filtering=True,id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape48032f3-02')
Jun 27 04:17:21.688403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:17:21.688761 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:21.689019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:21.689479 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:21.690168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:17:21.690359 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:17:21.714639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:21.714639 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:21.714639 np0000003830 nova-compute[98984]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:21.714639 np0000003830 nova-compute[98984]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:21.714639 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]: tcp: [128] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]: tcp: [129] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174 (non-flash)
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', '129')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:17:21.715089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', '128')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:21.715896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174', '129')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:21.716555 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538296200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:17:21.716751 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:17:21.716982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 3300000007cdd7905 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:17:21.761382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:21.824109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:21.869877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:17:21.870085 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:17:21.871193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:17:21.882740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:17:21.883004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:17:21.894335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:21.924783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.40.100,3260]
Jun 27 04:17:21.924783 np0000003830 nova-compute[98984]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:21.924783 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:21.939580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:21.952856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:21.991637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.50.100,3260]
Jun 27 04:17:21.991637 np0000003830 nova-compute[98984]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-71ee8fe3-27fd-4c20-bf1a-5a07f1a34174, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:21.991637 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:22.004728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:22.005925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:22.006045 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (317ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:22.006173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:17:22.006468 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Deleting instance files /opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e_del
Jun 27 04:17:22.006974 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Deletion of /opt/stack/data/nova/instances/88fcaef5-39d9-4994-b3da-3b9ae5742a3e_del complete
Jun 27 04:17:22.513860 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Took 1.68 seconds to destroy the instance on the hypervisor.
Jun 27 04:17:22.514655 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:17:22.515066 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:17:22.515243 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:17:22.515655 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:22.653839 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:22.956314 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bda18ff2-6b1a-4293-ab4e-4fb5abe2c352 req-8ac3f0ae-6e24-438e-a8c7-06a5999b774e service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-deleted-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:22.956314 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-bda18ff2-6b1a-4293-ab4e-4fb5abe2c352 req-8ac3f0ae-6e24-438e-a8c7-06a5999b774e service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Neutron deleted interface e48032f3-022c-402d-8f4d-fe5e5ee9fbbc; detaching it from the instance and deleting it from the info cache
Jun 27 04:17:22.957996 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bda18ff2-6b1a-4293-ab4e-4fb5abe2c352 req-8ac3f0ae-6e24-438e-a8c7-06a5999b774e service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Detach interface failed, port_id=e48032f3-022c-402d-8f4d-fe5e5ee9fbbc, reason: Instance 88fcaef5-39d9-4994-b3da-3b9ae5742a3e could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:17:23.106656 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b087e7a2-5728-4efc-885c-da4bc5db4ace req-3ad6759d-b94d-4ecd-be51-14c6fd96c861 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-unplugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:23.106826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b087e7a2-5728-4efc-885c-da4bc5db4ace req-3ad6759d-b94d-4ecd-be51-14c6fd96c861 service nova] Acquiring lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:23.106979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b087e7a2-5728-4efc-885c-da4bc5db4ace req-3ad6759d-b94d-4ecd-be51-14c6fd96c861 service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:23.107088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b087e7a2-5728-4efc-885c-da4bc5db4ace req-3ad6759d-b94d-4ecd-be51-14c6fd96c861 service nova] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:23.107215 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b087e7a2-5728-4efc-885c-da4bc5db4ace req-3ad6759d-b94d-4ecd-be51-14c6fd96c861 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] No waiting events found dispatching network-vif-unplugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:23.107340 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b087e7a2-5728-4efc-885c-da4bc5db4ace req-3ad6759d-b94d-4ecd-be51-14c6fd96c861 service nova] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Received event network-vif-unplugged-e48032f3-022c-402d-8f4d-fe5e5ee9fbbc for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:17:23.412856 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:23.914819 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Took 1.40 seconds to deallocate network for instance.
Jun 27 04:17:24.477675 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Took 0.56 seconds to detach 1 volumes for instance.
Jun 27 04:17:24.552134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:24.982999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:24.983158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:25.399470 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:17:25.399717 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:17:25.902748 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:17:26.414832 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.428s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:26.473439 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 88fcaef5-39d9-4994-b3da-3b9ae5742a3e
Jun 27 04:17:26.701952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:27.482404 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a6691d13-1bce-42bb-9501-5d6d5aabce58 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "88fcaef5-39d9-4994-b3da-3b9ae5742a3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.154s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:29.551589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:30.835747 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:30.836238 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:30.836281 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:31.343952 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:31.344152 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:31.344306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:31.344799 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:17:31.703582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:32.065104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:32.065675 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:32.383724 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:17:32.385559 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:32.482279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:32.482796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:32.567920 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:17:32.570812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:32.576020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:32.664160 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:32.664767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:32.752627 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:32.758097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:32.868901 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:32.869480 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:32.961543 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:32.965882 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:33.054895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:33.055378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:33.127223 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:33.127551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:33.131589 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:17:33.131841 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Claim successful on node np0000003830
Jun 27 04:17:33.140828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:33.143455 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:33.235439 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:33.235915 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:33.335939 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:33.339919 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:17:33.340953 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:33.384786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:33.385370 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=49725MB free_disk=72.06988143920898GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:17:33.385561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:34.553825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:34.560704 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:17:34.561006 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:17:34.724464 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:34.724680 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:35.063812 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:17:35.228128 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:35.336467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:35.336827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:35.570409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.443s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:35.570917 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:17:35.572796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.187s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:35.840112 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 01c43b2c-e0c8-4759-b0be-43fdf4356911 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:36.084025 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:17:36.084655 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:17:36.087114 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:36.087419 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:36.162879 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004340139998930681 future=<Future at 0x7ec5386166c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:36.163458 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782533841.1622987, 88fcaef5-39d9-4994-b3da-3b9ae5742a3e => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:17:36.163681 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:36.164024 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] VM Stopped (Lifecycle Event)
Jun 27 04:17:36.199991 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:17:36.232352 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:36.586644 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:17:36.666766 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a9f98c83-dbd6-4189-8292-4a14792117d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.666766 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.666766 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f415ca02-1d20-44e3-a262-35a1f2b735b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.667075 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance c0043076-a0d2-4446-bfb5-f22121ec128f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.667075 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.667145 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.667282 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 901c95b1-d0ea-49e8-83bc-97674de15f51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:17:36.668261 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 7 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:17:36.668261 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1856MB phys_disk=95GB used_disk=5GB total_vcpus=16 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:17:33 up 40 min,  2 users,  load average: 9.56, 8.96, 6.34\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '7', 'num_os_type_None': '7', 'num_proj_4ebd24b443df4c99bc3cc60c079c474b': '1', 'io_workload': '1', 'num_proj_56c1eb5f65f0446eae1f4967af349cd1': '1', 'num_proj_98005db8eb3947d8b16d88f66930edd4': '1', 'num_proj_47d99f8411b741b2ae3a730bfefef27b': '1', 'num_proj_0dfd39ec000947d9bb452cc7eebfb0c8': '1', 'num_proj_cbd1ebe1144a427082b2a28cd85def6b': '1', 'num_vm_building': '1', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:17:36.670548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 88fcaef5-39d9-4994-b3da-3b9ae5742a3e] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:17:36.686153 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Successfully created port: 539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:17:36.705644 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:36.845397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:37.090699 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:17:37.090958 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:17:37.096046 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:17:37.290013 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Successfully updated port: 539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:17:37.352393 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-changed-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:37.352393 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Refreshing instance network info cache due to event network-changed-539c9e25-43a4-4c87-9fee-27ef655e4377. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:17:37.352393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] Acquiring lock "refresh_cache-901c95b1-d0ea-49e8-83bc-97674de15f51" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:37.352393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] Acquired lock "refresh_cache-901c95b1-d0ea-49e8-83bc-97674de15f51" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:37.352393 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Refreshing network info cache for port 539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:17:37.387217 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:37.387436 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:37.387691 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attaching volume 5481bc54-0d02-475d-a544-17957a670db0 to /dev/vdb
Jun 27 04:17:37.438376 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:37.449475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:37.472520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:37.521912 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:37.522386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:37.533513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:37.536103 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673', 'fe80::fc16:3eff:fe13:2ae1', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:17:37.536586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:37.536749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:37.537129 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:37.537340 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating existing volume attachment record: 5378c4a9-1cc5-42fe-bc95-fc555042c148 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:37.594650 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:17:37.602539 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Booting with volume 58a1d843-ff2e-4866-b64e-92dd84b0a92c at /dev/vda
Jun 27 04:17:37.673796 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:37.687919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:37.710173 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:37.762722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:37.762952 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:37.771665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:37.773074 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673', 'fe80::fc16:3eff:fe13:2ae1', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:17:37.773221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:37.773302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:37.773531 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:37.773735 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Updating existing volume attachment record: e39464b1-8d60-4223-a103-0ca7a8f0d2f2 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:37.792483 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-901c95b1-d0ea-49e8-83bc-97674de15f51" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:17:37.856548 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:37.992225 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:17:38.011318 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:38.011907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:38.012180 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Attaching volume 214bae68-59e3-4598-8a83-ba4c97a5cd50 to /dev/vdb
Jun 27 04:17:38.058553 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:38.073636 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:38.092963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:38.117102 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:17:38.125199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.545s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:38.127090 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:17:38.138802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:38.139286 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5481bc54-0d02-475d-a544-17957a670db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:38.141136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:38.141136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:38.141136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5481bc54-0d02-475d-a544-17957a670db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:38.142398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:38.145985 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:38.153152 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:38.154466 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673', 'fe80::fc16:3eff:fe13:2ae1', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:17:38.154597 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:38.154703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:38.154907 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:38.155100 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updating existing volume attachment record: 1a0439df-0f7b-4407-986d-87290268649d {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:38.158888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:38.160842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:38.162088 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:38.164671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:38.165260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:38.166618 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:38.176061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:38.176061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:38.176061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:38.176061 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:38.184254 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:38.184254 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0] added
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:38.193076 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0] added
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:38.201961 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:38.202277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:38.218013 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:38.218013 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:38.230061 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:38.674910 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'flavor' on Instance uuid f415ca02-1d20-44e3-a262-35a1f2b735b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:38.732009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-363bf96c-b759-4f5e-bf35-eeafd46068a8 req-6579aa41-1d4e-4ffd-b835-a5e0a2a4ce2d service nova] Releasing lock "refresh_cache-901c95b1-d0ea-49e8-83bc-97674de15f51" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:38.732312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-901c95b1-d0ea-49e8-83bc-97674de15f51" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:17:38.733100 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:17:38.771103 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '01c43b2c-e0c8-4759-b0be-43fdf4356911', 'attached_at': '', 'detached_at': '', 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'serial': '214bae68-59e3-4598-8a83-ba4c97a5cd50'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:17:38.772454 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:38.772802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:38.773087 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:39.119674 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:39.119905 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:39.120227 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:39.120474 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:39.120721 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:39.120880 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:17:39.121132 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.71 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:17:39.177929 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Ignoring supplied device name: /dev/vdb
Jun 27 04:17:39.193322 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:39.203034 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:39.204688 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:39.219122 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.222098 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.233399 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.238442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.238442 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.238442 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:39.238707 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.238707 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.238707 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:39.248057 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.248057 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.248057 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:39.248208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.248208 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.248208 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:39.278175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.40.100,3260]
Jun 27 04:17:39.278175 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:39.278175 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.286071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.50.100,3260]
Jun 27 04:17:39.286071 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:39.286071 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.296184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.303015 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:39.310601 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.310601 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.310601 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.310601 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.310601 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:39.310796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.310796 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.310796 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.310796 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.310796 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:39.311126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:39.313993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:39.313993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('9', '-', '-', 0) found on session 130 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:39.313993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:39.319425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.319425 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.319425 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.319425 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.319425 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:39.319657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.319657 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:39.319657 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.319657 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:39.319657 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:39.319906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:39.320076 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:39.320734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('10', '-', '-', 0) found on session 131 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:39.320874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:39.331622 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:17:39.333817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 130 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:39.334190 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5481bc54-0d02-475d-a544-17957a670db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:39.336706 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 131 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:39.503349 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:39.555094 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:39.637126 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Updating instance_info_cache with network_info: [{"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:39.680291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:39.827786 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:17:39.828117 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:17:39.936954 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:17:39.937867 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:17:39.938094 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Creating image(s)
Jun 27 04:17:39.938425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:17:39.938566 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Ensure instance console log exists: /opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:17:39.938891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:39.939033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:39.939148 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:40.138985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-901c95b1-d0ea-49e8-83bc-97674de15f51" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:17:40.139251 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Instance network_info: |[{"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:17:40.140087 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Start _get_guest_xml network_info=[{"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'e39464b1-8d60-4223-a103-0ca7a8f0d2f2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '901c95b1-d0ea-49e8-83bc-97674de15f51', 'attached_at': '', 'detached_at': '', 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'serial': '58a1d843-ff2e-4866-b64e-92dd84b0a92c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:17:40.144156 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:17:40.145335 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1746397869', uuid='901c95b1-d0ea-49e8-83bc-97674de15f51'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533860.1449678) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:17:40.146566 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:17:40.147056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:17:40.147953 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:17:40.148115 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:17:40.149260 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:17:40.149513 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:17:40.149660 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:17:40.149762 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:17:40.149951 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:17:40.150043 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:17:40.150138 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:17:40.150284 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:17:40.150378 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:17:40.150477 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:17:40.150609 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:17:40.150707 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:17:40.162388 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:40.162708 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:40.162814 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:40.337861 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 131 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:40.337861 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5481bc54-0d02-475d-a544-17957a670db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:40.743165 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:40.743596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:40.743596 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Attaching volume c0859dc8-9269-4703-bd04-01a2959ed0b2 to /dev/vdb
Jun 27 04:17:40.785368 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:40.798885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:40.817517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:40.864565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:40.864686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:40.873792 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:40.875152 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673', 'fe80::fc16:3eff:fe13:2ae1', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:17:40.875300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:40.875424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:40.875704 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:40.875980 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Updating existing volume attachment record: 0d337584-db01-48dc-aa44-f9bcfa863165 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:41.181052 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found WWN 330000000cf5d3fd2 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:41.181513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:41.181751 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000cf5d3fd2', 'path': '/dev/dm-1', 'multipath_id': '330000000cf5d3fd2'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:41.182025 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cf5d3fd2', 'path': '/dev/dm-1', 'multipath_id': '330000000cf5d3fd2'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:41.184036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.411s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:41.184285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:41.188254 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:41.196865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:41.197396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:41.197639 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:41.198093 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:41.198599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:41.198782 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:41.208128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:41.208128 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:41.213512 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:41.213512 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50] added
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:41.219804 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:41.220046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:41.220222 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:41.220411 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50] added
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:41.223582 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:41.223811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:41.224012 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:41.224154 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:41.438684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:41.439015 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:41.439127 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:41.692965 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to attach volume 5481bc54-0d02-475d-a544-17957a670db0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]:   <alias name="ua-5481bc54-0d02-475d-a544-17957a670db0"/>
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]:   <serial>5481bc54-0d02-475d-a544-17957a670db0</serial>
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:41.693328 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:17:41.706148 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:42.220986 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:42.224622 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:42.232368 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:42.238574 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.244593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.251950 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.258866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.258866 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.258866 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.258866 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.258866 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:42.259096 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.259096 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.259096 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.259096 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.259096 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:42.267140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.267140 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.267140 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.267140 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.267140 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:42.267312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.267312 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.267312 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.267312 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.267312 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:42.292066 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.40.100,3260]
Jun 27 04:17:42.292066 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:42.292066 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.306227 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.311486 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.50.100,3260]
Jun 27 04:17:42.311486 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:42.311486 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.325145 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.325479 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:42.325955 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:42.326212 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:42.326375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:42.327151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('11', '-', '-', 0) found on session 132 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:42.327302 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:42.344166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 132 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:42.344166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.348510 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:42.348743 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:42.348944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:42.349040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:42.349675 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('12', '-', '-', 0) found on session 133 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:42.349826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:42.363342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 133 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:42.363342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:43.200152 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:17:43.347176 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:43.347696 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:43.347696 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:43.347696 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No VIF found with MAC fa:16:3e:fe:92:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:43.799926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:43.800164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:44.218586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found WWN 330000000ea9666ea for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:44.218871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:44.219197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.056s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:44.219513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:44.219833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== connect_volume: return (5447ms) {'type': 'block', 'scsi_wwn': '330000000ea9666ea', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000ea9666ea'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:44.219950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea9666ea', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000ea9666ea'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:44.221510 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:17:44.221716 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:44.221862 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:44.222296 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7ec5384aaf60>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '01c43b2c-e0c8-4759-b0be-43fdf4356911', 'attached_at': '', 'detached_at': '', 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'serial': '214bae68-59e3-4598-8a83-ba4c97a5cd50'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:17:44.222428 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98984) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
Jun 27 04:17:44.222557 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] opening encrypted volume /dev/dm-2 {{(pid=98984) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 27 04:17:44.231174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:44.231867 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:44.232179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:44.232329 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:44.232609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:44.232799 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:44.247663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:44.247663 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:44.247977 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:44.247977 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:44.260814 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.luks [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c] added
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:44.261155 np0000003830 nova-compute[98984]: INFO os_brick.encryptors.luks [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] /dev/dm-2 is not a valid LUKS device; formatting device for first use
Jun 27 04:17:44.262577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:44.262577 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] formatting encrypted volume /dev/dm-2 {{(pid=98984) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 27 04:17:44.262577 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:44.262577 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c] added
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:44.265876 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:44.266040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:44.266160 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:44.266237 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:44.303741 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lazy-loading 'flavor' on Instance uuid a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:44.557337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:44.904784 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2cfc0d5b-da26-4ee4-a47c-a49dc820a193 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.517s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:45.262312 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:45.266685 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:45.277327 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:45.284887 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.290937 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.298724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.309254 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.310071 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.310264 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.320054 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.320346 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:45.353964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.40.100,3260]
Jun 27 04:17:45.353964 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:45.353964 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.359060 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.50.100,3260]
Jun 27 04:17:45.359060 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:45.359060 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.366918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.372519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.386826 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.387160 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:45.387368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:45.387368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:45.391342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('13', '-', '-', 0) found on session 134 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:45.391475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.397080 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:45.397395 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:45.397688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:45.397781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:45.398695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('14', '-', '-', 0) found on session 135 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:45.398769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:45.411407 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 134 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:45.411558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:45.425421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 135 and hctl ['14', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:46.428164 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 135 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:46.428703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:46.454223 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:46.455606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:46.455606 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Attaching volume 7937da92-b04f-48c4-ab5f-ba7e61e7e186 to /dev/vdb
Jun 27 04:17:46.500040 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:46.515588 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:46.544402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:46.568179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:46.571243 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:46.571534 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:46.571719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:46.571848 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:46.589534 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Terminating instance
Jun 27 04:17:46.596182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:46.596556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:46.605120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:46.606560 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673', 'fe80::fc16:3eff:fe13:2ae1', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:17:46.606728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:46.606848 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:46.607065 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:46.607273 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updating existing volume attachment record: 5647bc73-49be-4b50-8619-efa3e4aa847c {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:46.708233 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.009703 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:17:47.091459 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:17:47.113920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.119173 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.140887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.152749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.170113 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.180448 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.182012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:47.182416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:47.182606 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:47.249844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 330000000f1da63b1 for multipath device dm-3 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:47.249844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:47.250348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.811s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:47.250697 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:47.255733 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (7091ms) {'type': 'block', 'scsi_wwn': '330000000f1da63b1', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000f1da63b1'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:47.255733 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f1da63b1', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000f1da63b1'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:47.265094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:47.265978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:47.266182 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:47.266367 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:47.267346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:47.267346 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:47.283709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:47.283709 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:47.288389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:47.288389 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:47.298299 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '901c95b1-d0ea-49e8-83bc-97674de15f51', 'attached_at': '', 'detached_at': '', 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'serial': '58a1d843-ff2e-4866-b64e-92dd84b0a92c'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:17:47.298839 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:17:47.299048 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:47.299197 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:47.299771 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7ec5181dc7d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '901c95b1-d0ea-49e8-83bc-97674de15f51', 'attached_at': '', 'detached_at': '', 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'serial': '58a1d843-ff2e-4866-b64e-92dd84b0a92c'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:17:47.299987 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98984) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
Jun 27 04:17:47.300153 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] opening encrypted volume /dev/dm-3 {{(pid=98984) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2] added
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:47.309900 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:47.310361 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:47.310361 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:47.310551 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2] added
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0466(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:47.313954 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:47.337636 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42358dc6-3ef3-4352-8787-e1d6a1fcf874 req-d74a1811-98f5-430d-b2e1-3cbcfd1f36cf service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:47.337636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42358dc6-3ef3-4352-8787-e1d6a1fcf874 req-d74a1811-98f5-430d-b2e1-3cbcfd1f36cf service nova] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:47.337636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42358dc6-3ef3-4352-8787-e1d6a1fcf874 req-d74a1811-98f5-430d-b2e1-3cbcfd1f36cf service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:47.337817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-42358dc6-3ef3-4352-8787-e1d6a1fcf874 req-d74a1811-98f5-430d-b2e1-3cbcfd1f36cf service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:47.337929 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42358dc6-3ef3-4352-8787-e1d6a1fcf874 req-d74a1811-98f5-430d-b2e1-3cbcfd1f36cf service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] No waiting events found dispatching network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:47.338035 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-42358dc6-3ef3-4352-8787-e1d6a1fcf874 req-d74a1811-98f5-430d-b2e1-3cbcfd1f36cf service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:17:47.350584 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.luks [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 27 04:17:47.350584 np0000003830 nova-compute[98984]: INFO os_brick.encryptors.luks [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] /dev/dm-3 is not a valid LUKS device; formatting device for first use
Jun 27 04:17:47.350792 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] formatting encrypted volume /dev/dm-3 {{(pid=98984) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 27 04:17:47.436170 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999631313000009 future=<Future at 0x7ec5181de4b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:47.440603 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.995141343999876 future=<Future at 0x7ec5181de4b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:47.440805 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.994960141999854 future=<Future at 0x7ec5181de4b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:17:47.446014 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Instance destroyed successfully.
Jun 27 04:17:47.452184 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'resources' on Instance uuid c0043076-a0d2-4446-bfb5-f22121ec128f {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:47.958929 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1279583720',display_name='tempest-TestEncryptedCinderVolumes-server-1279583720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1279583720',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGuYAtkCdSCeUm1e9x/7IhI6dv1gxiRaf6f4/jUexIJOkLhPSANlh1EzXGMPP3YjTRnxQcb46OkyH9pc9NE32yzfyqOtfMAGLmxJ1JA/q2963Zqpc/xOBe5tzTDFM8Dg==',key_name='tempest-TestEncryptedCinderVolumes-131351821',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:17:07Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-cneekiwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:17:07Z,user_data=None,user_id='db2d0b5572c9405aafaa0091643121a6',uuid=c0043076-a0d2-4446-bfb5-f22121ec128f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:17:47.959250 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "56c27299-ff0b-4543-b205-dda1b4dc7351", "address": "fa:16:3e:13:2a:e1", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c27299-ff", "ovs_interfaceid": "56c27299-ff0b-4543-b205-dda1b4dc7351", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:47.959917 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:47.960283 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:17:47.963129 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.963469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56c27299-ff, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:47.983317 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.983317 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:47.983547 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.984579 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.984822 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfa71e22-e700-4bd1-9d96-67be0ecd33cf) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:47.986676 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.986676 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:47.986676 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:47.992851 np0000003830 nova-compute[98984]: INFO os_vif [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:2a:e1,bridge_name='br-int',has_traffic_filtering=True,id=56c27299-ff0b-4543-b205-dda1b4dc7351,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c27299-ff')
Jun 27 04:17:47.998192 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:17:47.998863 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:47.999184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:48.311173 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:48.315022 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:48.328734 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:48.331946 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.343257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.349175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.365834 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.366192 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.371847 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.372120 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:48.422854 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.40.100,3260]
Jun 27 04:17:48.422854 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:48.422854 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.426570 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.50.100,3260]
Jun 27 04:17:48.426570 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:48.426570 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.438783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.452578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.472612 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.473094 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:48.473513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:48.473513 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:48.476234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] HCTL ('15', '-', '-', 0) found on session 136 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:48.476234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.477753 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:48.478047 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:48.478312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:48.478312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:48.479359 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] HCTL ('16', '-', '-', 0) found on session 137 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:48.479435 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:48.503373 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching for a device in session 136 and hctl ['15', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:48.505831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching for a device in session 137 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:48.506351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:49.433047 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4918080d-aec2-4b6c-ae22-9f7f9ed7700f req-e1d25b33-4873-4a67-a53d-98b460933c2c service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:49.433292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4918080d-aec2-4b6c-ae22-9f7f9ed7700f req-e1d25b33-4873-4a67-a53d-98b460933c2c service nova] Acquiring lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:49.433528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4918080d-aec2-4b6c-ae22-9f7f9ed7700f req-e1d25b33-4873-4a67-a53d-98b460933c2c service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:49.433741 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4918080d-aec2-4b6c-ae22-9f7f9ed7700f req-e1d25b33-4873-4a67-a53d-98b460933c2c service nova] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:49.433914 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4918080d-aec2-4b6c-ae22-9f7f9ed7700f req-e1d25b33-4873-4a67-a53d-98b460933c2c service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] No waiting events found dispatching network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:17:49.434079 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4918080d-aec2-4b6c-ae22-9f7f9ed7700f req-e1d25b33-4873-4a67-a53d-98b460933c2c service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-unplugged-56c27299-ff0b-4543-b205-dda1b4dc7351 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:17:49.498911 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching for a device in session 136 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:49.499389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:49.566261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:50.294480 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Found WWN 330000000572748c4 for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:50.294810 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:50.295114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== connect_volume: return (8855ms) {'type': 'block', 'scsi_wwn': '330000000572748c4', 'path': '/dev/dm-4', 'multipath_id': '330000000572748c4'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:50.295249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000572748c4', 'path': '/dev/dm-4', 'multipath_id': '330000000572748c4'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:50.298147 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.115s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:50.298506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:50.302968 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'flavor' on Instance uuid f415ca02-1d20-44e3-a262-35a1f2b735b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:50.319835 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:50.320672 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:50.324843 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:50.325265 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:50.326109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:50.326389 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:50.343890 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:50.343890 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:50.354113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:50.354113 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186] added
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:50.359786 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:50.360048 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:50.360174 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:50.360345 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186] added
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:50.367887 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:50.368263 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:50.368263 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0419(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:50.368474 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:50.806730 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Attempting to attach volume c0859dc8-9269-4703-bd04-01a2959ed0b2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]:   <alias name="ua-c0859dc8-9269-4703-bd04-01a2959ed0b2"/>
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]:   <serial>c0859dc8-9269-4703-bd04-01a2959ed0b2</serial>
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:50.819081 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:17:51.010601 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] opening encrypted volume /dev/dm-2 {{(pid=98984) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 27 04:17:51.366705 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:51.368832 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:51.388106 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:51.390213 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.409162 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.419380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.432162 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.432633 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.445456 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.445890 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:51.513343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.50.100,3260]
Jun 27 04:17:51.513343 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:51.513343 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.526738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.40.100,3260]
Jun 27 04:17:51.526738 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:51.526738 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.532281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.546986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.567958 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.568465 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:51.568987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:51.568987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:51.570588 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] HCTL ('17', '-', '-', 0) found on session 138 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:51.570955 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.571738 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:51.572409 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:51.572730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.251s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:51.575243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:51.575243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] HCTL ('18', '-', '-', 0) found on session 139 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:51.575243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:51.592157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Searching for a device in session 138 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:51.592442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:51.600117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Searching for a device in session 139 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:51.600283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:51.894345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:51.894715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:52.322126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:17:52.398711 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid ac8cc9d9-308f-4b81-8397-f5692c1e8495 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:52.542516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:52.542516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:52.542516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:52.542516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No VIF found with MAC fa:16:3e:07:7c:13, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:52.996037 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:53.073101 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 01c43b2c-e0c8-4759-b0be-43fdf4356911 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:53.338773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Found WWN 33000000030897930 for multipath device dm-7 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:53.339571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:53.339571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] <== connect_volume: return (6156ms) {'type': 'block', 'scsi_wwn': '33000000030897930', 'path': '/dev/dm-7', 'multipath_id': '33000000030897930'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:53.339571 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000030897930', 'path': '/dev/dm-7', 'multipath_id': '33000000030897930'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:53.339960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.341s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:53.340386 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fca51200-145e-40d0-b861-0cdb504cd581', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:17:53.340687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:17:53.344184 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lazy-loading 'flavor' on Instance uuid a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:53.375113 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:53.375534 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '139')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:17:53.375885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '127')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:53.377560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581', '126')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:53.378572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53af68040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:17:53.378804 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:17:53.379064 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flush multipath device 330000000b08b7288 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:17:53.408271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:53.410149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:53.452158 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:53.486392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:17:53.486392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:17:53.486392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:17:53.498526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:17:53.499917 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:17:53.510810 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:53.548830 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.40.100,3260]
Jun 27 04:17:53.548830 np0000003830 nova-compute[98984]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:53.548830 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:53.571009 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:53.576273 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Attempting to attach volume 214bae68-59e3-4598-8a83-ba4c97a5cd50 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]:   <alias name="ua-214bae68-59e3-4598-8a83-ba4c97a5cd50"/>
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]:   <serial>214bae68-59e3-4598-8a83-ba4c97a5cd50</serial>
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:53.579256 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:17:53.583479 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:53.625721 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.50.100,3260]
Jun 27 04:17:53.625721 np0000003830 nova-compute[98984]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-fca51200-145e-40d0-b861-0cdb504cd581, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:53.625721 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:53.645782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:53.648190 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:53.662484 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== disconnect_volume: return (5649ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:53.662484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:17:53.663030 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Deleting instance files /opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f_del
Jun 27 04:17:53.663487 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Deletion of /opt/stack/data/nova/instances/c0043076-a0d2-4446-bfb5-f22121ec128f_del complete
Jun 27 04:17:53.847754 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Attempting to attach volume 7937da92-b04f-48c4-ab5f-ba7e61e7e186 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]:   <alias name="ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186"/>
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-7"/>
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]:   <serial>7937da92-b04f-48c4-ab5f-ba7e61e7e186</serial>
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:53.852335 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:17:54.126953 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] opening encrypted volume /dev/dm-3 {{(pid=98984) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
Jun 27 04:17:54.159571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07ffdc8a-478b-4d78-9fb0-8a75258bfa73 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.415s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:54.170926 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Took 7.08 seconds to destroy the instance on the hypervisor.
Jun 27 04:17:54.174574 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:17:54.175317 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:17:54.180268 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:17:54.180268 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:54.317976 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:54.570431 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:54.579064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:54.579064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:54.579064 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Attaching volume d75bdf78-2591-4282-adca-2678be8634d5 to /dev/vdb
Jun 27 04:17:54.622959 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:54.633594 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:17:54.655110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:54.700772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:17:54.701051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:17:54.712404 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:17:54.713953 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe17:fde1', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe3a:ff4d', 'fe80::ac88:5fff:fee3:b673', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:17:54.714145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:17:54.714277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:17:54.714614 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:54.714890 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updating existing volume attachment record: ea8c0654-2be0-45e7-a085-854c7cd98622 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:17:54.882093 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cacead42-73a7-4afc-a925-18469211710d req-6287bc27-5ed8-471b-98be-4371de59d517 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Received event network-vif-deleted-56c27299-ff0b-4543-b205-dda1b4dc7351 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:54.882616 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-cacead42-73a7-4afc-a925-18469211710d req-6287bc27-5ed8-471b-98be-4371de59d517 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Neutron deleted interface 56c27299-ff0b-4543-b205-dda1b4dc7351; detaching it from the instance and deleting it from the info cache
Jun 27 04:17:54.886534 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cacead42-73a7-4afc-a925-18469211710d req-6287bc27-5ed8-471b-98be-4371de59d517 service nova] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Detach interface failed, port_id=56c27299-ff0b-4543-b205-dda1b4dc7351, reason: Instance c0043076-a0d2-4446-bfb5-f22121ec128f could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:17:55.280076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:55.281173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:55.281173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:55.281173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:17:fd:e1, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:55.289597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:17:55.289943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd75bdf78-2591-4282-adca-2678be8634d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:55.290117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:55.290699 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:55.290974 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd75bdf78-2591-4282-adca-2678be8634d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:17:55.303128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:55.303798 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:55.304423 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:55.304655 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:55.305072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:55.305305 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:55.316053 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:55.316053 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:55.321075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:17:55.321075 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:55.322552 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5] added
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:55.330986 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:55.331317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:55.331521 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:55.331857 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5] added
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:17:55.346038 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:55.346311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:17:55.346343 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.041(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:17:55.346577 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:17:55.453592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:55.453831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:55.556573 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:55.556573 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:55.556573 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:55.556788 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] No VIF found with MAC fa:16:3e:3a:ff:4d, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:55.824642 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Took 1.65 seconds to deallocate network for instance.
Jun 27 04:17:55.957217 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Detaching volume 5481bc54-0d02-475d-a544-17957a670db0
Jun 27 04:17:56.035864 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to driver detach volume 5481bc54-0d02-475d-a544-17957a670db0 from mountpoint /dev/vdb
Jun 27 04:17:56.040460 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-5481bc54-0d02-475d-a544-17957a670db0 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:17:56.041543 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-5481bc54-0d02-475d-a544-17957a670db0 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:17:56.041700 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Attempting to detach device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:   <alias name="ua-5481bc54-0d02-475d-a544-17957a670db0"/>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:   <serial>5481bc54-0d02-475d-a544-17957a670db0</serial>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:56.041959 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config.
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] (1/8): Attempting to detach device vdb with device alias ua-5481bc54-0d02-475d-a544-17957a670db0 from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:   <alias name="ua-5481bc54-0d02-475d-a544-17957a670db0"/>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:   <serial>5481bc54-0d02-475d-a544-17957a670db0</serial>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:56.063008 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:17:56.332349 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:56.343846 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.350100 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:17:56.355946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:17:56.361191 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.373907 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.374567 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:56.387903 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Took 0.56 seconds to detach 1 volumes for instance.
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.397727 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.398483 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:56.417704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.40.100,3260]
Jun 27 04:17:56.417704 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:56.417704 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.435939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.442335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.50.100,3260]
Jun 27 04:17:56.442335 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:56.442335 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.453784 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.454187 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.454481 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:56.454770 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:56.454901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:56.456080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] HCTL ('7', '-', '-', 0) found on session 140 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:56.456211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:56.473277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 140 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:56.473277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd75bdf78-2591-4282-adca-2678be8634d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] HCTL ('8', '-', '-', 0) found on session 141 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:17:56.476618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:17:56.489820 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 141 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:17:56.489877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd75bdf78-2591-4282-adca-2678be8634d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:17:56.501145 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1746397869',display_name='tempest-TestVolumeBootPattern-server-1746397869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1746397869',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-rd0sxtqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:17:37Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=901c95b1-d0ea-49e8-83bc-97674de15f51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:17:56.502121 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:56.502382 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:56.503160 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 901c95b1-d0ea-49e8-83bc-97674de15f51 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:56.592840 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533876.5924673, a9f98c83-dbd6-4189-8292-4a14792117d2 => ua-5481bc54-0d02-475d-a544-17957a670db0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:17:56.594079 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5481bc54-0d02-475d-a544-17957a670db0 for instance a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:17:56.596867 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config.
Jun 27 04:17:56.598054 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:17:56.598318 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5481bc54-0d02-475d-a544-17957a670db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:56.598460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:56.846605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e8cbe55f-6b19-447b-9332-44c7c4462536 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.835s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:56.894304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:56.894505 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <uuid>901c95b1-d0ea-49e8-83bc-97674de15f51</uuid>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <name>instance-0000003a</name>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-1746397869</nova:name>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:17:40</nova:creationTime>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:properties/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         <nova:port uuid="539c9e25-43a4-4c87-9fee-27ef655e4377">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <entry name="serial">901c95b1-d0ea-49e8-83bc-97674de15f51</entry>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <entry name="uuid">901c95b1-d0ea-49e8-83bc-97674de15f51</entry>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51/disk.config"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <alias name="ua-58a1d843-ff2e-4866-b64e-92dd84b0a92c"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <serial>58a1d843-ff2e-4866-b64e-92dd84b0a92c</serial>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:d5:4a:2a"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <target dev="tap539c9e25-43"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51/console.log" append="off"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:17:57.005776 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:17:57.007486 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Preparing to wait for external event network-vif-plugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:17:57.007486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:57.007486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:57.007486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:57.007486 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1746397869',display_name='tempest-TestVolumeBootPattern-server-1746397869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1746397869',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-rd0sxtqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:17:37Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=901c95b1-d0ea-49e8-83bc-97674de15f51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:17:57.007486 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:17:57.007763 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:17:57.007904 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:17:57.008304 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.008652 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:57.008954 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:17:57.009940 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.010091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f8bd32e-1dd2-5a4a-9613-273c44734938', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:57.010918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.011582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:57.012061 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.013964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.014094 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap539c9e25-43, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:57.014419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap539c9e25-43, col_values=(('qos', UUID('aed022cf-c996-40ac-88d0-20546b1238e3')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:57.014595 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap539c9e25-43, col_values=(('external_ids', {'iface-id': '539c9e25-43a4-4c87-9fee-27ef655e4377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:4a:2a', 'vm-uuid': '901c95b1-d0ea-49e8-83bc-97674de15f51'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:17:57.015262 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.016416 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:17:57.021735 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:57.025517 np0000003830 nova-compute[98984]: INFO os_vif [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43')
Jun 27 04:17:57.108171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e0fdf463-05db-497b-aeef-531b6315d23a tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.654s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:57.267641 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:17:57.267886 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:17:57.305058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:17:57.417016 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:57.417016 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:57.770949 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:17:57.919166 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Detaching volume 214bae68-59e3-4598-8a83-ba4c97a5cd50
Jun 27 04:17:57.934985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:57.935150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:57.958382 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Attempting to driver detach volume 214bae68-59e3-4598-8a83-ba4c97a5cd50 from mountpoint /dev/vdb
Jun 27 04:17:57.989138 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '01c43b2c-e0c8-4759-b0be-43fdf4356911', 'attached_at': '', 'detached_at': '', 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'serial': '214bae68-59e3-4598-8a83-ba4c97a5cd50'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:17:57.992551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-214bae68-59e3-4598-8a83-ba4c97a5cd50 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:17:57.993908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-214bae68-59e3-4598-8a83-ba4c97a5cd50 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:17:57.994061 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Attempting to detach device vdb from instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:   <alias name="ua-214bae68-59e3-4598-8a83-ba4c97a5cd50"/>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:   <serial>214bae68-59e3-4598-8a83-ba4c97a5cd50</serial>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:57.994345 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:17:57.998963 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 from the persistent domain config.
Jun 27 04:17:57.999106 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] (1/8): Attempting to detach device vdb with device alias ua-214bae68-59e3-4598-8a83-ba4c97a5cd50 from instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:   <alias name="ua-214bae68-59e3-4598-8a83-ba4c97a5cd50"/>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:   <serial>214bae68-59e3-4598-8a83-ba4c97a5cd50</serial>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:57.999403 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:17:58.277552 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.383s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:58.321272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found WWN 3300000003ad7a803 for multipath device dm-9 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:17:58.321644 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:58.321963 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000003ad7a803', 'path': '/dev/dm-9', 'multipath_id': '3300000003ad7a803'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:58.322517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.724s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:58.322919 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003ad7a803', 'path': '/dev/dm-9', 'multipath_id': '3300000003ad7a803'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:17:58.323077 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5481bc54-0d02-475d-a544-17957a670db0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:17:58.323202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:17:58.327694 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid ac8cc9d9-308f-4b81-8397-f5692c1e8495 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:58.340277 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Deleted allocations for instance c0043076-a0d2-4446-bfb5-f22121ec128f
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.352270 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:58.352589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', '130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', '131'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '141')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:17:58.352858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', '130')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:58.353811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0', '131')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:58.354768 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181d1080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:17:58.354967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:17:58.355541 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Flush multipath device 330000000cf5d3fd2 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:17:58.404262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:58.437573 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Detaching volume 7937da92-b04f-48c4-ab5f-ba7e61e7e186
Jun 27 04:17:58.454952 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:58.482550 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Attempting to driver detach volume 7937da92-b04f-48c4-ab5f-ba7e61e7e186 from mountpoint /dev/vdb
Jun 27 04:17:58.488334 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Found disk vdb by alias ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:17:58.489547 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Found disk vdb by alias ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:17:58.489708 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Attempting to detach device vdb from instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:   <alias name="ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186"/>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-7"/>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:   <serial>7937da92-b04f-48c4-ab5f-ba7e61e7e186</serial>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:58.489873 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:17:58.499003 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Successfully detached device vdb from instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 from the persistent domain config.
Jun 27 04:17:58.499205 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] (1/8): Attempting to detach device vdb with device alias ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186 from instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:   <alias name="ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186"/>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-7"/>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:   <serial>7937da92-b04f-48c4-ab5f-ba7e61e7e186</serial>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:58.499524 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:17:58.504017 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533878.5036883, 01c43b2c-e0c8-4759-b0be-43fdf4356911 => ua-214bae68-59e3-4598-8a83-ba4c97a5cd50> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:17:58.505662 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-214bae68-59e3-4598-8a83-ba4c97a5cd50 for instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:17:58.508329 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 from the live domain config.
Jun 27 04:17:58.508901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:17:58.509077 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:17:58.510597 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:17:58.510845 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:58.511002 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:17:58.511686 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7ec5381d7500>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '01c43b2c-e0c8-4759-b0be-43fdf4356911', 'attached_at': '', 'detached_at': '', 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'serial': '214bae68-59e3-4598-8a83-ba4c97a5cd50'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:17:58.511864 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] closing encrypted volume /dev/dm-8 {{(pid=98984) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
Jun 27 04:17:58.512558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:17:58.523489 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:17:58.523785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:17:58.538710 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.542647 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:58.542802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:17:58.542920 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:d5:4a:2a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:17:58.543660 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Using config drive
Jun 27 04:17:58.545061 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:17:58.545372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:58.545558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:58.575730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.40.100,3260]
Jun 27 04:17:58.575730 np0000003830 nova-compute[98984]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:58.575730 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.601255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.615267 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.651738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.50.100,3260]
Jun 27 04:17:58.651738 np0000003830 nova-compute[98984]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-5481bc54-0d02-475d-a544-17957a670db0, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:58.651738 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.671666 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.671907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:58.672119 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== disconnect_volume: return (2073ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:58.672178 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:17:58.674436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.129s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:58.674978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '214bae68-59e3-4598-8a83-ba4c97a5cd50', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:17:58.675358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.706185 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:58.706692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '141')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:17:58.707166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '132')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:58.708007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50', '133')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:58.709209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870c360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:17:58.709383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:17:58.709686 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flush multipath device 330000000ea9666ea {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:17:58.753019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:58.794993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:58.831050 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Attempting to attach volume d75bdf78-2591-4282-adca-2678be8634d5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]:   <alias name="ua-d75bdf78-2591-4282-adca-2678be8634d5"/>
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-9"/>
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]:   <serial>d75bdf78-2591-4282-adca-2678be8634d5</serial>
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:17:58.833097 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:17:58.849019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:17:58.849249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:17:58.850712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:17:58.861551 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:17:58.861798 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:17:58.873877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.914791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.40.100,3260]
Jun 27 04:17:58.914791 np0000003830 nova-compute[98984]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:58.914791 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.932299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.943993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:58.984900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.50.100,3260]
Jun 27 04:17:58.984900 np0000003830 nova-compute[98984]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-214bae68-59e3-4598-8a83-ba4c97a5cd50, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:58.984900 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.004911 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.006169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:59.006339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== disconnect_volume: return (460ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:59.006488 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:17:59.051036 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:17:59.063138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533879.0627499, a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 => ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:17:59.066369 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7937da92-b04f-48c4-ab5f-ba7e61e7e186 for instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:17:59.073473 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Successfully detached device vdb from instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 from the live domain config.
Jun 27 04:17:59.077197 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:17:59.077197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:17:59.077197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:17:59.081704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:17:59.081704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7937da92-b04f-48c4-ab5f-ba7e61e7e186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:17:59.081704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:59.111892 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186 (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:17:59.112220 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '141')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:17:59.112629 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '139')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:59.116564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186', '138')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:17:59.117468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5382e2b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'): ({'sdl'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:17:59.117780 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Removing multipathed devices sdl, sdm {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:17:59.118037 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Flush multipath device 33000000030897930 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:17:59.167086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:59.228045 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Creating config drive at /opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51/disk.config
Jun 27 04:17:59.229111 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:17:59.235810 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:59.239764 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpphkhmtj7 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:17:59.270826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:17:59.271077 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:17:59.273006 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:17:59.285194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:17:59.285621 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:17:59.298523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.301845 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpphkhmtj7" returned: 0 in 0.062s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:17:59.337377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.40.100,3260]
Jun 27 04:17:59.337377 np0000003830 nova-compute[98984]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.40.100,3260] successful.
Jun 27 04:17:59.337377 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.351048 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-337553b2-7dfe-446f-b843-268c0f66cef3 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "c0043076-a0d2-4446-bfb5-f22121ec128f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.780s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:59.354431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.365775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.404279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.50.100,3260]
Jun 27 04:17:59.404279 np0000003830 nova-compute[98984]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-7937da92-b04f-48c4-ab5f-ba7e61e7e186, portal: 192.168.50.100,3260] successful.
Jun 27 04:17:59.404279 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.420828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:17:59.421150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:17:59.421319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] <== disconnect_volume: return (343ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:17:59.421513 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:17:59.555228 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 01c43b2c-e0c8-4759-b0be-43fdf4356911 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:17:59.711316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:59.742247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:59.838524 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:17:59.911081 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-547faddc-2e51-4512-9945-6b32b4cdb05c req-8a2439d3-838b-4a6c-a958-6ab38ba9d1bd service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-plugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:17:59.911621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-547faddc-2e51-4512-9945-6b32b4cdb05c req-8a2439d3-838b-4a6c-a958-6ab38ba9d1bd service nova] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:17:59.911621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-547faddc-2e51-4512-9945-6b32b4cdb05c req-8a2439d3-838b-4a6c-a958-6ab38ba9d1bd service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:17:59.911713 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-547faddc-2e51-4512-9945-6b32b4cdb05c req-8a2439d3-838b-4a6c-a958-6ab38ba9d1bd service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:17:59.911828 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-547faddc-2e51-4512-9945-6b32b4cdb05c req-8a2439d3-838b-4a6c-a958-6ab38ba9d1bd service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Processing event network-vif-plugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:17:59.970903 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lazy-loading 'flavor' on Instance uuid a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:00.038714 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:00.042912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:00.063147 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:00.064145 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:00.248596 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0c8cb6e6-67f9-4867-b6f7-7cc9b9c0f354 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.794s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:00.489796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:00.489998 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:00.490151 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:00.490327 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:ab:21:dc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:00.517228 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533880.5168571, 901c95b1-d0ea-49e8-83bc-97674de15f51 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:00.517755 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:18:00.517974 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] VM Started (Lifecycle Event)
Jun 27 04:18:00.520469 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:18:00.522771 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Instance spawned successfully.
Jun 27 04:18:00.523125 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:18:00.562326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e5592f40-28d8-4207-bf58-54c334af07b4 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.145s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:00.976348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6a490d7f-e09d-47e2-814b-e1b8aafa18cc tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:01.020565 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:01.022351 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:01.030044 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:01.030212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:01.030684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:01.031022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:01.031332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:01.031688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:01.525126 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:18:01.525437 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533881.5252411, 901c95b1-d0ea-49e8-83bc-97674de15f51 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:01.525576 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] VM Paused (Lifecycle Event)
Jun 27 04:18:01.536953 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Took 21.60 seconds to spawn the instance on the hypervisor.
Jun 27 04:18:01.537149 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:01.760350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:01.760350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:01.760808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:01.760808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:01.760808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:01.762991 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Terminating instance
Jun 27 04:18:01.824538 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:01.824719 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:01.900471 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:01.972540 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0673c60b-b971-4311-83bd-38a7a2853e02 req-13305ad1-be2f-4533-8f2e-43ddec8a0d9b service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-plugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:01.973010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0673c60b-b971-4311-83bd-38a7a2853e02 req-13305ad1-be2f-4533-8f2e-43ddec8a0d9b service nova] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:01.973635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0673c60b-b971-4311-83bd-38a7a2853e02 req-13305ad1-be2f-4533-8f2e-43ddec8a0d9b service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:01.973775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0673c60b-b971-4311-83bd-38a7a2853e02 req-13305ad1-be2f-4533-8f2e-43ddec8a0d9b service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:01.973925 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0673c60b-b971-4311-83bd-38a7a2853e02 req-13305ad1-be2f-4533-8f2e-43ddec8a0d9b service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] No waiting events found dispatching network-vif-plugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:01.974090 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-0673c60b-b971-4311-83bd-38a7a2853e02 req-13305ad1-be2f-4533-8f2e-43ddec8a0d9b service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received unexpected event network-vif-plugged-539c9e25-43a4-4c87-9fee-27ef655e4377 for instance with vm_state active and task_state None.
Jun 27 04:18:02.016704 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.030122 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:02.031616 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:02.031766 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:02.034001 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533882.0337887, 901c95b1-d0ea-49e8-83bc-97674de15f51 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:02.034136 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] VM Resumed (Lifecycle Event)
Jun 27 04:18:02.047604 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ecfbbe2d-65b8-442a-aece-fda38789b659 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.475s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:02.048744 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Took 28.97 seconds to build instance.
Jun 27 04:18:02.266697 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:18:02.286303 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.289040 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.306961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.308827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:02.309551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:02.309551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:02.309551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:02.309551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:02.310760 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.312146 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Terminating instance
Jun 27 04:18:02.328899 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Detaching volume c0859dc8-9269-4703-bd04-01a2959ed0b2
Jun 27 04:18:02.330651 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.334058 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.373717 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Attempting to driver detach volume c0859dc8-9269-4703-bd04-01a2959ed0b2 from mountpoint /dev/vdb
Jun 27 04:18:02.379847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Found disk vdb by alias ua-c0859dc8-9269-4703-bd04-01a2959ed0b2 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:02.381173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Found disk vdb by alias ua-c0859dc8-9269-4703-bd04-01a2959ed0b2 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:02.381382 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Attempting to detach device vdb from instance f415ca02-1d20-44e3-a262-35a1f2b735b3 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:   <alias name="ua-c0859dc8-9269-4703-bd04-01a2959ed0b2"/>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:   <serial>c0859dc8-9269-4703-bd04-01a2959ed0b2</serial>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:02.381649 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:02.388999 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully detached device vdb from instance f415ca02-1d20-44e3-a262-35a1f2b735b3 from the persistent domain config.
Jun 27 04:18:02.389306 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] (1/8): Attempting to detach device vdb with device alias ua-c0859dc8-9269-4703-bd04-01a2959ed0b2 from instance f415ca02-1d20-44e3-a262-35a1f2b735b3 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:   <alias name="ua-c0859dc8-9269-4703-bd04-01a2959ed0b2"/>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-4"/>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:   <serial>c0859dc8-9269-4703-bd04-01a2959ed0b2</serial>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:02.389658 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:02.436211 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00040529700027036597 future=<Future at 0x7ec5181de4b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:02.436803 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Emitting event <LifecycleEvent: 1782533867.4356074, c0043076-a0d2-4446-bfb5-f22121ec128f => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:02.436941 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:02.437070 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] VM Stopped (Lifecycle Event)
Jun 27 04:18:02.444315 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:02.444820 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:02.535175 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:02.538042 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:02.541868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:02.553877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.487s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:02.559570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.568229 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.584419 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Instance destroyed successfully.
Jun 27 04:18:02.584773 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'resources' on Instance uuid 01c43b2c-e0c8-4759-b0be-43fdf4356911 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:02.828613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:18:02.845044 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.847533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.868342 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.870109 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.900398 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:02.939708 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: c0043076-a0d2-4446-bfb5-f22121ec128f] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:02.950515 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Detaching volume d75bdf78-2591-4282-adca-2678be8634d5
Jun 27 04:18:02.975741 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c0859dc8-9269-4703-bd04-01a2959ed0b2 for instance f415ca02-1d20-44e3-a262-35a1f2b735b3 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:18:02.988591 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Attempting to driver detach volume d75bdf78-2591-4282-adca-2678be8634d5 from mountpoint /dev/vdb
Jun 27 04:18:02.995288 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found disk vdb by alias ua-d75bdf78-2591-4282-adca-2678be8634d5 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:02.996436 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found disk vdb by alias ua-d75bdf78-2591-4282-adca-2678be8634d5 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:02.996603 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Attempting to detach device vdb from instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:   <alias name="ua-d75bdf78-2591-4282-adca-2678be8634d5"/>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-9"/>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:   <serial>d75bdf78-2591-4282-adca-2678be8634d5</serial>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:02.996956 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:03.002489 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b65defa4-7fe9-4413-becb-a118ff28be35 req-9c2127cb-408a-4bec-9f7e-38ae31482cd6 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:03.002928 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b65defa4-7fe9-4413-becb-a118ff28be35 req-9c2127cb-408a-4bec-9f7e-38ae31482cd6 service nova] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:03.003079 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b65defa4-7fe9-4413-becb-a118ff28be35 req-9c2127cb-408a-4bec-9f7e-38ae31482cd6 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:03.003249 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b65defa4-7fe9-4413-becb-a118ff28be35 req-9c2127cb-408a-4bec-9f7e-38ae31482cd6 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:03.003390 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b65defa4-7fe9-4413-becb-a118ff28be35 req-9c2127cb-408a-4bec-9f7e-38ae31482cd6 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] No waiting events found dispatching network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:03.003545 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b65defa4-7fe9-4413-becb-a118ff28be35 req-9c2127cb-408a-4bec-9f7e-38ae31482cd6 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:03.005948 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully detached device vdb from instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 from the persistent domain config.
Jun 27 04:18:03.006014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] (1/8): Attempting to detach device vdb with device alias ua-d75bdf78-2591-4282-adca-2678be8634d5 from instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:   <alias name="ua-d75bdf78-2591-4282-adca-2678be8634d5"/>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-9"/>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:   <serial>d75bdf78-2591-4282-adca-2678be8634d5</serial>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:03.006327 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:03.044659 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99970617200006 future=<Future at 0x7ec5183a6300 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:03.045644 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998667048000243 future=<Future at 0x7ec5183a6300 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:03.045821 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998456241999975 future=<Future at 0x7ec5183a6300 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:03.046338 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533883.0459113, f415ca02-1d20-44e3-a262-35a1f2b735b3 => ua-c0859dc8-9269-4703-bd04-01a2959ed0b2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:18:03.050775 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully detached device vdb from instance f415ca02-1d20-44e3-a262-35a1f2b735b3 from the live domain config.
Jun 27 04:18:03.054539 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:03.054815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:03.054935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:03.055346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:03.055699 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:03.056400 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.083774 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2 (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:03.084262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '137'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '143')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:03.084544 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '136')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:03.085745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', '137')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:03.087013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538153600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'): ({'sdj'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:03.087296 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Removing multipathed devices sdk, sdj {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:18:03.087596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Flush multipath device 330000000572748c4 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:18:03.088590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-575092653',display_name='tempest-TestEncryptedCinderVolumes-server-575092653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-575092653',id=52,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKonQFZZuALjRegfcFsTUwoYvYrDMeqFPstmK4jK5wt0k0VCBKemXN0qorFHphwiBwXqSoWlLx0eOvZk4evDMhryQZGidVaeEHivOEB84DXt1TV7NMawzjJBojISTjxdw==',key_name='tempest-keypair-1446209593',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:16:56Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-d8bdvigr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:16:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=01c43b2c-e0c8-4759-b0be-43fdf4356911,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:18:03.089156 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "address": "fa:16:3e:17:fd:e1", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2512a5e4-7b", "ovs_interfaceid": "2512a5e4-7b48-4f42-99b7-fad75e3f7494", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:03.091522 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:03.091522 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:18:03.096791 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.097570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2512a5e4-7b, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:03.098395 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.099350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:03.110686 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.115660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.115660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2086fbf6-fedb-4127-8c54-fc9531a9ba77) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:03.116980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.116980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:03.125077 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.130044 np0000003830 nova-compute[98984]: INFO os_vif [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:fd:e1,bridge_name='br-int',has_traffic_filtering=True,id=2512a5e4-7b48-4f42-99b7-fad75e3f7494,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2512a5e4-7b')
Jun 27 04:18:03.130445 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Deleting instance files /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911_del
Jun 27 04:18:03.131266 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Deletion of /opt/stack/data/nova/instances/01c43b2c-e0c8-4759-b0be-43fdf4356911_del complete
Jun 27 04:18:03.146411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:03.156726 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999711811999987 future=<Future at 0x7ec51821ef90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:03.161525 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Instance destroyed successfully.
Jun 27 04:18:03.162978 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lazy-loading 'resources' on Instance uuid a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:03.189564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.198650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:03.261103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:18:03.261290 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:18:03.262563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:18:03.274287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:18:03.274464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:03.287068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.322860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.40.100,3260]
Jun 27 04:18:03.322860 np0000003830 nova-compute[98984]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:03.322860 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.344191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.357346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.391017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 137, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.50.100,3260]
Jun 27 04:18:03.391017 np0000003830 nova-compute[98984]: Logout of [sid: 137, target: iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:03.391017 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.408463 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.408463 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:03.408737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== disconnect_volume: return (353ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:03.408737 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:03.535415 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533883.5338488, ac8cc9d9-308f-4b81-8397-f5692c1e8495 => ua-d75bdf78-2591-4282-adca-2678be8634d5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:18:03.535912 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d75bdf78-2591-4282-adca-2678be8634d5 for instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:18:03.542221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:03.543345 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully detached device vdb from instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 from the live domain config.
Jun 27 04:18:03.545964 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:03.546348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd75bdf78-2591-4282-adca-2678be8634d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:03.546541 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:03.547595 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:03.547899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd75bdf78-2591-4282-adca-2678be8634d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:03.548072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.576883 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5 (non-flash)
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:03.577175 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:03.577341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '143')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:03.577472 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '140')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:03.578692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5', '141')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:03.580069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870d080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:03.580324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:18:03.580622 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flush multipath device 3300000003ad7a803 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:18:03.626450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:03.638797 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 27 04:18:03.639528 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:18:03.639661 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:18:03.639803 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:18:03.640068 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:03.665327 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1491390413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testservervolumeattachscenariooldversion-server-1491390',id=55,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsqs8FE0Hsszfl70vkEasg9Wih4c3DE3rH32GZkZIWMd1wVUVnifNWo+BwN/FcR2c3Cp+sbJZYTvAbj9ADRWkG7uPH+WigDb6fJWiKgiuW+dnpEfFSYupo89DtUEmNwrQ==',key_name='tempest-keypair-1383274682',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:17:03Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dfd39ec000947d9bb452cc7eebfb0c8',ramdisk_id='',reservation_id='r-t3dldixn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:17:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3f1fed1d8584fd5814abbbba5e5c858',uuid=a223eb51-4b77-4bf2-bb91-6b8dd3c337a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:18:03.665572 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Converting VIF {"id": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "address": "fa:16:3e:3a:ff:4d", "network": {"id": "11054617-be2f-4664-8e86-77e692a3ccc0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-683489891-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0dfd39ec000947d9bb452cc7eebfb0c8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e9d8f02-8b", "ovs_interfaceid": "7e9d8f02-8b3e-4bb2-a2f7-10726682ba45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:03.666094 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:03.666459 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:18:03.667396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.667705 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e9d8f02-8b, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:03.668924 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.670027 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:03.671225 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:03.672738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.672936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cc15a36-0339-4afe-90f3-1e8676517b32) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:03.675999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:03.676396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:03.678643 np0000003830 nova-compute[98984]: INFO os_vif [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ff:4d,bridge_name='br-int',has_traffic_filtering=True,id=7e9d8f02-8b3e-4bb2-a2f7-10726682ba45,network=Network(11054617-be2f-4664-8e86-77e692a3ccc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e9d8f02-8b')
Jun 27 04:18:03.679057 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Deleting instance files /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9_del
Jun 27 04:18:03.680301 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Deletion of /opt/stack/data/nova/instances/a223eb51-4b77-4bf2-bb91-6b8dd3c337a9_del complete
Jun 27 04:18:03.719731 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:18:03.719934 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:18:03.721912 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:18:03.736011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:18:03.736256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:03.748750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.774826 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:03.779665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.40.100,3260]
Jun 27 04:18:03.779665 np0000003830 nova-compute[98984]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:03.779665 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.794375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.806882 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.841473 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.50.100,3260]
Jun 27 04:18:03.841473 np0000003830 nova-compute[98984]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-d75bdf78-2591-4282-adca-2678be8634d5, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:03.841473 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.856762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:03.856979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:03.857092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== disconnect_volume: return (310ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:03.857254 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:03.961682 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'flavor' on Instance uuid f415ca02-1d20-44e3-a262-35a1f2b735b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:03.998880 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:03.999049 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:03.999191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:03.999319 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:03.999427 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:04.001447 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Terminating instance
Jun 27 04:18:04.050312 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:04.050543 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:04.053278 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:04.053442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:04.053617 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] No waiting events found dispatching network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:04.053984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:04.053984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:04.053984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] Acquiring lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:04.054435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:04.054435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:04.054435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] No waiting events found dispatching network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:04.056246 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8e03a95-b102-45d7-a195-ffc334f06770 req-4c886222-ebaa-4c41-889b-09162e72447c service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-unplugged-2512a5e4-7b48-4f42-99b7-fad75e3f7494 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:04.188982 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Took 1.37 seconds to destroy the instance on the hypervisor.
Jun 27 04:18:04.188982 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:18:04.188982 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:18:04.188982 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:18:04.188982 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:04.240726 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e24ddf6e-9925-4cb0-ab47-4d00c59d971f req-d9c7fe64-cd2e-4599-83c8-fd1a2b502257 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Received event network-vif-deleted-2512a5e4-7b48-4f42-99b7-fad75e3f7494 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:04.241637 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-e24ddf6e-9925-4cb0-ab47-4d00c59d971f req-d9c7fe64-cd2e-4599-83c8-fd1a2b502257 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Neutron deleted interface 2512a5e4-7b48-4f42-99b7-fad75e3f7494; detaching it from the instance and deleting it from the info cache
Jun 27 04:18:04.243609 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e24ddf6e-9925-4cb0-ab47-4d00c59d971f req-d9c7fe64-cd2e-4599-83c8-fd1a2b502257 service nova] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Detach interface failed, port_id=2512a5e4-7b48-4f42-99b7-fad75e3f7494, reason: Instance 01c43b2c-e0c8-4759-b0be-43fdf4356911 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:18:04.262370 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:04.423391 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid ac8cc9d9-308f-4b81-8397-f5692c1e8495 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:04.504435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:18:04.522888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:04.527038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:04.557383 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:04.562262 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:04.591252 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:04.621526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:04.621716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:04.621967 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attaching volume e0cff339-9da2-4b5b-a97e-d5e3f242faec to /dev/vdb
Jun 27 04:18:04.669215 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:04.682970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:18:04.699542 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:04.707169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:04.763422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:18:04.763533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:18:04.776184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:18:04.777811 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880', 'fe80::fc16:3eff:fe07:7c13', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:feab:21dc', 'fe80::6cf6:a3ff:fec7:f4cf'] 
Jun 27 04:18:04.778059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:18:04.778169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:18:04.778544 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:04.778904 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating existing volume attachment record: 714973a4-0da4-4be6-8824-cbb67b910f4f {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:18:04.847946 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999626675999934 future=<Future at 0x7ec51810e090 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:04.854187 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Instance destroyed successfully.
Jun 27 04:18:04.854899 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 901c95b1-d0ea-49e8-83bc-97674de15f51 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:04.970622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0be06955-4cd3-4b26-9479-285946d387b4 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.145s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:04.971283 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.071s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:04.971548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:04.971716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:04.971851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:04.975977 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Terminating instance
Jun 27 04:18:05.081215 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0eddf805-ee4d-4deb-815b-5999a4b67fa9 req-ae417936-fcb6-437d-9756-ac0fefd92d73 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:05.081630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0eddf805-ee4d-4deb-815b-5999a4b67fa9 req-ae417936-fcb6-437d-9756-ac0fefd92d73 service nova] Acquiring lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:05.081786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0eddf805-ee4d-4deb-815b-5999a4b67fa9 req-ae417936-fcb6-437d-9756-ac0fefd92d73 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:05.081894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0eddf805-ee4d-4deb-815b-5999a4b67fa9 req-ae417936-fcb6-437d-9756-ac0fefd92d73 service nova] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:05.082002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0eddf805-ee4d-4deb-815b-5999a4b67fa9 req-ae417936-fcb6-437d-9756-ac0fefd92d73 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] No waiting events found dispatching network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:05.082152 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0eddf805-ee4d-4deb-815b-5999a4b67fa9 req-ae417936-fcb6-437d-9756-ac0fefd92d73 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-unplugged-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:05.201792 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Took 1.56 seconds to deallocate network for instance.
Jun 27 04:18:05.353559 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:05.361012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1746397869',display_name='tempest-TestVolumeBootPattern-server-1746397869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1746397869',id=58,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:01Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-rd0sxtqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:18:02Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=901c95b1-d0ea-49e8-83bc-97674de15f51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:18:05.361482 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "539c9e25-43a4-4c87-9fee-27ef655e4377", "address": "fa:16:3e:d5:4a:2a", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap539c9e25-43", "ovs_interfaceid": "539c9e25-43a4-4c87-9fee-27ef655e4377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:05.362219 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:05.362673 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:18:05.362958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:18:05.363301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:05.364228 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:05.364808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:05.365086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:18:05.365661 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.365986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap539c9e25-43, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:05.370320 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.371381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:05.372509 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.372754 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aed022cf-c996-40ac-88d0-20546b1238e3) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:05.373758 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:05.373958 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.375769 np0000003830 nova-compute[98984]: INFO os_vif [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:4a:2a,bridge_name='br-int',has_traffic_filtering=True,id=539c9e25-43a4-4c87-9fee-27ef655e4377,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap539c9e25-43')
Jun 27 04:18:05.381685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:05.382392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:05.385900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:05.386315 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:05.386660 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:05.386899 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:05.401345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:05.401345 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:05.408871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:05.408871 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:05.413234 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '901c95b1-d0ea-49e8-83bc-97674de15f51', 'attached_at': '', 'detached_at': '', 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'serial': '58a1d843-ff2e-4866-b64e-92dd84b0a92c'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:18:05.413839 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:18:05.414113 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:18:05.414320 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec] added
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:05.416757 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:05.417079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:05.417247 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:05.417426 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:05.417867 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7ec5384aae70>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '901c95b1-d0ea-49e8-83bc-97674de15f51', 'attached_at': '', 'detached_at': '', 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'serial': '58a1d843-ff2e-4866-b64e-92dd84b0a92c'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:18:05.418037 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] closing encrypted volume /dev/dm-0 {{(pid=98984) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec] added
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:05.423755 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:05.423948 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:05.424024 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:05.424151 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:05.430561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-89419b89-b41e-44fb-9cfc-670a4939588f tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.986s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:05.451452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:05.451846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:05.452133 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:05.480855 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:18:05.498389 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.503190 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.528636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.534831 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.565350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.695394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:05.696812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:05.696812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:05.696812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:05.696812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:05.698370 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Terminating instance
Jun 27 04:18:05.707225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:05.707447 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:05.804562 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.824897 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:05.849336 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999735105000127 future=<Future at 0x7ec518167ce0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:05.851461 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Instance destroyed successfully.
Jun 27 04:18:05.852293 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'resources' on Instance uuid f415ca02-1d20-44e3-a262-35a1f2b735b3 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:05.855397 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Took 1.67 seconds to deallocate network for instance.
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-unplugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] No waiting events found dispatching network-vif-unplugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-unplugged-539c9e25-43a4-4c87-9fee-27ef655e4377 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Received event network-vif-deleted-7e9d8f02-8b3e-4bb2-a2f7-10726682ba45 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-unplugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] Acquiring lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] No waiting events found dispatching network-vif-unplugged-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:06.122509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-feb3d584-0741-4c71-b6a3-8b09325d41ee req-60f8eea7-68b1-4da6-899c-7f39d0d62344 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-unplugged-539c9e25-43a4-4c87-9fee-27ef655e4377 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:06.207261 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:18:06.229559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.232445 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.254409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.257971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.285388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.355684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-927472873',display_name='tempest-VolumesSnapshotTestJSON-instance-927472873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumessnapshottestjson-instance-927472873',id=53,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeSf9KTUbed6XmD8XMVWxYJ14JgV2oIlk+geO6z5t6+sVLBEn1ar3pulcI7V/n2xesy55en2S24Rk1VoeSEOl4lP3crR16RfKUoIjiXxy8rtRUy8apOv2cpyhJ+3eT9/A==',key_name='tempest-keypair-1942717209',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:16:59Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98005db8eb3947d8b16d88f66930edd4',ramdisk_id='',reservation_id='r-0it14w0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2040432487',owner_user_name='tempest-VolumesSnapshotTestJSON-2040432487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37634a5befb4243a59d1ea76d47aa7a',uuid=f415ca02-1d20-44e3-a262-35a1f2b735b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:18:06.357159 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converting VIF {"id": "6198baf1-42bb-44f8-8b5b-c6062458d252", "address": "fa:16:3e:07:7c:13", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6198baf1-42", "ovs_interfaceid": "6198baf1-42bb-44f8-8b5b-c6062458d252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:06.357818 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:06.358166 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:18:06.361005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.361405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6198baf1-42, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:06.363923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.366019 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:06.371703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:06.372096 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.373463 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.373761 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41449344-d7ca-4e2a-ae48-c183e07acac0) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:06.374364 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.375152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:06.379441 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.383847 np0000003830 nova-compute[98984]: INFO os_vif [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:7c:13,bridge_name='br-int',has_traffic_filtering=True,id=6198baf1-42bb-44f8-8b5b-c6062458d252,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6198baf1-42')
Jun 27 04:18:06.389950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:06.389950 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:06.389950 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:06.417942 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:06.425550 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:06.430775 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:06.442616 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.444889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.457579 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.463844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.463844 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.463844 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.463844 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.463844 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:06.464044 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.464044 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.464044 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.464044 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.464044 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:06.472704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.472704 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.472704 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.472704 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.472704 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:06.472954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.472954 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.472954 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.472954 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.472954 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:06.496028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.502200 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f7584fe-5540-4597-a20c-05cdb0775531 req-88fbb3ed-11e2-4a55-9fec-4055d23ed1f4 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-unplugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:06.504288 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.40.100,3260]
Jun 27 04:18:06.504288 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:06.504288 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.504782 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:06.510755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f7584fe-5540-4597-a20c-05cdb0775531 req-88fbb3ed-11e2-4a55-9fec-4055d23ed1f4 service nova] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:06.510755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f7584fe-5540-4597-a20c-05cdb0775531 req-88fbb3ed-11e2-4a55-9fec-4055d23ed1f4 service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:06.510755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f7584fe-5540-4597-a20c-05cdb0775531 req-88fbb3ed-11e2-4a55-9fec-4055d23ed1f4 service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:06.510755 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f7584fe-5540-4597-a20c-05cdb0775531 req-88fbb3ed-11e2-4a55-9fec-4055d23ed1f4 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] No waiting events found dispatching network-vif-unplugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:06.510755 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f7584fe-5540-4597-a20c-05cdb0775531 req-88fbb3ed-11e2-4a55-9fec-4055d23ed1f4 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-unplugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:06.517515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.525186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.50.100,3260]
Jun 27 04:18:06.525186 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:06.525186 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.534639 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:06.535425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:06.536517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('7', '-', '-', 0) found on session 144 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:06.536517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:06.538345 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998614842999814 future=<Future at 0x7ec518371fa0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:06.540176 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Instance destroyed successfully.
Jun 27 04:18:06.543459 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'resources' on Instance uuid ac8cc9d9-308f-4b81-8397-f5692c1e8495 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:06.544787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:06.560865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 144 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:06.560865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('8', '-', '-', 0) found on session 145 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:06.567458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:06.586645 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 145 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:06.586645 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:06.615605 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:07.043403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1081306008',display_name='tempest-AttachVolumeNegativeTest-server-1081306008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-1081306008',id=56,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLogNYokEBmDyExeAaD1VKBJz6xySO8I0CB+33yAnc1ovjMJ/YwXcqaiShjYpwKMC6C7G8ce7AZqH0meqgRbrd308os46LwXgFT56c7R7qF9NpFbBjKDDKxBO0yqezdNSQ==',key_name='tempest-keypair-688762495',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:17:06Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-j27s40eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=ac8cc9d9-308f-4b81-8397-f5692c1e8495,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:18:07.043937 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "address": "fa:16:3e:ab:21:dc", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7bf4c7a-cc", "ovs_interfaceid": "f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:07.044174 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:07.044438 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:18:07.045329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:07.045565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7bf4c7a-cc, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:07.046611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:07.048443 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:07.048892 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:07.049021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d826d77d-b317-4db5-b88a-a4b0ac92a8e8) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:07.053698 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:07.054226 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:07.054459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:07.056121 np0000003830 nova-compute[98984]: INFO os_vif [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:21:dc,bridge_name='br-int',has_traffic_filtering=True,id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7bf4c7a-cc')
Jun 27 04:18:07.056430 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Deleting instance files /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495_del
Jun 27 04:18:07.057174 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Deletion of /opt/stack/data/nova/instances/ac8cc9d9-308f-4b81-8397-f5692c1e8495_del complete
Jun 27 04:18:07.124944 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.417s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:07.126927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.759s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-unplugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] No waiting events found dispatching network-vif-unplugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-unplugged-6198baf1-42bb-44f8-8b5b-c6062458d252 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-unplugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] Acquiring lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] No waiting events found dispatching network-vif-unplugged-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:07.135518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-417cc02b-9410-4668-a36e-7abcda93c547 req-7f86c7bc-c2be-4f12-b8cf-a9e6d14557ee service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-unplugged-6198baf1-42bb-44f8-8b5b-c6062458d252 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:07.199245 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deleted allocations for instance 01c43b2c-e0c8-4759-b0be-43fdf4356911
Jun 27 04:18:07.385444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:18:07.446449 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:07.446702 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:07.562864 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Took 1.36 seconds to destroy the instance on the hypervisor.
Jun 27 04:18:07.563466 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:18:07.563798 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:18:07.563910 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:18:07.564518 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:07.665206 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:07.949806 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:08.237542 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-10e2e946-cc6a-41b0-87fb-91075884b83d tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "01c43b2c-e0c8-4759-b0be-43fdf4356911" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.449s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:08.281314 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e545670a-4e9c-4f67-a172-3e8e42c951dd req-011a891c-ee57-4b95-9268-349bbde9ebc7 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-deleted-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:08.281450 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-e545670a-4e9c-4f67-a172-3e8e42c951dd req-011a891c-ee57-4b95-9268-349bbde9ebc7 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Neutron deleted interface f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9; detaching it from the instance and deleting it from the info cache
Jun 27 04:18:08.283163 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e545670a-4e9c-4f67-a172-3e8e42c951dd req-011a891c-ee57-4b95-9268-349bbde9ebc7 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Detach interface failed, port_id=f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9, reason: Instance ac8cc9d9-308f-4b81-8397-f5692c1e8495 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:18:08.405826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found WWN 3300000007fba1fba for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:18:08.406174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:08.406373 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000007fba1fba', 'path': '/dev/dm-0', 'multipath_id': '3300000007fba1fba'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:08.406531 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007fba1fba', 'path': '/dev/dm-0', 'multipath_id': '3300000007fba1fba'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:18:08.407127 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.955s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:08.407611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58a1d843-ff2e-4866-b64e-92dd84b0a92c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:08.407770 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:08.410355 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.439826 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c (non-flash)
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:08.440223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '145')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:08.440555 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '134')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:08.441348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c', '135')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:08.442190 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538464860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'): ({'sdi'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:08.443475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:18:08.443748 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 330000000f1da63b1 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:18:08.456044 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.331s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:08.477360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:08.534172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:08.562626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ba5bcdf7-9e6d-4ed8-81e2-c64698d96421 req-25853dfd-ff5a-4b74-9c94-6775866b1c24 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-unplugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:08.562626 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ba5bcdf7-9e6d-4ed8-81e2-c64698d96421 req-25853dfd-ff5a-4b74-9c94-6775866b1c24 service nova] Acquiring lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:08.562626 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ba5bcdf7-9e6d-4ed8-81e2-c64698d96421 req-25853dfd-ff5a-4b74-9c94-6775866b1c24 service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:08.562626 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ba5bcdf7-9e6d-4ed8-81e2-c64698d96421 req-25853dfd-ff5a-4b74-9c94-6775866b1c24 service nova] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:08.562626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ba5bcdf7-9e6d-4ed8-81e2-c64698d96421 req-25853dfd-ff5a-4b74-9c94-6775866b1c24 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] No waiting events found dispatching network-vif-unplugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:08.562626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ba5bcdf7-9e6d-4ed8-81e2-c64698d96421 req-25853dfd-ff5a-4b74-9c94-6775866b1c24 service nova] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Received event network-vif-unplugged-f7bf4c7a-cc0f-438a-bc9f-63dbed92f4c9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:18:08.588314 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Deleted allocations for instance a223eb51-4b77-4bf2-bb91-6b8dd3c337a9
Jun 27 04:18:08.604795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:18:08.604795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:18:08.604795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:18:08.612561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:18:08.612759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:08.625811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:08.654825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.40.100,3260]
Jun 27 04:18:08.654825 np0000003830 nova-compute[98984]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:08.654825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:08.668744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:08.679019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:08.710526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.50.100,3260]
Jun 27 04:18:08.710526 np0000003830 nova-compute[98984]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-58a1d843-ff2e-4866-b64e-92dd84b0a92c, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:08.710526 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:08.724177 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:08.725332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:08.725450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (3273ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:08.725627 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:08.725889 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Deleting instance files /opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51_del
Jun 27 04:18:08.726423 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Deletion of /opt/stack/data/nova/instances/901c95b1-d0ea-49e8-83bc-97674de15f51_del complete
Jun 27 04:18:08.730103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.342s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:08.730466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c0859dc8-9269-4703-bd04-01a2959ed0b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:08.730880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:08.732872 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:08.755781 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '145')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:08.756128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:08.756128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:18:08.756224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:08.756311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c0859dc8-9269-4703-bd04-01a2959ed0b2') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:18:08.756414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538464860>, {}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:08.756561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Disconnecting from: [] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:08.756763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:08.756894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== disconnect_volume: return (2369ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:08.757042 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:08.757312 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Deleting instance files /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3_del
Jun 27 04:18:08.758181 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Deletion of /opt/stack/data/nova/instances/f415ca02-1d20-44e3-a262-35a1f2b735b3_del complete
Jun 27 04:18:08.913780 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to attach volume e0cff339-9da2-4b5b-a97e-d5e3f242faec with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]:   <alias name="ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec"/>
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]:   <serial>e0cff339-9da2-4b5b-a97e-d5e3f242faec</serial>
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:08.915509 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:18:09.233728 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Took 4.73 seconds to destroy the instance on the hypervisor.
Jun 27 04:18:09.234414 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:18:09.235044 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Took 1.67 seconds to deallocate network for instance.
Jun 27 04:18:09.235456 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:18:09.235591 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:18:09.235838 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:09.265377 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Took 3.78 seconds to destroy the instance on the hypervisor.
Jun 27 04:18:09.266066 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:18:09.266435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:18:09.266578 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:18:09.266847 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:09.369781 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:09.386340 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:09.602016 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5da1fdbf-b597-4c12-a96d-e2fb03df5bd9 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983 tempest-TestServerVolumeAttachScenarioOldVersion-1215799983-project-member] Lock "a223eb51-4b77-4bf2-bb91-6b8dd3c337a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.292s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:09.742822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:09.742822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:10.054096 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:10.054523 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:10.133804 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-470b99a4-e779-4358-b5ca-60167417fb4b req-ca45b913-604e-44ea-958d-49ab7b201969 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Received event network-vif-deleted-6198baf1-42bb-44f8-8b5b-c6062458d252 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:10.133921 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-470b99a4-e779-4358-b5ca-60167417fb4b req-ca45b913-604e-44ea-958d-49ab7b201969 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Neutron deleted interface 6198baf1-42bb-44f8-8b5b-c6062458d252; detaching it from the instance and deleting it from the info cache
Jun 27 04:18:10.137836 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-470b99a4-e779-4358-b5ca-60167417fb4b req-ca45b913-604e-44ea-958d-49ab7b201969 service nova] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Detach interface failed, port_id=6198baf1-42bb-44f8-8b5b-c6062458d252, reason: Instance f415ca02-1d20-44e3-a262-35a1f2b735b3 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:18:10.279051 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:10.558388 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:10.587988 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:10.599525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:10.599525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:10.599525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:10.599525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No VIF found with MAC fa:16:3e:fe:92:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:10.624838 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-64578667-6b60-4268-a4b0-84d9f7a934cc req-0a51d903-7e43-43de-aa0e-bd33f2893e92 service nova] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Received event network-vif-deleted-539c9e25-43a4-4c87-9fee-27ef655e4377 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:10.778775 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Took 1.54 seconds to deallocate network for instance.
Jun 27 04:18:11.064660 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.322s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:11.089726 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Took 1.82 seconds to deallocate network for instance.
Jun 27 04:18:11.124315 np0000003830 nova-compute[98984]: WARNING nova.volume.cinder [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Attachment 0d337584-db01-48dc-aa44-f9bcfa863165 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0d337584-db01-48dc-aa44-f9bcfa863165. (HTTP 404) (Request-ID: req-4cc5b2c1-1993-48ae-9a36-b533dd6559c1)
Jun 27 04:18:11.125417 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Took 0.03 seconds to detach 1 volumes for instance.
Jun 27 04:18:11.237106 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Deleted allocations for instance ac8cc9d9-308f-4b81-8397-f5692c1e8495
Jun 27 04:18:11.433204 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Took 0.65 seconds to detach 1 volumes for instance.
Jun 27 04:18:11.630081 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:11.630715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:11.873411 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:11.873702 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:11.938194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:12.050574 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:12.159853 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-bb0d6298-9882-4d3a-bddf-a36ac8e73b1e tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.538s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:12.245254 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-82f45b86-6920-4d15-bf41-b2301b132f8b tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "ac8cc9d9-308f-4b81-8397-f5692c1e8495" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.550s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:12.376449 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:12.883355 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.253s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:12.886578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.948s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:12.971892 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Deleted allocations for instance f415ca02-1d20-44e3-a262-35a1f2b735b3
Jun 27 04:18:13.035833 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:13.114888 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:13.115126 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:13.619386 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:13.952010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:13.952564 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:13.982064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-00a7ae57-a05b-43ae-8618-3c3d9fe60a09 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "f415ca02-1d20-44e3-a262-35a1f2b735b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.011s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:13.989097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:13.989335 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:14.127930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.242s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:14.221716 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 901c95b1-d0ea-49e8-83bc-97674de15f51
Jun 27 04:18:14.454358 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:18:14.491367 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:18:14.600601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:15.008576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:15.009262 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:15.013232 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:18:15.013475 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Claim successful on node np0000003830
Jun 27 04:18:15.054629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:15.233220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f2ebaa3a-85b3-4de0-94ac-982c34e70141 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "901c95b1-d0ea-49e8-83bc-97674de15f51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.234s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:15.616621 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:16.211051 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:16.211473 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:16.313368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:16.313626 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:16.435033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:16.435252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:16.712948 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:18:16.816446 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:16.937840 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Detaching volume e0cff339-9da2-4b5b-a97e-d5e3f242faec
Jun 27 04:18:16.997783 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to driver detach volume e0cff339-9da2-4b5b-a97e-d5e3f242faec from mountpoint /dev/vdb
Jun 27 04:18:17.001762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:17.002928 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:17.003060 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Attempting to detach device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:   <alias name="ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec"/>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:   <serial>e0cff339-9da2-4b5b-a97e-d5e3f242faec</serial>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:17.003265 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:17.014999 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config.
Jun 27 04:18:17.015180 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] (1/8): Attempting to detach device vdb with device alias ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:   <alias name="ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec"/>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:   <serial>e0cff339-9da2-4b5b-a97e-d5e3f242faec</serial>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:17.015405 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:17.053157 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:17.295011 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:17.325458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.317s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:17.328890 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:18:17.328890 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.274s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:17.335149 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:18:17.335296 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Claim successful on node np0000003830
Jun 27 04:18:17.542359 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533897.5419064, a9f98c83-dbd6-4189-8292-4a14792117d2 => ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:18:17.543219 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e0cff339-9da2-4b5b-a97e-d5e3f242faec for instance a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:18:17.545903 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config.
Jun 27 04:18:17.549017 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:17.549291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:17.549458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:17.549880 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:17.550259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e0cff339-9da2-4b5b-a97e-d5e3f242faec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:17.552830 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:17.575152 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:17.575152 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:17.575152 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:17.575887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:17.575887 np0000003830 nova-compute[98984]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec (non-flash)
Jun 27 04:18:17.575887 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:17.575887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '145')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:17.575887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '144')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:17.576666 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec', '145')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:17.577542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518191f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:17.577801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:18:17.578089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Flush multipath device 3300000007fba1fba {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:18:17.615467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:17.676993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:17.716627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:18:17.716812 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:18:17.717339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:18:17.728170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:18:17.728441 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:17.751541 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:17.767334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.40.100,3260]
Jun 27 04:18:17.767334 np0000003830 nova-compute[98984]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:17.767334 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:17.781213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:17.793811 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.50.100,3260]
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-e0cff339-9da2-4b5b-a97e-d5e3f242faec, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== disconnect_volume: return (288ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:17.838554 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:17.903655 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db2d0b5572c9405aafaa0091643121a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d99f8411b741b2ae3a730bfefef27b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:18:18.044751 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00041312999974252307 future=<Future at 0x7ec5183a6300 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.045399 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782533883.0442047, 01c43b2c-e0c8-4759-b0be-43fdf4356911 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:18.045629 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.045958 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] VM Stopped (Lifecycle Event)
Jun 27 04:18:18.046965 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.10943870099981723 future=<Future at 0x7ec51821ef90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.047107 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.1092834469995978 future=<Future at 0x7ec51821ef90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.156894 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004368690001683717 future=<Future at 0x7ec51821ef90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.157045 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.157197 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.690325288999702 future=<Future at 0x7ec51810e090 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.163992 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=1.6901877169998443 future=<Future at 0x7ec51810e090 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:18.163992 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782533883.1563256, a223eb51-4b77-4bf2-bb91-6b8dd3c337a9 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:18.163992 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] VM Stopped (Lifecycle Event)
Jun 27 04:18:18.335073 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:18:18.399231 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Successfully created port: b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:18:18.405512 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:18.549096 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-08d14771-226e-4ad2-a842-b66c25bfea2f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 01c43b2c-e0c8-4759-b0be-43fdf4356911] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:18.586012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:18.586245 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:18.660723 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: a223eb51-4b77-4bf2-bb91-6b8dd3c337a9] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:18.838005 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:18:19.088764 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:19.145073 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Successfully updated port: b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:18:19.209444 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-changed-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:19.209444 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Refreshing instance network info cache due to event network-changed-b9e85a43-9c6f-4bed-aebb-03b4bc89585a. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:19.209444 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] Acquiring lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:19.209444 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] Acquired lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:19.209444 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Refreshing network info cache for port b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:19.342010 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Booting with volume ff8eb322-2d18-49c7-81fb-c20ed370fc25 at /dev/vda
Jun 27 04:18:19.408382 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:19.410136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:18:19.411508 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c405252-1f35-4442-a8f5-55d44f6df35f tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.976s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:19.432346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:19.477243 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:18:19.477506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:18:19.487573 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:18:19.494268 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880'] 
Jun 27 04:18:19.494268 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:18:19.494268 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:18:19.494268 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:19.494268 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Updating existing volume attachment record: 5b906d40-4af9-42d3-bd40-6bacde847708 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:18:19.595959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.268s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:19.597103 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.302s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:19.597389 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:18:19.601948 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:19.607082 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:18:19.607325 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Claim successful on node np0000003830
Jun 27 04:18:19.646947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:19.711031 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:19.805681 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:19.847993 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004455020002751553 future=<Future at 0x7ec51810e090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:19.848426 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782533884.8474483, 901c95b1-d0ea-49e8-83bc-97674de15f51 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:19.848594 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:19.848792 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] VM Stopped (Lifecycle Event)
Jun 27 04:18:19.850710 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.9983356450002248 future=<Future at 0x7ec518167ce0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:19.850796 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.9982184310001685 future=<Future at 0x7ec518167ce0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:19.949382 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:20.104750 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:18:20.105217 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:18:20.105782 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:20.106270 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:20.227214 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a2a8189b804630997728bfb949fba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c1eb5f65f0446eae1f4967af349cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:18:20.355730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 901c95b1-d0ea-49e8-83bc-97674de15f51] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:20.447393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0b4afa01-427c-4a44-90fa-33644baa8532 req-220977df-30e1-4101-8681-85738fbf480a service nova] Releasing lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:20.447773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquired lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:20.447952 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:18:20.606522 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:18:20.743328 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Successfully created port: 00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:18:20.849513 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00040706599975237623 future=<Future at 0x7ec518167ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:20.849968 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Emitting event <LifecycleEvent: 1782533885.8489728, f415ca02-1d20-44e3-a262-35a1f2b735b3 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:20.850461 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:20.850461 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.6866820259997439 future=<Future at 0x7ec518371fa0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:20.850461 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] VM Stopped (Lifecycle Event)
Jun 27 04:18:20.851834 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=0.6852923399997053 future=<Future at 0x7ec518371fa0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:20.898378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:20.898716 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:21.032955 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:21.086175 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:21.086559 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:21.111536 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:18:21.160377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:21.160377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:21.214466 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:21.353588 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: f415ca02-1d20-44e3-a262-35a1f2b735b3] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:21.358893 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Successfully updated port: 00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:18:21.378887 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Updating instance_info_cache with network_info: [{"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:21.401988 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:21.412380 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-changed-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:21.416024 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Refreshing instance network info cache due to event network-changed-00c7251a-b156-475a-99a5-48dafe19e9b6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:21.416214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:21.416337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:21.416474 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Refreshing network info cache for port 00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:21.537478 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003758180000659195 future=<Future at 0x7ec518371fa0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:21.538241 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782533886.536868, ac8cc9d9-308f-4b81-8397-f5692c1e8495 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:21.538406 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:18:21.538579 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] VM Stopped (Lifecycle Event)
Jun 27 04:18:21.592515 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:18:21.606701 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:18:21.607637 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:18:21.607901 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Creating image(s)
Jun 27 04:18:21.608323 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:18:21.609242 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Ensure instance console log exists: /opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:18:21.609565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:21.609772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:21.609929 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:21.670022 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:21.860785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:21.882573 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Releasing lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:21.882850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Instance network_info: |[{"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:18:21.883842 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Start _get_guest_xml network_info=[{"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5b906d40-4af9-42d3-bd40-6bacde847708', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f5f5d222-bc04-45ff-b423-bef50fa2f194', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'serial': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:18:21.886607 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:18:21.888171 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1622722981', uuid='f5f5d222-bc04-45ff-b423-bef50fa2f194'), owner=OwnerMeta(userid='db2d0b5572c9405aafaa0091643121a6', username='tempest-TestEncryptedCinderVolumes-1089025697-project-member', projectid='47d99f8411b741b2ae3a730bfefef27b', projectname='tempest-TestEncryptedCinderVolumes-1089025697'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533901.8877325) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:18:21.889362 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:18:21.889819 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:18:21.890821 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:18:21.891056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:18:21.892438 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:18:21.892886 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:18:21.893094 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:18:21.893245 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:18:21.893421 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:18:21.893584 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:18:21.893738 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:18:21.893972 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:18:21.894125 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:18:21.894285 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:18:21.894441 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:18:21.894652 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:18:21.907846 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:18:21.908124 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:21.908255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:21.908630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:21.908831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:18:21.917313 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.321s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:21.917902 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:18:21.921758 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:21.922573 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:21.924306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:21.924868 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:21.925414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:21.926200 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:21.926390 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:21.938316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:21.938316 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:21.939476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:21.939476 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25] added
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:21.952291 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:21.952721 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:21.952721 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:21.952880 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25] added
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:21.954080 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:21.954283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:21.954516 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:21.954707 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:21.986998 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:22.041014 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ac8cc9d9-308f-4b81-8397-f5692c1e8495] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:22.060279 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:22.117237 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:18:22.118246 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:18:22.118882 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Creating image(s)
Jun 27 04:18:22.119135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:22.119298 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:22.119780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:22.120564 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:22.123524 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:22.124600 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:22.147391 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:22.165132 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:22.165530 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:22.174082 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:18:22.174357 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Claim successful on node np0000003830
Jun 27 04:18:22.219826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:22.220177 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:22.220611 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:22.221137 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:22.224017 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:22.224371 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:22.324866 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:22.325350 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:22.376776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk 1073741824" returned: 0 in 0.051s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:22.377341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:22.377706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:22.428439 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:18:22.428795 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:18:22.429292 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:22.429633 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:22.462907 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:22.463215 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:18:22.463412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:22.524480 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a614c2dbe3dc443cab3c16539edca35c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd1ebe1144a427082b2a28cd85def6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:18:22.552075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:22.552422 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:18:22.552814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:18:22.552991 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Ensure instance console log exists: /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:18:22.553269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:22.553535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:22.553704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:22.652158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-817797ab-ceda-4f1b-8fb4-966b41efd5ca req-2b1d6b9c-bd3a-4604-af8e-c0355c1fc67f service nova] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:22.652728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:22.652968 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:18:22.685513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.525s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:22.742353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:22.742597 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:22.932629 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:18:22.953651 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:22.955186 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:22.961046 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Successfully created port: 4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:22.965458 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:22.968104 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:22.978092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:22.983389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:22.988865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:18:22.988865 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:22.988964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:18:22.988964 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:22.989061 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:18:22.989061 np0000003830 nova-compute[98984]: 
Jun 27 04:18:22.994155 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:18:22.994155 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:22.994318 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:18:22.994318 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:22.994507 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:18:22.994507 np0000003830 nova-compute[98984]: 
Jun 27 04:18:23.017038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.50.100,3260]
Jun 27 04:18:23.017038 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:23.017038 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:23.028355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:23.034284 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.40.100,3260]
Jun 27 04:18:23.034284 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:23.034284 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:23.040071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.040071 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.040071 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:23.040247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.040247 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.040247 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:23.040454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:23.040628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:23.041136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] HCTL ('7', '-', '-', 0) found on session 146 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:23.041247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:23.047169 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:23.057745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 146 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:23.059874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.059874 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.059874 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:23.060121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.060121 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:23.060121 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:23.060402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:23.060572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:23.061051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] HCTL ('8', '-', '-', 0) found on session 147 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:23.061155 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:23.075523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 147 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:23.240204 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:23.244772 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:18:23.436107 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:18:23.451071 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:23.467654 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Successfully updated port: 4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:18:23.513996 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-changed-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:23.514375 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Refreshing instance network info cache due to event network-changed-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:23.514608 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] Acquiring lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:23.514730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] Acquired lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:23.514876 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Refreshing network info cache for port 4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:23.586005 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:23.586172 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:23.622468 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:23.757223 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:23.757434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:23.757661 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attaching volume b6ed12ba-60af-4164-bac4-e5cd008c2215 to /dev/vdb
Jun 27 04:18:23.800193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:23.802737 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:23.813089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:18:23.834536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:23.880510 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:18:23.880933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:18:23.888660 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:18:23.889688 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880'] 
Jun 27 04:18:23.889874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:18:23.890030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:18:23.890266 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:23.890530 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating existing volume attachment record: 72796a50-21c6-4406-95ca-1593a566160a {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:18:23.971911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:24.018824 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:24.057909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 146 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:24.058149 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:24.075072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Searching for a device in session 147 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:24.075222 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:24.079225 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:24.089146 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:24.125204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:24.125204 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance network_info: |[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:18:24.127094 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start _get_guest_xml network_info=[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:18:24.131214 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:18:24.132410 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1455892126', uuid='4ac6d302-e622-4d21-9ee8-ac0fe6b003f0'), owner=OwnerMeta(userid='c0a2a8189b804630997728bfb949fba1', username='tempest-TestEncryptedCinderVolumes-1777393507-project-member', projectid='56c1eb5f65f0446eae1f4967af349cd1', projectname='tempest-TestEncryptedCinderVolumes-1777393507'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533904.1320732) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:18:24.133374 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:18:24.133735 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:18:24.134628 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:18:24.134802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:18:24.135674 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:18:24.135983 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:18:24.136095 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:18:24.136198 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:18:24.136300 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:18:24.136376 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:18:24.136472 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:18:24.136648 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:18:24.136775 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:18:24.136878 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:18:24.137021 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:18:24.137128 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:18:24.152991 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:18:24.153243 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:24.153989 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:24.154959 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:24.215629 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:24.443353 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:18:24.443808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6ed12ba-60af-4164-bac4-e5cd008c2215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:24.443976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:24.446404 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:18:24.447301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:18:24.447506 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Creating image(s)
Jun 27 04:18:24.447904 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "/opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:24.448046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:24.448427 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "/opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:24.448938 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:24.451411 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:24.452239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:24.541760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:24.542238 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:24.542806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:24.543256 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:24.546098 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:24.546476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:24.597371 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.432s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:24.598220 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.798s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:24.599142 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:18:24.604971 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:18:24.605154 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Claim successful on node np0000003830
Jun 27 04:18:24.608090 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.639805 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:24.640298 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <uuid>4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</uuid>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <name>instance-0000003c</name>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1455892126</nova:name>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:18:24</nova:creationTime>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:user uuid="c0a2a8189b804630997728bfb949fba1">tempest-TestEncryptedCinderVolumes-1777393507-project-member</nova:user>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:project uuid="56c1eb5f65f0446eae1f4967af349cd1">tempest-TestEncryptedCinderVolumes-1777393507</nova:project>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         <nova:port uuid="00c7251a-b156-475a-99a5-48dafe19e9b6">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <entry name="serial">4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</entry>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <entry name="uuid">4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</entry>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:26:ae:8a"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <target dev="tap00c7251a-b1"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/console.log" append="off"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:18:24.660348 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:18:24.662413 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Preparing to wait for external event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:18:24.662413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:24.662413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:24.662413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:24.662871 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:18:24.663337 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:24.664408 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:24.664733 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:18:24.665367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.666101 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:24.666614 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:18:24.667604 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.667823 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f912ca60-ec3c-5740-8d91-3ccae28d3374', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:24.668921 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.669508 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:24.669735 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.671918 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.672078 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00c7251a-b1, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:24.672492 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00c7251a-b1, col_values=(('qos', UUID('815e4ff1-0c76-4cc0-8850-a8b47b0e0375')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:24.672725 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00c7251a-b1, col_values=(('external_ids', {'iface-id': '00c7251a-b156-475a-99a5-48dafe19e9b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ae:8a', 'vm-uuid': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:24.673442 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.674867 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:24.679214 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:24.680177 np0000003830 nova-compute[98984]: INFO os_vif [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1')
Jun 27 04:18:24.694422 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk 1073741824" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:24.695068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:24.695507 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:24.719064 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-53cd055f-5128-4a86-9db1-d8cef84cb4ae req-291d3a51-c9dd-4fb9-9bde-57bd341a0c41 service nova] Releasing lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:24.719984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquired lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:24.720374 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:18:24.786457 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:24.786949 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:18:24.787251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:24.886912 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:24.887427 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Cannot resize image /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:18:24.887926 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:18:24.888175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Ensure instance console log exists: /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:18:24.888600 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:24.888927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:24.889121 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:24.927138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:18:25.116666 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:18:25.116913 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:18:25.117428 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:25.117838 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:25.189134 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:18:25.298834 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:25.439073 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:25.566906 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Updating instance_info_cache with network_info: [{"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:25.616441 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:18:25.627794 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Successfully created port: 84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:18:25.944109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Found WWN 330000000d1d499d8 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:18:25.945872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:25.946410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.502s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:25.946753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6ed12ba-60af-4164-bac4-e5cd008c2215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:18:25.947394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '330000000d1d499d8', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000d1d499d8'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:25.947615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d1d499d8', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000d1d499d8'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:18:25.951885 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:25.952103 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:25.959563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:25.960277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:25.960756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:25.960948 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:25.962867 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:25.963136 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:25.973915 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:25.973915 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:25.978427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:25.978427 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:25.983014 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'f5f5d222-bc04-45ff-b423-bef50fa2f194', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'serial': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:18:25.983744 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:18:25.984000 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:18:25.984179 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215] added
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:25.985394 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:25.985724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:25.985780 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:25.985919 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215] added
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:25.991642 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:25.991895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:25.992004 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:25.992153 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:25.999255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:18:25.999255 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:18:25.999255 np0000003830 nova-compute[98984]:     <volume>ff8eb322-2d18-49c7-81fb-c20ed370fc25</volume>
Jun 27 04:18:25.999255 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:18:25.999255 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:18:25.999255 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:18:26.069047 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Releasing lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:26.069535 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Instance network_info: |[{"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:18:26.071022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Start _get_guest_xml network_info=[{"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:18:26.073585 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:18:26.074867 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1933885818', uuid='91bf4758-53d5-47c3-bdf2-02127b907893'), owner=OwnerMeta(userid='a614c2dbe3dc443cab3c16539edca35c', username='tempest-AttachVolumeNegativeTest-981489683-project-member', projectid='cbd1ebe1144a427082b2a28cd85def6b', projectname='tempest-AttachVolumeNegativeTest-981489683'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533906.074464) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:18:26.076100 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:18:26.076415 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:18:26.077432 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:18:26.077564 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:18:26.078570 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:18:26.078862 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:18:26.078990 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:18:26.079065 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:18:26.079195 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:18:26.079278 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:18:26.079361 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:18:26.079540 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:18:26.079647 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:18:26.079747 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:18:26.079841 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:18:26.079982 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:18:26.090448 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1933885818',display_name='tempest-AttachVolumeNegativeTest-server-1933885818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-1933885818',id=61,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHioXA2b7RxtlwtEpNLhnbpt5IrykYIuMvMA30/2+Di6rKbMu3kaV6r8SSo3kbWS2dPCfAX4n6Zs46qeu15FhaPTbpKb3ykeU49slin6+DtpF/Gd/OVQVXtnqyZvbh/S4w==',key_name='tempest-keypair-37067785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-7hsd72vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=91bf4758-53d5-47c3-bdf2-02127b907893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:18:26.090720 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:26.091349 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:26.092244 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'pci_devices' on Instance uuid 91bf4758-53d5-47c3-bdf2-02127b907893 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:26.108949 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Successfully updated port: 84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:18:26.120062 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:18:26.163084 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-changed-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:26.164061 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Refreshing instance network info cache due to event network-changed-84730f36-2ee1-481f-b480-f80d5680fe84. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:26.164061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] Acquiring lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:26.164061 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] Acquired lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:26.164061 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Refreshing network info cache for port 84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:26.199216 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:26.199332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:26.199452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:26:ae:8a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:26.199869 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Using config drive
Jun 27 04:18:26.454974 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:26.509292 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1622722981',display_name='tempest-TestEncryptedCinderVolumes-server-1622722981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1622722981',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGuYAtkCdSCeUm1e9x/7IhI6dv1gxiRaf6f4/jUexIJOkLhPSANlh1EzXGMPP3YjTRnxQcb46OkyH9pc9NE32yzfyqOtfMAGLmxJ1JA/q2963Zqpc/xOBe5tzTDFM8Dg==',key_name='tempest-TestEncryptedCinderVolumes-131351821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-bhukd6kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:19Z,user_data=None,user_id='db2d0b5572c9405aafaa0091643121a6',uuid=f5f5d222-bc04-45ff-b423-bef50fa2f194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:18:26.509598 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:26.510011 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:26.510721 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'pci_devices' on Instance uuid f5f5d222-bc04-45ff-b423-bef50fa2f194 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <uuid>91bf4758-53d5-47c3-bdf2-02127b907893</uuid>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <name>instance-0000003d</name>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1933885818</nova:name>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:18:26</nova:creationTime>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:user uuid="a614c2dbe3dc443cab3c16539edca35c">tempest-AttachVolumeNegativeTest-981489683-project-member</nova:user>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:project uuid="cbd1ebe1144a427082b2a28cd85def6b">tempest-AttachVolumeNegativeTest-981489683</nova:project>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         <nova:port uuid="4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <entry name="serial">91bf4758-53d5-47c3-bdf2-02127b907893</entry>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <entry name="uuid">91bf4758-53d5-47c3-bdf2-02127b907893</entry>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.config"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:eb:56:e4"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <target dev="tap4d5ee3b9-7d"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/console.log" append="off"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:18:26.594776 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Preparing to wait for external event network-vif-plugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1933885818',display_name='tempest-AttachVolumeNegativeTest-server-1933885818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-1933885818',id=61,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHioXA2b7RxtlwtEpNLhnbpt5IrykYIuMvMA30/2+Di6rKbMu3kaV6r8SSo3kbWS2dPCfAX4n6Zs46qeu15FhaPTbpKb3ykeU49slin6+DtpF/Gd/OVQVXtnqyZvbh/S4w==',key_name='tempest-keypair-37067785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-7hsd72vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=91bf4758-53d5-47c3-bdf2-02127b907893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:26.596936 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:26.597283 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:18:26.597549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.597882 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:26.598137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:18:26.598821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.598959 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db96ee60-e6e3-5aa7-a013-4c1266741881', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:26.608108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.608931 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:26.611063 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:26.613448 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.615309 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.615522 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d5ee3b9-7d, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:26.615921 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d5ee3b9-7d, col_values=(('qos', UUID('680bf0a8-93e8-4617-b9da-030110d17ed4')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:26.616104 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d5ee3b9-7d, col_values=(('external_ids', {'iface-id': '4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:56:e4', 'vm-uuid': '91bf4758-53d5-47c3-bdf2-02127b907893'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:26.616864 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.618115 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:26.624967 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Booting with volume 77330dab-efd6-4e32-a925-c049014083ca at /dev/vda
Jun 27 04:18:26.626017 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:26.627241 np0000003830 nova-compute[98984]: INFO os_vif [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d')
Jun 27 04:18:26.666009 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:26.668333 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:26.679530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:18:26.705913 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:26.708009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:26.739821 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:26.752147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:18:26.752433 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:18:26.760724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:18:26.762760 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880'] 
Jun 27 04:18:26.762870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:18:26.762977 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:18:26.763174 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:26.763365 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Updating existing volume attachment record: b3faed68-01f7-4e3e-b449-aa0245ba6f29 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:18:26.841094 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Creating config drive at /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config
Jun 27 04:18:26.844883 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnnahjiqw {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:26.897185 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnnahjiqw" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:26.912289 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:26.961890 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.364s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:26.962533 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:18:26.986645 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:26.992734 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:27.004932 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:27.010071 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <uuid>f5f5d222-bc04-45ff-b423-bef50fa2f194</uuid>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <name>instance-0000003b</name>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1622722981</nova:name>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:18:21</nova:creationTime>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:user uuid="db2d0b5572c9405aafaa0091643121a6">tempest-TestEncryptedCinderVolumes-1089025697-project-member</nova:user>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:project uuid="47d99f8411b741b2ae3a730bfefef27b">tempest-TestEncryptedCinderVolumes-1089025697</nova:project>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <nova:port uuid="b9e85a43-9c6f-4bed-aebb-03b4bc89585a">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <entry name="serial">f5f5d222-bc04-45ff-b423-bef50fa2f194</entry>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <entry name="uuid">f5f5d222-bc04-45ff-b423-bef50fa2f194</entry>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194/disk.config"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <alias name="ua-ff8eb322-2d18-49c7-81fb-c20ed370fc25"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <serial>ff8eb322-2d18-49c7-81fb-c20ed370fc25</serial>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <encryption format="luks">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:         <secret type="passphrase" uuid="a442727a-824c-48b9-bf11-4543a5d2dec4"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       </encryption>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:0b:0d:49"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <target dev="tapb9e85a43-9c"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194/console.log" append="off"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:18:27.014437 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:18:27.017579 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Preparing to wait for external event network-vif-plugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:18:27.017579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:27.017579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:27.017579 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:27.017579 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1622722981',display_name='tempest-TestEncryptedCinderVolumes-server-1622722981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1622722981',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGuYAtkCdSCeUm1e9x/7IhI6dv1gxiRaf6f4/jUexIJOkLhPSANlh1EzXGMPP3YjTRnxQcb46OkyH9pc9NE32yzfyqOtfMAGLmxJ1JA/q2963Zqpc/xOBe5tzTDFM8Dg==',key_name='tempest-TestEncryptedCinderVolumes-131351821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-bhukd6kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:19Z,user_data=None,user_id='db2d0b5572c9405aafaa0091643121a6',uuid=f5f5d222-bc04-45ff-b423-bef50fa2f194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:18:27.017579 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:27.017964 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:27.018166 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:18:27.018724 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.019150 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:27.019585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:18:27.020763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.021643 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.021879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a186bb18-0b4c-576c-a857-2945d10b3117', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:27.022631 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.023743 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:27.034411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.034411 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.034411 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:27.034411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.034411 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.034411 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:27.034957 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.037960 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.038170 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9e85a43-9c, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:27.038639 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9e85a43-9c, col_values=(('qos', UUID('d1af0af4-daac-43df-bc4d-060fa5c0b59f')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:27.038807 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9e85a43-9c, col_values=(('external_ids', {'iface-id': 'b9e85a43-9c6f-4bed-aebb-03b4bc89585a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:0d:49', 'vm-uuid': 'f5f5d222-bc04-45ff-b423-bef50fa2f194'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:27.039871 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.041375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:27.042055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.042055 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.042055 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:27.042236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.042236 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.042236 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:27.058278 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.058746 np0000003830 nova-compute[98984]: INFO os_vif [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c')
Jun 27 04:18:27.065296 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.40.100,3260]
Jun 27 04:18:27.065296 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:27.065296 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.077751 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.089680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.50.100,3260]
Jun 27 04:18:27.089680 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:27.089680 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.090042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.090042 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.090042 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.090042 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.090042 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:27.090161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.090161 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.090161 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.090161 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.090161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:27.090490 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:27.090648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:27.091518 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('9', '-', '-', 0) found on session 148 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:27.091949 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:27.102281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:27.111960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 148 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:27.111960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6ed12ba-60af-4164-bac4-e5cd008c2215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:27.117304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.117304 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.117304 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.117304 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.117304 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:27.117574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.117574 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:27.117574 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.117574 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:27.117574 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:27.117869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:27.118032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:27.118822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('10', '-', '-', 0) found on session 149 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:27.118973 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:27.135768 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 149 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:27.135768 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6ed12ba-60af-4164-bac4-e5cd008c2215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:27.379562 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.413404 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.415437 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c16ea401-4208-43c2-99a8-d4130cfe6737 req-04d45e1e-f45a-4934-958a-7a30c4f240a8 service nova] Releasing lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:27.415868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:27.416161 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:18:27.418423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.468577 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:18:27.468778 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:18:27.469248 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:27.469621 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:27.500520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.553156 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b37634a5befb4243a59d1ea76d47aa7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98005db8eb3947d8b16d88f66930edd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:18:27.586286 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-96ba92ad-fa9e-49ed-a721-fd81103d0eea req-2b3a351c-2c15-4695-904a-d62e7fbf77de service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:27.586921 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96ba92ad-fa9e-49ed-a721-fd81103d0eea req-2b3a351c-2c15-4695-904a-d62e7fbf77de service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:27.587169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96ba92ad-fa9e-49ed-a721-fd81103d0eea req-2b3a351c-2c15-4695-904a-d62e7fbf77de service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:27.587270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-96ba92ad-fa9e-49ed-a721-fd81103d0eea req-2b3a351c-2c15-4695-904a-d62e7fbf77de service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:27.587392 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-96ba92ad-fa9e-49ed-a721-fd81103d0eea req-2b3a351c-2c15-4695-904a-d62e7fbf77de service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Processing event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:18:27.714263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.727307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.729372 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.757091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.767411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:27.962944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:18:27.972362 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:18:27.989953 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:28.007176 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Successfully created port: 4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:18:28.133863 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:28.146384 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:28.146623 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:28.146762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:eb:56:e4, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:28.147233 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Using config drive
Jun 27 04:18:28.158021 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533908.1576152, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:28.158591 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:18:28.158892 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Started (Lifecycle Event)
Jun 27 04:18:28.161010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:18:28.163991 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance spawned successfully.
Jun 27 04:18:28.164396 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:18:28.270153 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Updating instance_info_cache with network_info: [{"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:28.476509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:18:28.515117 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Successfully updated port: 4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:18:28.578367 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:28.578590 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:28.578747 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] No VIF found with MAC fa:16:3e:0b:0d:49, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:28.579126 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Using config drive
Jun 27 04:18:28.652474 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:28.664347 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:28.666507 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:28.672200 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:28.672358 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:28.672661 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:28.672879 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:28.673116 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:28.673359 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:28.772308 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:28.772781 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance network_info: |[{"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:18:28.813270 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Creating config drive at /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.config
Jun 27 04:18:28.819603 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppywin8uc {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:28.865117 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:18:28.867486 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:18:28.867788 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Creating image(s)
Jun 27 04:18:28.868445 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:18:28.868628 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:18:28.869089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:28.869426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:28.869591 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:28.870264 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Start _get_guest_xml network_info=[{"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'b3faed68-01f7-4e3e-b449-aa0245ba6f29', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c', 'attached_at': '', 'detached_at': '', 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'serial': '77330dab-efd6-4e32-a925-c049014083ca'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:18:28.875374 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:18:28.876691 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-460433181', uuid='6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533908.876229) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:18:28.877833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:18:28.878163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:18:28.879038 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:18:28.879212 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:18:28.880173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:18:28.880463 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:18:28.880644 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:18:28.880740 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:18:28.880853 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:18:28.880951 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:18:28.881032 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:18:28.881206 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:18:28.881305 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:18:28.881471 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:18:28.881636 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:18:28.881751 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:18:28.891472 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:18:28.891710 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:28.891931 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:28.894347 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppywin8uc" returned: 0 in 0.075s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:28.979151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found WWN 330000000d2286d05 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:18:28.979753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:28.980316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== connect_volume: return (4536ms) {'type': 'block', 'scsi_wwn': '330000000d2286d05', 'path': '/dev/dm-1', 'multipath_id': '330000000d2286d05'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:28.980594 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d2286d05', 'path': '/dev/dm-1', 'multipath_id': '330000000d2286d05'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:18:28.981023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.089s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:28.981295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:18:28.990466 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:28.995283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:28.995924 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:28.996367 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:28.996652 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:29.000139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:29.000139 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:29.010526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:29.010526 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:29.017196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:29.017196 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:29.018020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:29.018163 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquired lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:29.018662 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca] added
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:29.026072 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:29.026598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:29.026598 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:29.026714 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca] added
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:29.033509 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:29.033905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:29.034155 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:29.034368 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:29.084324 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:29.170903 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:18:29.171074 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533909.1707582, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:29.171074 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Paused (Lifecycle Event)
Jun 27 04:18:29.178023 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Took 7.06 seconds to spawn the instance on the hypervisor.
Jun 27 04:18:29.181597 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:29.204800 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Creating config drive at /opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194/disk.config
Jun 27 04:18:29.209917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6q17cc2v {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:29.270297 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6q17cc2v" returned: 0 in 0.060s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:29.313019 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.339263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.491112 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:18:29.494519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to attach volume b6ed12ba-60af-4164-bac4-e5cd008c2215 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:18:29.495600 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:18:29.495600 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Creating image(s)
Jun 27 04:18:29.495844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:29.496055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "/opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]:   <alias name="ua-b6ed12ba-60af-4164-bac4-e5cd008c2215"/>
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]:   <serial>b6ed12ba-60af-4164-bac4-e5cd008c2215</serial>
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:29.497007 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:18:29.498122 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "/opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:29.500018 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:29.505254 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:29.509009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:29.534827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.605393 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.617345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:29.618020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:29.619704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:29.621259 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:29.627411 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:18:29.635600 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:18:29.636952 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:29.680894 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:29.696740 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:29.701898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:29.702031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:29.702206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:29.702395 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:29.702567 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state active and task_state None.
Jun 27 04:18:29.705875 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Took 14.71 seconds to build instance.
Jun 27 04:18:29.706991 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-changed-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:29.707757 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Refreshing instance network info cache due to event network-changed-4f94b6be-5110-40ba-93f8-3fd23be38eb1. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:29.709163 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Acquiring lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:29.709908 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533909.7095141, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:29.710024 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Resumed (Lifecycle Event)
Jun 27 04:18:29.712411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.719533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.720889 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.751777 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.759004 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:29.759925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.123s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:29.760409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:29.830997 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:29.831975 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:18:29.833755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk 1073741824" returned: 0 in 0.073s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:29.834266 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:29.834773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:29.918700 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:29.934173 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:29.934173 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:18:29.934402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:30.028335 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:30.034957 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:30.035664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:30.038923 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Cannot resize image /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:18:30.040551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:18:30.040551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Ensure instance console log exists: /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:18:30.040551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:30.040551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:30.040551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:30.041887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:30.049777 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:30.060999 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.068540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.069965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.084373 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.098510 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.098510 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.098510 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.098510 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.098510 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:30.098803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.098803 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.098803 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.098803 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.098803 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:30.109201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.109201 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.109201 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.109201 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.109201 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:30.109450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.109450 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.109450 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.109450 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.109450 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:30.133122 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updating instance_info_cache with network_info: [{"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:30.136068 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.40.100,3260]
Jun 27 04:18:30.136068 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:30.136068 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.152336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.171689 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.50.100,3260]
Jun 27 04:18:30.171689 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:30.171689 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:30.176600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:30.178933 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('11', '-', '-', 0) found on session 150 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:30.179128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:30.195221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:30.207108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.209894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-59d38d87-83b3-4936-8601-9cc404e8e27e tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.220s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:30.213436 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.222939 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:30.223949 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:30.224245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:30.227283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 150 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:30.227283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:30.227283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('12', '-', '-', 0) found on session 151 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:30.227283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:30.231478 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:30.251450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 151 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:30.253441 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:30.503991 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a3a7cc04-5820-4a00-b78b-db2215bae085 req-432b3be2-6b33-4351-94ad-238fadb453a7 service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-plugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:30.505174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a3a7cc04-5820-4a00-b78b-db2215bae085 req-432b3be2-6b33-4351-94ad-238fadb453a7 service nova] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:30.505174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a3a7cc04-5820-4a00-b78b-db2215bae085 req-432b3be2-6b33-4351-94ad-238fadb453a7 service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:30.505174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a3a7cc04-5820-4a00-b78b-db2215bae085 req-432b3be2-6b33-4351-94ad-238fadb453a7 service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:30.505580 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a3a7cc04-5820-4a00-b78b-db2215bae085 req-432b3be2-6b33-4351-94ad-238fadb453a7 service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Processing event network-vif-plugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:18:30.570987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.579228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.592818 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.618751 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:30.638130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Releasing lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:30.638363 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Instance network_info: |[{"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:18:30.639416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Acquired lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:30.639416 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Refreshing network info cache for port 4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:30.643717 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Start _get_guest_xml network_info=[{"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:18:30.648891 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:18:30.651058 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1790760693', uuid='b7c534a5-7cfd-40d5-b88d-82faa79600fd'), owner=OwnerMeta(userid='b37634a5befb4243a59d1ea76d47aa7a', username='tempest-VolumesSnapshotTestJSON-2040432487-project-member', projectid='98005db8eb3947d8b16d88f66930edd4', projectname='tempest-VolumesSnapshotTestJSON-2040432487'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533910.6504452) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:18:30.655218 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:18:30.655218 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:18:30.661059 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:18:30.661059 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:18:30.661059 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:18:30.661059 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:18:30.661059 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:18:30.661703 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:18:30.661994 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:18:30.662206 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:18:30.662431 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:18:30.662749 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:18:30.662978 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:18:30.663196 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:18:30.663438 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:18:30.663693 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:18:30.680749 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1790760693',display_name='tempest-VolumesSnapshotTestJSON-instance-1790760693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumessnapshottestjson-instance-1790760693',id=63,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrEyzVlf7zwgIi9BvnCH6sYfJiEPjU01LPGu4rBUcXTIl/b9VMo2dQsNmS0QWR13mJ74S6XhIrmQDzJZiMP1+2g6Ltc5elqVz7DHnsBT57DXrHoRKZ5wCb4PmF+0QyAYw==',key_name='tempest-keypair-718229701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98005db8eb3947d8b16d88f66930edd4',ramdisk_id='',reservation_id='r-eczh80qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040432487',owner_user_name='tempest-VolumesSnapshotTestJSON-2040432487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37634a5befb4243a59d1ea76d47aa7a',uuid=b7c534a5-7cfd-40d5-b88d-82faa79600fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:18:30.681334 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converting VIF {"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:30.682403 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:30.683371 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'pci_devices' on Instance uuid b7c534a5-7cfd-40d5-b88d-82faa79600fd {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:30.789208 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533910.7888966, 91bf4758-53d5-47c3-bdf2-02127b907893 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:30.789512 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] VM Started (Lifecycle Event)
Jun 27 04:18:30.998917 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:18:31.145637 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <uuid>b7c534a5-7cfd-40d5-b88d-82faa79600fd</uuid>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <name>instance-0000003f</name>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1790760693</nova:name>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:18:30</nova:creationTime>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:user uuid="b37634a5befb4243a59d1ea76d47aa7a">tempest-VolumesSnapshotTestJSON-2040432487-project-member</nova:user>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:project uuid="98005db8eb3947d8b16d88f66930edd4">tempest-VolumesSnapshotTestJSON-2040432487</nova:project>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         <nova:port uuid="4f94b6be-5110-40ba-93f8-3fd23be38eb1">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <entry name="serial">b7c534a5-7cfd-40d5-b88d-82faa79600fd</entry>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <entry name="uuid">b7c534a5-7cfd-40d5-b88d-82faa79600fd</entry>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.config"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:89:0b:85"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <target dev="tap4f94b6be-51"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/console.log" append="off"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Preparing to wait for external event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:31.188519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:31.191900 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1790760693',display_name='tempest-VolumesSnapshotTestJSON-instance-1790760693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumessnapshottestjson-instance-1790760693',id=63,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrEyzVlf7zwgIi9BvnCH6sYfJiEPjU01LPGu4rBUcXTIl/b9VMo2dQsNmS0QWR13mJ74S6XhIrmQDzJZiMP1+2g6Ltc5elqVz7DHnsBT57DXrHoRKZ5wCb4PmF+0QyAYw==',key_name='tempest-keypair-718229701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98005db8eb3947d8b16d88f66930edd4',ramdisk_id='',reservation_id='r-eczh80qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040432487',owner_user_name='tempest-VolumesSnapshotTestJSON-2040432487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37634a5befb4243a59d1ea76d47aa7a',uuid=b7c534a5-7cfd-40d5-b88d-82faa79600fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:18:31.191900 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converting VIF {"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:31.191900 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:31.191900 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:18:31.191900 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.192708 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:31.192961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:18:31.195465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.195465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8aca6f63-a69a-5e25-91a3-54a1ea0d17d5', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:31.195465 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.195784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:31.199690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.202325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.202597 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f94b6be-51, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:31.202969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f94b6be-51, col_values=(('qos', UUID('b619ce73-7ace-443e-abe1-ddcd45f7a9fa')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:31.203139 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f94b6be-51, col_values=(('external_ids', {'iface-id': '4f94b6be-5110-40ba-93f8-3fd23be38eb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:0b:85', 'vm-uuid': 'b7c534a5-7cfd-40d5-b88d-82faa79600fd'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:31.205599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.207167 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:31.211303 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:31.211902 np0000003830 nova-compute[98984]: INFO os_vif [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51')
Jun 27 04:18:31.292402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:31.301185 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533911.300055, 91bf4758-53d5-47c3-bdf2-02127b907893 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:31.301185 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] VM Paused (Lifecycle Event)
Jun 27 04:18:31.338368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:31.338527 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:31.338646 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:31.338772 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No VIF found with MAC fa:16:3e:fe:92:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:31.536381 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:31.685336 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updated VIF entry in instance network info cache for port 4f94b6be-5110-40ba-93f8-3fd23be38eb1. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:18:31.685816 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updating instance_info_cache with network_info: [{"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:31.750984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-94e8fb53-cdec-4dc8-886b-2d7fe150af55 req-05aa85f2-19bb-4b76-8296-1e2c711465b4 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-plugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:31.752390 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-94e8fb53-cdec-4dc8-886b-2d7fe150af55 req-05aa85f2-19bb-4b76-8296-1e2c711465b4 service nova] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:31.753154 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-94e8fb53-cdec-4dc8-886b-2d7fe150af55 req-05aa85f2-19bb-4b76-8296-1e2c711465b4 service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:31.753154 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-94e8fb53-cdec-4dc8-886b-2d7fe150af55 req-05aa85f2-19bb-4b76-8296-1e2c711465b4 service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:31.753154 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-94e8fb53-cdec-4dc8-886b-2d7fe150af55 req-05aa85f2-19bb-4b76-8296-1e2c711465b4 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Processing event network-vif-plugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:18:31.753417 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:18:31.757509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:18:31.765005 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Instance spawned successfully.
Jun 27 04:18:31.765314 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:18:31.803021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:31.811170 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533911.8108702, 91bf4758-53d5-47c3-bdf2-02127b907893 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:31.811397 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] VM Resumed (Lifecycle Event)
Jun 27 04:18:31.830398 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:31.832048 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:31.992798 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:18:31.995490 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:18:31.998755 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Instance spawned successfully.
Jun 27 04:18:31.999253 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:18:32.018713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 330000000308f8c7d for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:18:32.019117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:32.019348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3127ms) {'type': 'block', 'scsi_wwn': '330000000308f8c7d', 'path': '/dev/dm-2', 'multipath_id': '330000000308f8c7d'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:32.019548 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000308f8c7d', 'path': '/dev/dm-2', 'multipath_id': '330000000308f8c7d'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:18:32.187833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Releasing lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:32.188346 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-plugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:32.188487 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:32.188730 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:32.188900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:32.189057 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] No waiting events found dispatching network-vif-plugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:32.189306 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5cd14ef1-941f-447b-b6f8-c4532aedae18 req-f87797b6-a50c-4030-be3a-c94497157a63 service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received unexpected event network-vif-plugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 for instance with vm_state building and task_state spawning.
Jun 27 04:18:32.277159 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.277387 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.278078 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.278509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.278833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.279163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.315432 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:32.319341 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:32.339639 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:32.342227 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:32.342227 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:32.342227 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:18:32.508215 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.508403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.508762 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.508965 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.509297 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.509800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:32.537118 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-460433181',display_name='tempest-TestVolumeBootPattern-server-460433181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-460433181',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZqEYjgni6BbVYc/bno5NO/+aaOTHfQzS/cepa0LQhtafQgitkJNLE/W7elnp7MCpqIvqgIz+WZ2Ha9LmKmjwmcH0tKHVOBG0fkUxOx5oc8Uqhl7GY0vaC7qLWDgJ7MWg==',key_name='tempest-keypair-1392328707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-i910ccyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:18:32.538299 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:32.539084 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:32.539733 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:32.580284 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-plugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:32.580673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:32.580848 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:32.580967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:32.581101 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] No waiting events found dispatching network-vif-plugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:32.581225 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received unexpected event network-vif-plugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a for instance with vm_state building and task_state spawning.
Jun 27 04:18:32.581479 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-changed-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:32.581619 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Refreshing instance network info cache due to event network-changed-00c7251a-b156-475a-99a5-48dafe19e9b6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:32.581750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:32.581844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:32.581955 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Refreshing network info cache for port 00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:32.735024 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:32.735172 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:32.735284 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No VIF found with MAC fa:16:3e:89:0b:85, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:32.735766 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Using config drive
Jun 27 04:18:32.789722 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Took 8.34 seconds to spawn the instance on the hypervisor.
Jun 27 04:18:32.789930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:32.822455 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:18:32.822758 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533912.8225625, f5f5d222-bc04-45ff-b423-bef50fa2f194 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:32.822853 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] VM Started (Lifecycle Event)
Jun 27 04:18:32.912979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-ea2236dc-8228-4432-a52a-8b0df2c93793 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.155s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:33.014376 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Took 11.41 seconds to spawn the instance on the hypervisor.
Jun 27 04:18:33.014825 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <uuid>6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c</uuid>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <name>instance-0000003e</name>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-460433181</nova:name>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:18:28</nova:creationTime>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         <nova:port uuid="84730f36-2ee1-481f-b480-f80d5680fe84">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <entry name="serial">6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c</entry>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <entry name="uuid">6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c</entry>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c/disk.config"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <alias name="ua-77330dab-efd6-4e32-a925-c049014083ca"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <serial>77330dab-efd6-4e32-a925-c049014083ca</serial>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:52:eb:2b"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <target dev="tap84730f36-2e"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c/console.log" append="off"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:18:33.042540 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:18:33.044652 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Preparing to wait for external event network-vif-plugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:18:33.044652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:33.044652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:33.044652 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:33.044652 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-460433181',display_name='tempest-TestVolumeBootPattern-server-460433181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-460433181',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZqEYjgni6BbVYc/bno5NO/+aaOTHfQzS/cepa0LQhtafQgitkJNLE/W7elnp7MCpqIvqgIz+WZ2Ha9LmKmjwmcH0tKHVOBG0fkUxOx5oc8Uqhl7GY0vaC7qLWDgJ7MWg==',key_name='tempest-keypair-1392328707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-i910ccyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:18:33.044652 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:18:33.045823 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:18:33.046126 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:18:33.046588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.046837 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:33.047057 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:18:33.047908 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.048102 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b486d708-40d6-55b3-b9f3-7b705c005c1c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:33.054993 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.056348 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:33.060864 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.062584 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.062734 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84730f36-2e, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:33.063021 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84730f36-2e, col_values=(('qos', UUID('6182c3ae-5c70-4b01-99fc-93eb305f989f')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:33.063225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84730f36-2e, col_values=(('external_ids', {'iface-id': '84730f36-2ee1-481f-b480-f80d5680fe84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:eb:2b', 'vm-uuid': '6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:18:33.064049 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.065260 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:18:33.076523 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:33.077385 np0000003830 nova-compute[98984]: INFO os_vif [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e')
Jun 27 04:18:33.083936 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:33.252390 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:33.301543 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Took 16.08 seconds to build instance.
Jun 27 04:18:33.328994 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:33.340059 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:33.389776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:33.470277 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Creating config drive at /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.config
Jun 27 04:18:33.475970 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuyu6tgwa {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:33.509723 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:33.510670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:33.548609 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:33.552514 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuyu6tgwa" returned: 0 in 0.076s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:33.559523 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Took 18.60 seconds to build instance.
Jun 27 04:18:33.630764 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:33.636158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:33.751312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:33.755067 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updated VIF entry in instance network info cache for port 00c7251a-b156-475a-99a5-48dafe19e9b6. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:18:33.755626 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:33.759187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:33.805572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4ea6b483-da6b-4cb5-81b6-abedcdf643cb tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.593s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:33.847176 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533913.846621, f5f5d222-bc04-45ff-b423-bef50fa2f194 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:33.847464 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] VM Paused (Lifecycle Event)
Jun 27 04:18:33.890873 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:33.900812 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:34.012401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:34.013412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:34.063673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.111s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:34.118874 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:34.119558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:18:34.127849 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:18:34.133686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:34.155592 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.190092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.196204 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.260708 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:34.261592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:34.287522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-20c3a62a-d4a2-43ba-9dbe-84d3423143cc req-43e114fc-17e1-4eb1-8627-c4400eafc04f service nova] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:34.313092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.353554 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:34.365701 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533914.3646164, f5f5d222-bc04-45ff-b423-bef50fa2f194 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:34.366166 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] VM Resumed (Lifecycle Event)
Jun 27 04:18:34.405253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:34.411007 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:18:34.412141 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:34.445561 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f044583e-732a-4b6c-aee3-5c570bc285f0 req-05d3041a-f032-4a9b-ae9f-10b1a3f8a5e7 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:34.446166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f044583e-732a-4b6c-aee3-5c570bc285f0 req-05d3041a-f032-4a9b-ae9f-10b1a3f8a5e7 service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:34.446633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f044583e-732a-4b6c-aee3-5c570bc285f0 req-05d3041a-f032-4a9b-ae9f-10b1a3f8a5e7 service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:34.446920 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f044583e-732a-4b6c-aee3-5c570bc285f0 req-05d3041a-f032-4a9b-ae9f-10b1a3f8a5e7 service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:34.447669 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f044583e-732a-4b6c-aee3-5c570bc285f0 req-05d3041a-f032-4a9b-ae9f-10b1a3f8a5e7 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Processing event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:18:34.479876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.068s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:34.480318 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51032MB free_disk=72.1321792602539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:18:34.480488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:34.480773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:34.608483 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.617351 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:34.617351 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:34.618194 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:52:eb:2b, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:34.618194 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Using config drive
Jun 27 04:18:34.659303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-changed-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:34.660253 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Refreshing instance network info cache due to event network-changed-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:34.660405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] Acquiring lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:34.660544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] Acquired lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:34.660689 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Refreshing network info cache for port 4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:34.667334 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.678319 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.681416 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.707137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.716609 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:34.870838 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:34.875564 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:35.128183 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:35.164611 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:35.201847 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:18:35.204263 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:18:35.208229 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Instance spawned successfully.
Jun 27 04:18:35.208948 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:18:35.274972 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Creating config drive at /opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c/disk.config
Jun 27 04:18:35.280244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5p7526jp {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:35.364704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5p7526jp" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:18:35.379540 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533915.3791957, b7c534a5-7cfd-40d5-b88d-82faa79600fd => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:35.379713 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] VM Started (Lifecycle Event)
Jun 27 04:18:35.572161 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance a9f98c83-dbd6-4189-8292-4a14792117d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:18:35.572663 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance f5f5d222-bc04-45ff-b423-bef50fa2f194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:18:35.573071 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:18:35.573071 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 91bf4758-53d5-47c3-bdf2-02127b907893 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:18:35.573264 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:18:35.573608 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance b7c534a5-7cfd-40d5-b88d-82faa79600fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:18:35.574047 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 6 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:18:35.574456 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=16 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:18:34 up 41 min,  2 users,  load average: 7.52, 8.41, 6.32\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_4ebd24b443df4c99bc3cc60c079c474b': '1', 'io_workload': '2', 'num_proj_47d99f8411b741b2ae3a730bfefef27b': '1', 'num_proj_56c1eb5f65f0446eae1f4967af349cd1': '1', 'num_proj_cbd1ebe1144a427082b2a28cd85def6b': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '1', 'num_proj_98005db8eb3947d8b16d88f66930edd4': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:18:35.605242 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-changed-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:35.607482 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Refreshing instance network info cache due to event network-changed-b9e85a43-9c6f-4bed-aebb-03b4bc89585a. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:35.607482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] Acquiring lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:35.607482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] Acquired lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:35.607482 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Refreshing network info cache for port b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:35.615649 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:35.728774 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:35.730568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:35.730568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:35.730568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:35.730568 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:35.731299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:35.829574 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Updated VIF entry in instance network info cache for port 4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:18:35.829951 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Updating instance_info_cache with network_info: [{"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:35.858572 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:35.887528 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:35.889221 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:35.893074 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:35.899334 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:36.015201 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:36.048385 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:18:36.048670 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:18:36.108998 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:36.237012 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Took 6.75 seconds to spawn the instance on the hypervisor.
Jun 27 04:18:36.237597 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:36.297964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:36.302562 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:36.310832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:36.310832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:36.332170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ce667636-3af6-4ffc-a9ef-4b1e9a4fbbc4 req-bcf47428-4560-49a9-b68f-3e617a664d7c service nova] Releasing lock "refresh_cache-91bf4758-53d5-47c3-bdf2-02127b907893" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:36.336957 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:36.401912 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:18:36.402206 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533916.4019756, b7c534a5-7cfd-40d5-b88d-82faa79600fd => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:36.402375 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] VM Paused (Lifecycle Event)
Jun 27 04:18:36.510283 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:36.518114 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-08a06c52-0466-43cd-8a55-e1150ffaca40 req-9980d9a2-bee7-4ee3-aa6e-0540db81072b service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:36.518923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-08a06c52-0466-43cd-8a55-e1150ffaca40 req-9980d9a2-bee7-4ee3-aa6e-0540db81072b service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:36.519201 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-08a06c52-0466-43cd-8a55-e1150ffaca40 req-9980d9a2-bee7-4ee3-aa6e-0540db81072b service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:36.519396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-08a06c52-0466-43cd-8a55-e1150ffaca40 req-9980d9a2-bee7-4ee3-aa6e-0540db81072b service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:36.519797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-08a06c52-0466-43cd-8a55-e1150ffaca40 req-9980d9a2-bee7-4ee3-aa6e-0540db81072b service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:36.519981 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-08a06c52-0466-43cd-8a55-e1150ffaca40 req-9980d9a2-bee7-4ee3-aa6e-0540db81072b service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received unexpected event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with vm_state active and task_state None.
Jun 27 04:18:36.552703 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:18:36.665599 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Updated VIF entry in instance network info cache for port b9e85a43-9c6f-4bed-aebb-03b4bc89585a. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:18:36.665886 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Updating instance_info_cache with network_info: [{"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:36.736769 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-vif-plugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:36.736974 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:36.737186 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:36.737320 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:36.737490 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Processing event network-vif-plugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:18:36.737656 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-vif-plugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:36.737784 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:36.737933 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:36.738119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:36.738270 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] No waiting events found dispatching network-vif-plugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:18:36.738843 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d3690dbf-73bf-4cdc-9fc9-01e8377a1329 req-d1937bdc-53c5-43f8-8c36-4da2da9b0deb service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received unexpected event network-vif-plugged-84730f36-2ee1-481f-b480-f80d5680fe84 for instance with vm_state building and task_state spawning.
Jun 27 04:18:36.755391 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Took 13.01 seconds to build instance.
Jun 27 04:18:36.824232 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:18:36.826636 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:18:36.829599 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance spawned successfully.
Jun 27 04:18:36.830756 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:18:36.905457 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:36.914829 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533916.9144604, b7c534a5-7cfd-40d5-b88d-82faa79600fd => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:36.915177 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] VM Resumed (Lifecycle Event)
Jun 27 04:18:37.063067 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:18:37.063333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.583s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:37.064005 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:18:37.170780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-163025c3-3850-46ac-82c0-e02ea7affb14 req-d33f7aeb-70b3-44b6-94c0-11f4c7b83f2c service nova] Releasing lock "refresh_cache-f5f5d222-bc04-45ff-b423-bef50fa2f194" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:37.257104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.514s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:37.341406 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:37.341702 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:37.342193 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:37.342896 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:37.343408 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:37.344048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:18:37.415426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:37.415426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:37.420282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:37.425763 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:37.856733 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Took 8.99 seconds to spawn the instance on the hypervisor.
Jun 27 04:18:37.856854 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:37.920170 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Detaching volume b6ed12ba-60af-4164-bac4-e5cd008c2215
Jun 27 04:18:37.929769 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533917.9294264, 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:37.929938 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] VM Started (Lifecycle Event)
Jun 27 04:18:37.970605 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to driver detach volume b6ed12ba-60af-4164-bac4-e5cd008c2215 from mountpoint /dev/vdb
Jun 27 04:18:37.976033 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-b6ed12ba-60af-4164-bac4-e5cd008c2215 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:37.977516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-b6ed12ba-60af-4164-bac4-e5cd008c2215 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:37.977697 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Attempting to detach device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:   <alias name="ua-b6ed12ba-60af-4164-bac4-e5cd008c2215"/>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:   <serial>b6ed12ba-60af-4164-bac4-e5cd008c2215</serial>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:37.977970 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:37.984116 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config.
Jun 27 04:18:37.984474 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] (1/8): Attempting to detach device vdb with device alias ua-b6ed12ba-60af-4164-bac4-e5cd008c2215 from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:   <alias name="ua-b6ed12ba-60af-4164-bac4-e5cd008c2215"/>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:   <serial>b6ed12ba-60af-4164-bac4-e5cd008c2215</serial>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:37.984779 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:38.072857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:38.368401 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Took 16.27 seconds to build instance.
Jun 27 04:18:38.435319 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:38.438432 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:38.539347 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b6ed12ba-60af-4164-bac4-e5cd008c2215 for instance a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:18:38.800886 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-changed-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:38.800886 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Refreshing instance network info cache due to event network-changed-4f94b6be-5110-40ba-93f8-3fd23be38eb1. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:38.800886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] Acquiring lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:38.800886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] Acquired lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:38.800886 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Refreshing network info cache for port 4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:38.870212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.784s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:38.941025 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533918.9407256, 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:38.941195 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] VM Paused (Lifecycle Event)
Jun 27 04:18:39.062096 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:39.062437 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:39.062677 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:39.062868 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:18:39.063148 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.76 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:18:39.308979 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:39.444139 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:39.448773 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533919.4471571, 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:18:39.448773 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] VM Resumed (Lifecycle Event)
Jun 27 04:18:39.608785 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:39.688400 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:39.827520 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:39.828231 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:18:39.830183 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:18:39.830598 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:18:39.860791 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updated VIF entry in instance network info cache for port 4f94b6be-5110-40ba-93f8-3fd23be38eb1. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:18:39.861090 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updating instance_info_cache with network_info: [{"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:39.950369 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:18:39.954540 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:18:40.363266 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-834c8ebf-dc1c-4e46-9678-6da5aa0d309c req-6a8560c6-3c92-4ed5-91bb-18bec7485b55 service nova] Releasing lock "refresh_cache-b7c534a5-7cfd-40d5-b88d-82faa79600fd" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:40.456827 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533920.4563282, a9f98c83-dbd6-4189-8292-4a14792117d2 => ua-b6ed12ba-60af-4164-bac4-e5cd008c2215> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:18:40.461309 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config.
Jun 27 04:18:40.462750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:40.463246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6ed12ba-60af-4164-bac4-e5cd008c2215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:40.463452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:40.463937 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:40.464430 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6ed12ba-60af-4164-bac4-e5cd008c2215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:40.464647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:40.496849 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215 (non-flash)
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:40.497330 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '151')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:40.497690 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', '148')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:40.498538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215', '149')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:40.500829 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5384a62a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:40.501141 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:18:40.501427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Flush multipath device 330000000d2286d05 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:18:40.538837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:40.592008 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:40.643743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:18:40.643743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:18:40.645400 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:18:40.661197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:18:40.661464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:40.677392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:40.715269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.40.100,3260]
Jun 27 04:18:40.715269 np0000003830 nova-compute[98984]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:40.715269 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:40.763804 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:40.777114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:40.815150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.50.100,3260]
Jun 27 04:18:40.815150 np0000003830 nova-compute[98984]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-b6ed12ba-60af-4164-bac4-e5cd008c2215, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:40.815150 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:40.831061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:40.831732 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:40.838971 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== disconnect_volume: return (368ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:40.838971 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:40.887717 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-changed-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:18:40.888111 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Refreshing instance network info cache due to event network-changed-84730f36-2ee1-481f-b480-f80d5680fe84. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:18:40.888917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] Acquiring lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:18:40.889117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] Acquired lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:18:40.889537 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Refreshing network info cache for port 84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:18:41.393985 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:41.426250 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:41.777095 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:18:41.984530 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Updated VIF entry in instance network info cache for port 84730f36-2ee1-481f-b480-f80d5680fe84. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:18:41.984752 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Updating instance_info_cache with network_info: [{"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:18:42.433999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fb2c9bcb-1fae-4283-bb45-9167e81ca1ed tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.021s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:42.487142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bf740525-2bd3-4b38-8339-3237f722f748 req-143c39ea-6107-4c81-bed5-5486c043708e service nova] Releasing lock "refresh_cache-6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:18:43.084688 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:44.161881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:44.162203 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:44.610515 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:44.665555 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:45.670984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:46.750246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:46.750726 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:46.750726 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attaching volume 5713f198-8eb7-4dd2-9258-5b3953079035 to /dev/vdb
Jun 27 04:18:46.803899 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:46.816174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:18:46.837124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:18:46.890844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:18:46.891186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:18:46.902262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:18:46.903961 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe26:ae8a', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:feeb:56e4', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fe0b:d49', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:fe89:b85', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe52:eb2b', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fefe:923a', 'fe80::5cd6:e8ff:fe80:6880'] 
Jun 27 04:18:46.904183 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:18:46.904274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:18:46.904528 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:46.904949 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating existing volume attachment record: e5516b09-82bd-41c3-a997-3aa35735f871 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:18:47.461433 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:18:47.461937 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5713f198-8eb7-4dd2-9258-5b3953079035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:47.462409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:47.463059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:47.463462 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5713f198-8eb7-4dd2-9258-5b3953079035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:18:47.474898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:47.475429 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:47.475660 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:47.476118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:47.476711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:47.476933 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:47.487057 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:47.487057 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:47.491467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:18:47.491467 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035] added
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:47.498237 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:47.498474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:47.498597 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0229(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:47.498756 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035] added
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:18:47.502639 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:47.502840 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:18:47.502963 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:18:47.503185 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:18:48.087360 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:48.499204 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:18:48.503536 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:48.510953 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:18:48.520290 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.524632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.531199 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.538001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.538001 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.538001 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.538001 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.538001 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:48.538230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.538230 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.538230 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.538230 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.538230 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:48.546235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.546235 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.546235 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.546235 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.546235 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:48.546452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.546452 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.546452 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.546452 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.546452 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:48.573997 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.40.100,3260]
Jun 27 04:18:48.573997 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:48.573997 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.593001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.601982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.50.100,3260]
Jun 27 04:18:48.601982 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:48.601982 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.612107 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.612406 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:48.612660 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:48.612774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:48.613673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('9', '-', '-', 0) found on session 152 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:48.613802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:48.615888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:48.629116 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 152 and hctl ['9', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.636120 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:48.636953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:18:48.637271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] HCTL ('10', '-', '-', 0) found on session 153 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:18:48.637351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:18:48.654896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 153 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:48.654896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5713f198-8eb7-4dd2-9258-5b3953079035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:49.612608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:49.629645 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Searching for a device in session 152 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:18:49.629826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5713f198-8eb7-4dd2-9258-5b3953079035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:18:50.496889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found WWN 3300000001f2eea3a for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:18:50.497134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:50.497294 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000001f2eea3a', 'path': '/dev/dm-1', 'multipath_id': '3300000001f2eea3a'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:50.497410 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001f2eea3a', 'path': '/dev/dm-1', 'multipath_id': '3300000001f2eea3a'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:18:50.500946 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:18:51.004580 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to attach volume 5713f198-8eb7-4dd2-9258-5b3953079035 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]:   <alias name="ua-5713f198-8eb7-4dd2-9258-5b3953079035"/>
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]:   <serial>5713f198-8eb7-4dd2-9258-5b3953079035</serial>
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:51.006257 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:18:52.656543 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:52.657064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:52.657064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:18:52.657064 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] No VIF found with MAC fa:16:3e:fe:92:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:18:53.096271 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:54.214476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-098347ff-d52e-43aa-b79c-9c14b7c1db17 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.464s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:18:54.614928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:57.866718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:18:57.867240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:18:58.099265 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:58.369042 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Detaching volume 5713f198-8eb7-4dd2-9258-5b3953079035
Jun 27 04:18:58.405997 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Attempting to driver detach volume 5713f198-8eb7-4dd2-9258-5b3953079035 from mountpoint /dev/vdb
Jun 27 04:18:58.410088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-5713f198-8eb7-4dd2-9258-5b3953079035 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:58.411430 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Found disk vdb by alias ua-5713f198-8eb7-4dd2-9258-5b3953079035 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:18:58.411430 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Attempting to detach device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:   <alias name="ua-5713f198-8eb7-4dd2-9258-5b3953079035"/>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:   <serial>5713f198-8eb7-4dd2-9258-5b3953079035</serial>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:58.411816 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:58.429999 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the persistent domain config.
Jun 27 04:18:58.430170 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] (1/8): Attempting to detach device vdb with device alias ua-5713f198-8eb7-4dd2-9258-5b3953079035 from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:   <alias name="ua-5713f198-8eb7-4dd2-9258-5b3953079035"/>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-1"/>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:   <serial>5713f198-8eb7-4dd2-9258-5b3953079035</serial>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:18:58.430544 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:18:58.926004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533938.9255946, a9f98c83-dbd6-4189-8292-4a14792117d2 => ua-5713f198-8eb7-4dd2-9258-5b3953079035> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:18:58.927554 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5713f198-8eb7-4dd2-9258-5b3953079035 for instance a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:18:58.929730 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully detached device vdb from instance a9f98c83-dbd6-4189-8292-4a14792117d2 from the live domain config.
Jun 27 04:18:58.930861 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:18:58.931166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5713f198-8eb7-4dd2-9258-5b3953079035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:18:58.931289 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:18:58.931626 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:18:58.931909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5713f198-8eb7-4dd2-9258-5b3953079035', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:18:58.932034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:58.958881 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035 (non-flash)
Jun 27 04:18:58.959147 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:18:58.959287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', '153')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:18:58.959412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', '152')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:58.960543 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035', '153')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:18:58.961584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518774540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:18:58.961837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:18:58.962111 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Flush multipath device 3300000001f2eea3a {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:18:58.996011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:59.035040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:18:59.080009 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:18:59.080179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:18:59.081081 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:18:59.094610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:18:59.094806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:18:59.105274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:59.137609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.40.100,3260]
Jun 27 04:18:59.137609 np0000003830 nova-compute[98984]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.40.100,3260] successful.
Jun 27 04:18:59.137609 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:59.152461 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:59.162954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:59.195837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.50.100,3260]
Jun 27 04:18:59.195837 np0000003830 nova-compute[98984]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-5713f198-8eb7-4dd2-9258-5b3953079035, portal: 192.168.50.100,3260] successful.
Jun 27 04:18:59.195837 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:59.211270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:18:59.211559 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:18:59.211683 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] <== disconnect_volume: return (280ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:18:59.211829 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:18:59.628567 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:18:59.761172 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'flavor' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:00.767354 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8704acdf-c017-49bd-bf34-d6322eae5f74 tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.900s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:03.102569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:04.631534 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:07.831030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:07.831517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:08.104808 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:08.334519 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:09.013235 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:09.013762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:09.013762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:09.013762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:09.013923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:09.015774 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Terminating instance
Jun 27 04:19:09.339264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:09.518563 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:19:09.536409 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.538957 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.558256 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.579958 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.629973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.690700 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63071cbb-fc7d-4aed-b8e3-b49a3056e97b req-2f5d0aa8-2068-4584-8ca4-8e054757e6ce service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:09.691110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63071cbb-fc7d-4aed-b8e3-b49a3056e97b req-2f5d0aa8-2068-4584-8ca4-8e054757e6ce service nova] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:09.691333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63071cbb-fc7d-4aed-b8e3-b49a3056e97b req-2f5d0aa8-2068-4584-8ca4-8e054757e6ce service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:09.691478 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-63071cbb-fc7d-4aed-b8e3-b49a3056e97b req-2f5d0aa8-2068-4584-8ca4-8e054757e6ce service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:09.691651 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63071cbb-fc7d-4aed-b8e3-b49a3056e97b req-2f5d0aa8-2068-4584-8ca4-8e054757e6ce service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] No waiting events found dispatching network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:09.691786 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-63071cbb-fc7d-4aed-b8e3-b49a3056e97b req-2f5d0aa8-2068-4584-8ca4-8e054757e6ce service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:09.801367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.815800 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.822696 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:09.851169 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999689771999783 future=<Future at 0x7ec5382ec710 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:09.851668 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998841659999925 future=<Future at 0x7ec5382ec710 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:09.851668 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998713275999762 future=<Future at 0x7ec5382ec710 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:09.852242 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Instance destroyed successfully.
Jun 27 04:19:09.852750 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lazy-loading 'resources' on Instance uuid a9f98c83-dbd6-4189-8292-4a14792117d2 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:10.354973 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-32098929',display_name='tempest-SnapshotDataIntegrityTests-server-32098929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-snapshotdataintegritytests-server-32098929',id=51,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAhUWa+dUyzNQvXEnqrzz58LA4fkrE1bHzTf8AdZg7ZkbvZhhafj6EoQG+sH+qqUrY3T5mqQ3lKLoL/0ek3lVHwngaI7/31tU9+9POgsCTAcUyN51s6KwkHExlCiGDnOA==',key_name='tempest-keypair-273654',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:16:54Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ebd24b443df4c99bc3cc60c079c474b',ramdisk_id='',reservation_id='r-bqc0pv74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1395059374',owner_user_name='tempest-SnapshotDataIntegrityTests-1395059374-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49b9832df5614177bdd2c91a1ecc6390',uuid=a9f98c83-dbd6-4189-8292-4a14792117d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:10.355408 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Converting VIF {"id": "fe71007a-262f-4792-9fda-3690719ffbd2", "address": "fa:16:3e:fe:92:3a", "network": {"id": "491d2881-c6be-4a41-8ab3-20a4fb939020", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1521044331-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4ebd24b443df4c99bc3cc60c079c474b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe71007a-26", "ovs_interfaceid": "fe71007a-262f-4792-9fda-3690719ffbd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:10.355808 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:10.356082 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:10.357299 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:10.357548 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe71007a-26, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:10.358599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:10.359537 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:10.360216 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:10.360340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9e3f3f8-b335-474d-ad16-6ef26903b3cf) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:10.360855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:10.361253 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:10.361607 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:10.363024 np0000003830 nova-compute[98984]: INFO os_vif [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:92:3a,bridge_name='br-int',has_traffic_filtering=True,id=fe71007a-262f-4792-9fda-3690719ffbd2,network=Network(491d2881-c6be-4a41-8ab3-20a4fb939020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe71007a-26')
Jun 27 04:19:10.363510 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Deleting instance files /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2_del
Jun 27 04:19:10.364075 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Deletion of /opt/stack/data/nova/instances/a9f98c83-dbd6-4189-8292-4a14792117d2_del complete
Jun 27 04:19:10.526678 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:10.534533 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:10.534533 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attaching volume 8f6390d4-a0db-489c-ac30-faae059a4aef to /dev/vdb
Jun 27 04:19:10.596602 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:10.599319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:19:10.618333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:10.661028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:19:10.661299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:19:10.668903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:19:10.670249 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe26:ae8a', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:feeb:56e4', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fe0b:d49', 'fe80::b0cb:92ff:fef0:4818', 'fe80::fc16:3eff:fe89:b85', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe52:eb2b', 'fe80::a810:fdff:fe5d:dd65'] 
Jun 27 04:19:10.670384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:19:10.670506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:19:10.670764 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:10.671004 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating existing volume attachment record: c6772e63-23af-4474-8c29-e3390dc8c0b9 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:19:10.872515 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Took 1.35 seconds to destroy the instance on the hypervisor.
Jun 27 04:19:10.873249 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:19:10.873448 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:19:10.873587 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:19:10.873884 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:10.934345 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:11.245966 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:19:11.247786 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:19:11.248007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:11.248193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:11.248640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:11.248922 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:19:11.259608 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:11.260287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:11.261014 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:11.261014 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:11.261526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:11.261787 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:11.274676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:11.274676 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:11.279573 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:11.279573 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef] added
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:11.285990 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:11.286757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:11.286757 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:11.286757 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef] added
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:11.290429 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:11.290673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:11.291137 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:11.291137 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:11.333825 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-125efa38-75c6-4245-a59b-4231d9af2c0e req-5a6c6a8c-1dd3-456a-9f4d-1306233e0a98 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-deleted-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:11.334937 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-125efa38-75c6-4245-a59b-4231d9af2c0e req-5a6c6a8c-1dd3-456a-9f4d-1306233e0a98 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Neutron deleted interface fe71007a-262f-4792-9fda-3690719ffbd2; detaching it from the instance and deleting it from the info cache
Jun 27 04:19:11.336455 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-125efa38-75c6-4245-a59b-4231d9af2c0e req-5a6c6a8c-1dd3-456a-9f4d-1306233e0a98 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Detach interface failed, port_id=fe71007a-262f-4792-9fda-3690719ffbd2, reason: Instance a9f98c83-dbd6-4189-8292-4a14792117d2 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:19:11.557972 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:11.558573 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:11.748042 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c4e79de-7561-472e-835a-c2a291725d65 req-0e7213d2-397e-451f-92f2-381934721955 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:11.748277 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c4e79de-7561-472e-835a-c2a291725d65 req-0e7213d2-397e-451f-92f2-381934721955 service nova] Acquiring lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:11.748424 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c4e79de-7561-472e-835a-c2a291725d65 req-0e7213d2-397e-451f-92f2-381934721955 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:11.748797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c4e79de-7561-472e-835a-c2a291725d65 req-0e7213d2-397e-451f-92f2-381934721955 service nova] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:11.748797 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c4e79de-7561-472e-835a-c2a291725d65 req-0e7213d2-397e-451f-92f2-381934721955 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] No waiting events found dispatching network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:11.748900 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c4e79de-7561-472e-835a-c2a291725d65 req-0e7213d2-397e-451f-92f2-381934721955 service nova] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Received event network-vif-unplugged-fe71007a-262f-4792-9fda-3690719ffbd2 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:11.791490 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:12.062889 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid 91bf4758-53d5-47c3-bdf2-02127b907893 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:12.286873 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:12.291347 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:12.293448 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Took 1.42 seconds to deallocate network for instance.
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:12.299140 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:12.307583 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.313724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.321030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.330314 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.330314 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.330314 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.330314 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.330314 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:12.330670 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.330670 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.330670 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.330670 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.330670 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:12.336403 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.336403 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.336403 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.336403 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.336403 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:12.336767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.336767 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.336767 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.336767 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.336767 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:12.372299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260]
Jun 27 04:19:12.372299 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:12.372299 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.372920 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260]
Jun 27 04:19:12.372920 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:12.372920 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.385521 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.390186 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.399958 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.400185 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:12.400441 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:12.400598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:12.401321 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('9', '-', '-', 0) found on session 154 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:12.401542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.406757 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:12.407018 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:12.407210 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:12.407210 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:12.407859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('10', '-', '-', 0) found on session 155 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:12.407972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:12.417292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 154 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:12.417292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:12.422508 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 155 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:12.685306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:12.685743 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:12.685743 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:12.685830 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:12.685925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:12.687901 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Terminating instance
Jun 27 04:19:12.801469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:12.801775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:13.066956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:13.067215 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:13.068751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:13.191027 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:19:13.208719 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:13.211307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:13.227759 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:13.232108 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:13.254330 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:13.422059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 155 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:13.422447 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:13.510075 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999678110999866 future=<Future at 0x7ec518770f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:13.512803 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Instance destroyed successfully.
Jun 27 04:19:13.513279 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lazy-loading 'resources' on Instance uuid f5f5d222-bc04-45ff-b423-bef50fa2f194 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:13.570407 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:13.807127 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-unplugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:13.807598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:13.807598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:13.807685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:13.807801 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] No waiting events found dispatching network-vif-unplugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:13.807937 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-unplugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:13.808088 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-unplugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:13.808454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] Acquiring lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:13.808601 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:13.808700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:13.808794 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] No waiting events found dispatching network-vif-unplugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:13.808893 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-178e89d3-afb9-4618-ae2c-0e2bc647782f req-cef9d3ff-8c49-4d33-8ca0-5f18865cf02e service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-unplugged-b9e85a43-9c6f-4bed-aebb-03b4bc89585a for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:13.833235 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:13.833403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:14.015817 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1622722981',display_name='tempest-TestEncryptedCinderVolumes-server-1622722981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1622722981',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsGuYAtkCdSCeUm1e9x/7IhI6dv1gxiRaf6f4/jUexIJOkLhPSANlh1EzXGMPP3YjTRnxQcb46OkyH9pc9NE32yzfyqOtfMAGLmxJ1JA/q2963Zqpc/xOBe5tzTDFM8Dg==',key_name='tempest-TestEncryptedCinderVolumes-131351821',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:33Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47d99f8411b741b2ae3a730bfefef27b',ramdisk_id='',reservation_id='r-bhukd6kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-1089025697',owner_user_name='tempest-TestEncryptedCinderVolumes-1089025697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:18:33Z,user_data=None,user_id='db2d0b5572c9405aafaa0091643121a6',uuid=f5f5d222-bc04-45ff-b423-bef50fa2f194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:14.016046 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converting VIF {"id": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "address": "fa:16:3e:0b:0d:49", "network": {"id": "ea814379-2271-486e-9b40-09a6918045e3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1669881709-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "47d99f8411b741b2ae3a730bfefef27b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9e85a43-9c", "ovs_interfaceid": "b9e85a43-9c6f-4bed-aebb-03b4bc89585a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:14.016490 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:14.016717 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:14.017712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.017892 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9e85a43-9c, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:14.018843 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.019505 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:14.020121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.020754 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.020864 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1af0af4-daac-43df-bc4d-060fa5c0b59f) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:14.021284 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.021765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:14.022153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.024386 np0000003830 nova-compute[98984]: INFO os_vif [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:0d:49,bridge_name='br-int',has_traffic_filtering=True,id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a,network=Network(ea814379-2271-486e-9b40-09a6918045e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9e85a43-9c')
Jun 27 04:19:14.027370 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:14.027661 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:14.027803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:14.077615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.276s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:14.137070 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Deleted allocations for instance a9f98c83-dbd6-4189-8292-4a14792117d2
Jun 27 04:19:14.158065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:14.158236 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:14.158419 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Attaching volume b93036b7-b51e-4e2a-96f4-b73ede8e61ce to /dev/vdb
Jun 27 04:19:14.194326 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:14.204799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:19:14.225875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:14.269204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:19:14.269452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:19:14.277738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found WWN 330000000fe904d7e for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:19:14.278747 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:14.279487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:19:14.282321 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe26:ae8a', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:feeb:56e4', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fe89:b85', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe52:eb2b', 'fe80::a810:fdff:fe5d:dd65'] 
Jun 27 04:19:14.282450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:19:14.282599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:19:14.282795 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:14.283026 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Updating existing volume attachment record: 440e8f5c-aebc-406e-b994-b551da0416c1 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:19:14.285715 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.258s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:14.286450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000fe904d7e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000fe904d7e'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:14.286693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff8eb322-2d18-49c7-81fb-c20ed370fc25', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:14.286908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fe904d7e', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000fe904d7e'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:19:14.287253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:14.291207 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:19:14.291431 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:19:14.291619 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:19:14.310171 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.luks [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 27 04:19:14.310483 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:19:14.310639 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:19:14.310756 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:19:14.311226 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7ec538130aa0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:19:14.311331 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98984) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:14.316970 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsi session list stdout=tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25 (non-flash)
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:14.317230 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:14.317353 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '155')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:14.317406 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '147')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:14.318418 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25', '146')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:14.319250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518192660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:14.319587 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:19:14.319846 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Flush multipath device 330000000d1d499d8 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:19:14.337402 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'flavor' on Instance uuid b7c534a5-7cfd-40d5-b88d-82faa79600fd {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:14.359975 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:14.404827 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:14.470346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:19:14.470346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:19:14.470346 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:19:14.483298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:19:14.483515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:14.499332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.528374 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.40.100,3260]
Jun 27 04:19:14.528374 np0000003830 nova-compute[98984]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:14.528374 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.542678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.552683 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.579772 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.50.100,3260]
Jun 27 04:19:14.579772 np0000003830 nova-compute[98984]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-ff8eb322-2d18-49c7-81fb-c20ed370fc25, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:14.579772 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.595802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.596879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:14.597078 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] <== disconnect_volume: return (569ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:14.597339 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:14.597788 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Deleting instance files /opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194_del
Jun 27 04:19:14.598275 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Deletion of /opt/stack/data/nova/instances/f5f5d222-bc04-45ff-b423-bef50fa2f194_del complete
Jun 27 04:19:14.642301 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:14.841735 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Ignoring supplied device name: /dev/vdb
Jun 27 04:19:14.844903 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:19:14.845232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:14.845439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:14.845953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:14.846091 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:19:14.857410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:14.861519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:14.861519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:14.861519 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:14.861519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:14.861519 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:14.876424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:14.876424 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.883993 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:14.883993 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce] added
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:14.888675 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.888943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:14.889102 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:14.889282 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce] added
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:14.894102 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:14.894343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:14.894406 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:14.894507 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:15.104482 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Took 1.91 seconds to destroy the instance on the hypervisor.
Jun 27 04:19:15.105440 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:19:15.105862 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:19:15.106028 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:19:15.106750 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:15.148240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-29906762-6a2d-4d30-ba44-1576b0bfafff tempest-SnapshotDataIntegrityTests-1395059374 tempest-SnapshotDataIntegrityTests-1395059374-project-member] Lock "a9f98c83-dbd6-4189-8292-4a14792117d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.135s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:15.166703 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:15.345112 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:15.879224 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b64924e1-4f7a-4e8b-b9f5-ba37a64bc11a req-1ce443a9-1cae-4a97-9353-3ee4611cd3e2 service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Received event network-vif-deleted-b9e85a43-9c6f-4bed-aebb-03b4bc89585a {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:15.881823 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-b64924e1-4f7a-4e8b-b9f5-ba37a64bc11a req-1ce443a9-1cae-4a97-9353-3ee4611cd3e2 service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Neutron deleted interface b9e85a43-9c6f-4bed-aebb-03b4bc89585a; detaching it from the instance and deleting it from the info cache
Jun 27 04:19:15.881823 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b64924e1-4f7a-4e8b-b9f5-ba37a64bc11a req-1ce443a9-1cae-4a97-9353-3ee4611cd3e2 service nova] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Detach interface failed, port_id=b9e85a43-9c6f-4bed-aebb-03b4bc89585a, reason: Instance f5f5d222-bc04-45ff-b423-bef50fa2f194 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:19:15.889750 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:15.895059 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:15.903146 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:15.912352 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:15.917907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:15.928925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:15.936358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.936358 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.936358 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.936358 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.936358 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:15.936659 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.936659 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.936659 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.936659 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.936659 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:15.952887 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.952887 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.952887 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.952887 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.952887 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:15.953145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.953145 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:15.953145 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.953145 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:15.953145 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:15.976262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.50.100,3260]
Jun 27 04:19:15.976262 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:15.976262 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:15.994526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:15.999488 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.40.100,3260]
Jun 27 04:19:15.999488 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:15.999488 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.008148 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.008416 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:16.008815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:16.008946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:16.009661 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] HCTL ('7', '-', '-', 0) found on session 156 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:16.009762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:16.010808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:16.023996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 156 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.033624 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:16.033915 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:16.034172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:16.034330 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:16.035080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] HCTL ('8', '-', '-', 0) found on session 157 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:16.035178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:16.049072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 157 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:16.049072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:16.056974 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:16.424567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:16.424763 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:16.425012 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Attaching volume 03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d to /dev/vdb
Jun 27 04:19:16.464695 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:16.476412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:19:16.499709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:16.552320 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:19:16.552911 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:19:16.560018 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:19:16.566343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:19:16.567394 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe26:ae8a', 'fe80::419:d6ff:fe7a:6f35', 'fe80::fc16:3eff:feeb:56e4', 'fe80::6cf6:a3ff:fec7:f4cf', 'fe80::fc16:3eff:fe89:b85', 'fe80::6076:6eff:feb8:1925', 'fe80::fc16:3eff:fe52:eb2b', 'fe80::a810:fdff:fe5d:dd65'] 
Jun 27 04:19:16.567528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:19:16.567636 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:19:16.567974 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:16.568117 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updating existing volume attachment record: a02361d9-37b3-45ff-b09a-a83110cdb273 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:19:17.023801 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Searching for a device in session 156 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:17.024233 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:17.112984 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Took 0.55 seconds to detach 1 volumes for instance.
Jun 27 04:19:17.126851 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:19:17.127112 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:17.127339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:17.619490 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:17.619735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:17.649508 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:17.876289 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found WWN 3300000008d2030e1 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:19:17.877196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:17.877196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000008d2030e1', 'path': '/dev/dm-0', 'multipath_id': '3300000008d2030e1'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:17.877196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008d2030e1', 'path': '/dev/dm-0', 'multipath_id': '3300000008d2030e1'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:19:17.877604 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.750s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:17.877869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:19:17.880461 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid 91bf4758-53d5-47c3-bdf2-02127b907893 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:17.889588 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:17.890131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:17.890700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:17.891163 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:17.891345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:17.891831 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:17.901923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:17.902231 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:17.904207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:17.904207 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:17.909207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:17.909207 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d] added
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:17.915435 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:17.915799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:17.915799 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:17.915981 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d] added
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:17.919526 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:17.919892 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:17.919941 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:17.920093 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:18.175979 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:19:18.175979 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:19:18.175979 np0000003830 nova-compute[98984]:     <volume>8f6390d4-a0db-489c-ac30-faae059a4aef</volume>
Jun 27 04:19:18.175979 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:19:18.175979 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:19:18.175979 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:19:18.181696 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:18.383784 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Attempting to attach volume b93036b7-b51e-4e2a-96f4-b73ede8e61ce with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]:   <alias name="ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce"/>
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]:   <serial>b93036b7-b51e-4e2a-96f4-b73ede8e61ce</serial>
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:18.385365 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:19:18.406069 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:18.684537 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attempting to attach volume 8f6390d4-a0db-489c-ac30-faae059a4aef with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   <alias name="ua-8f6390d4-a0db-489c-ac30-faae059a4aef"/>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   <serial>8f6390d4-a0db-489c-ac30-faae059a4aef</serial>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="6854b993-7fe9-4348-9eac-749109231aa8"/>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:18.686097 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:19:18.913130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.293s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:18.916738 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:18.920666 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:18.931379 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:18.938785 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:18.946891 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:18.955045 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.962984 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.963355 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.971327 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:18.971585 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:18.988300 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Deleted allocations for instance f5f5d222-bc04-45ff-b423-bef50fa2f194
Jun 27 04:19:19.015863 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.50.100,3260]
Jun 27 04:19:19.015863 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:19.015863 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:19.016553 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.40.100,3260]
Jun 27 04:19:19.016553 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:19.016553 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:19.028457 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:19.033588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:19.037870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.049215 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:19.049648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:19.050618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] HCTL ('14', '-', '-', 0) found on session 159 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:19.050704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.055584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:19.055802 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:19.055967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:19.056036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:19.056749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] HCTL ('13', '-', '-', 0) found on session 158 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:19.056879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:19.066563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching for a device in session 159 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:19.066749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:19.073163 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Searching for a device in session 158 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:19.073163 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:19.482177 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:19.644936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:19.891476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:19:19.998578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-257eaec2-4ee1-4ea3-b89b-9ef67eb8df43 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Lock "f5f5d222-bc04-45ff-b423-bef50fa2f194" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.313s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:20.025403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:20.025831 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:20.025942 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:20.026044 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] No VIF found with MAC fa:16:3e:eb:56:e4, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:19:20.154526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:20.155905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:20.155905 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:20.157044 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98984) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 27 04:19:20.157200 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'flavor' on Instance uuid 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:20.907059 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Found WWN 3300000007c2ce459 for multipath device dm-5 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:19:20.907458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:20.907458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== connect_volume: return (3779ms) {'type': 'block', 'scsi_wwn': '3300000007c2ce459', 'path': '/dev/dm-5', 'multipath_id': '3300000007c2ce459'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:20.907458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c2ce459', 'path': '/dev/dm-5', 'multipath_id': '3300000007c2ce459'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:19:20.910072 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'flavor' on Instance uuid b7c534a5-7cfd-40d5-b88d-82faa79600fd {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:21.181171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:21.192932 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:21.194764 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:21.195174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:21.195174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:21.195174 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:26:ae:8a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:19:21.215184 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:21.217507 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:21.240867 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:21.412638 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Attempting to attach volume 03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]:   <alias name="ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d"/>
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]:   <serial>03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d</serial>
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:21.414253 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:19:21.453038 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-85b60df4-34de-43a5-8089-27b50ac80c1a req-201a6685-a215-4a0a-82c6-56caf69ff96f service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-vif-unplugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:21.453289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-85b60df4-34de-43a5-8089-27b50ac80c1a req-201a6685-a215-4a0a-82c6-56caf69ff96f service nova] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:21.453467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-85b60df4-34de-43a5-8089-27b50ac80c1a req-201a6685-a215-4a0a-82c6-56caf69ff96f service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:21.453712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-85b60df4-34de-43a5-8089-27b50ac80c1a req-201a6685-a215-4a0a-82c6-56caf69ff96f service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:21.453936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-85b60df4-34de-43a5-8089-27b50ac80c1a req-201a6685-a215-4a0a-82c6-56caf69ff96f service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] No waiting events found dispatching network-vif-unplugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:21.454035 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-85b60df4-34de-43a5-8089-27b50ac80c1a req-201a6685-a215-4a0a-82c6-56caf69ff96f service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received unexpected event network-vif-unplugged-84730f36-2ee1-481f-b480-f80d5680fe84 for instance with vm_state active and task_state powering-off.
Jun 27 04:19:21.460140 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:21.598758 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999641775000327 future=<Future at 0x7ec5183f1790 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:21.601460 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance destroyed successfully.
Jun 27 04:19:21.601951 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:21.882927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97ecba84-8b92-454d-9b16-8750233bd549 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.725s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:22.103785 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:19:22.104273 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:22.617985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-11e72f73-ae5e-4ccf-aa4e-155fb27b91f0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.463s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:22.930196 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-37e2fedd-f7ab-478d-9ceb-6878d89f0aee tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.403s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:23.156734 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:23.157128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:23.157128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:23.157128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No VIF found with MAC fa:16:3e:89:0b:85, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:19:23.228883 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:23.229115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:23.527832 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-61ef714e-b3be-4203-8f27-e7bb94506206 req-6a8ca461-9f7e-4cfa-a340-fec9f75bc2c9 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-vif-unplugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:23.528030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-61ef714e-b3be-4203-8f27-e7bb94506206 req-6a8ca461-9f7e-4cfa-a340-fec9f75bc2c9 service nova] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:23.528282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-61ef714e-b3be-4203-8f27-e7bb94506206 req-6a8ca461-9f7e-4cfa-a340-fec9f75bc2c9 service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:23.528398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-61ef714e-b3be-4203-8f27-e7bb94506206 req-6a8ca461-9f7e-4cfa-a340-fec9f75bc2c9 service nova] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:23.528598 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-61ef714e-b3be-4203-8f27-e7bb94506206 req-6a8ca461-9f7e-4cfa-a340-fec9f75bc2c9 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] No waiting events found dispatching network-vif-unplugged-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:23.528817 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-61ef714e-b3be-4203-8f27-e7bb94506206 req-6a8ca461-9f7e-4cfa-a340-fec9f75bc2c9 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received unexpected event network-vif-unplugged-84730f36-2ee1-481f-b480-f80d5680fe84 for instance with vm_state stopped and task_state None.
Jun 27 04:19:23.731757 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Detaching volume b93036b7-b51e-4e2a-96f4-b73ede8e61ce
Jun 27 04:19:23.773506 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Attempting to driver detach volume b93036b7-b51e-4e2a-96f4-b73ede8e61ce from mountpoint /dev/vdb
Jun 27 04:19:23.778160 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found disk vdb by alias ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:19:23.782164 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Found disk vdb by alias ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:19:23.782325 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Attempting to detach device vdb from instance 91bf4758-53d5-47c3-bdf2-02127b907893 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:   <alias name="ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce"/>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:   <serial>b93036b7-b51e-4e2a-96f4-b73ede8e61ce</serial>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:23.782533 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:19:23.801133 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully detached device vdb from instance 91bf4758-53d5-47c3-bdf2-02127b907893 from the persistent domain config.
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] (1/8): Attempting to detach device vdb with device alias ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce from instance 91bf4758-53d5-47c3-bdf2-02127b907893 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:   <alias name="ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce"/>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:   <serial>b93036b7-b51e-4e2a-96f4-b73ede8e61ce</serial>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:23.802578 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:19:24.035247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:24.303485 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533964.3031223, 91bf4758-53d5-47c3-bdf2-02127b907893 => ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:19:24.307695 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b93036b7-b51e-4e2a-96f4-b73ede8e61ce for instance 91bf4758-53d5-47c3-bdf2-02127b907893 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:19:24.310292 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully detached device vdb from instance 91bf4758-53d5-47c3-bdf2-02127b907893 from the live domain config.
Jun 27 04:19:24.311689 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:24.316515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:24.316515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:24.316515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:24.316515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:24.316515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:24.341188 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:24.341823 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:24.346131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '159')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:24.346131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', '157')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:24.346131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce', '156')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:24.346131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518734b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:24.346131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:19:24.346131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Flush multipath device 3300000008d2030e1 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:19:24.382819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:24.447244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:24.505107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:19:24.505252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:19:24.506405 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:19:24.520135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:19:24.520135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:24.532003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:24.573675 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.40.100,3260]
Jun 27 04:19:24.573675 np0000003830 nova-compute[98984]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:24.573675 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:24.590809 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:24.604605 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:24.645851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.50.100,3260]
Jun 27 04:19:24.645851 np0000003830 nova-compute[98984]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-b93036b7-b51e-4e2a-96f4-b73ede8e61ce, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:24.645851 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:24.664044 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:24.664289 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:24.664396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] <== disconnect_volume: return (352ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:24.664514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:24.715937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-0dd088a3-a1e1-4207-b2ca-6a006fbd32c2 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.291s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:24.851210 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004992180001863744 future=<Future at 0x7ec5382ec710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:24.851450 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:24.851979 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Emitting event <LifecycleEvent: 1782533949.8502498, a9f98c83-dbd6-4189-8292-4a14792117d2 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:24.852114 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.6574868609995974 future=<Future at 0x7ec518770f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:24.852251 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=3.6573404739997386 future=<Future at 0x7ec518770f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:24.853092 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] VM Stopped (Lifecycle Event)
Jun 27 04:19:25.294427 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'flavor' on Instance uuid 91bf4758-53d5-47c3-bdf2-02127b907893 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:25.354781 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: a9f98c83-dbd6-4189-8292-4a14792117d2] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:25.386295 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Stashing vm_state: active {{(pid=98984) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
Jun 27 04:19:25.393620 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:25.951122 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:25.951364 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:26.299982 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a1b03a94-075c-4d9d-ace1-378b693a5c6a tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.071s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:26.457838 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:19:26.458336 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Claim successful on node np0000003830
Jun 27 04:19:26.549520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:26.549769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:26.549983 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:26.550131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:26.550279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:26.552188 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Terminating instance
Jun 27 04:19:26.735995 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:26.736240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:26.736465 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:26.736710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:26.736977 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:26.739117 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Terminating instance
Jun 27 04:19:26.963132 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating resource usage from migration d149a5a6-4887-459b-9ca3-a8db0938e5d9
Jun 27 04:19:27.054943 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:19:27.065701 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.081533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.083255 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.101907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.132048 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.242229 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:19:27.261166 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f3439a8-9cd9-4a6f-8175-86fa0734c039 req-1348eb57-8d5d-442e-9508-0b1aca9cadad service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-unplugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:27.261166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f3439a8-9cd9-4a6f-8175-86fa0734c039 req-1348eb57-8d5d-442e-9508-0b1aca9cadad service nova] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:27.261166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f3439a8-9cd9-4a6f-8175-86fa0734c039 req-1348eb57-8d5d-442e-9508-0b1aca9cadad service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:27.261166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0f3439a8-9cd9-4a6f-8175-86fa0734c039 req-1348eb57-8d5d-442e-9508-0b1aca9cadad service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:27.261166 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f3439a8-9cd9-4a6f-8175-86fa0734c039 req-1348eb57-8d5d-442e-9508-0b1aca9cadad service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] No waiting events found dispatching network-vif-unplugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:27.261166 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0f3439a8-9cd9-4a6f-8175-86fa0734c039 req-1348eb57-8d5d-442e-9508-0b1aca9cadad service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-unplugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:27.263755 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Instance destroyed successfully.
Jun 27 04:19:27.265012 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:27.269304 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:27.270034 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:27.395826 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999620686000071 future=<Future at 0x7ec5183f21b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:27.398544 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Instance destroyed successfully.
Jun 27 04:19:27.398994 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lazy-loading 'resources' on Instance uuid 91bf4758-53d5-47c3-bdf2-02127b907893 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:27.658596 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.767450 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-460433181',display_name='tempest-TestVolumeBootPattern-server-460433181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-460433181',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZqEYjgni6BbVYc/bno5NO/+aaOTHfQzS/cepa0LQhtafQgitkJNLE/W7elnp7MCpqIvqgIz+WZ2Ha9LmKmjwmcH0tKHVOBG0fkUxOx5oc8Uqhl7GY0vaC7qLWDgJ7MWg==',key_name='tempest-keypair-1392328707',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:37Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-i910ccyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:27.767792 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "84730f36-2ee1-481f-b480-f80d5680fe84", "address": "fa:16:3e:52:eb:2b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84730f36-2e", "ovs_interfaceid": "84730f36-2ee1-481f-b480-f80d5680fe84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:27.768576 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:27.768908 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:27.773007 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:27.777956 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.778359 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84730f36-2e, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:27.779300 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.780201 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:27.785393 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.786444 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.786928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6182c3ae-5c70-4b01-99fc-93eb305f989f) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:27.787605 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.788213 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:27.793449 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.795939 np0000003830 nova-compute[98984]: INFO os_vif [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:eb:2b,bridge_name='br-int',has_traffic_filtering=True,id=84730f36-2ee1-481f-b480-f80d5680fe84,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84730f36-2e')
Jun 27 04:19:27.798302 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:27.798671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:27.798891 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:27.799732 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:27.800424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77330dab-efd6-4e32-a925-c049014083ca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:27.800424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:27.827448 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca (non-flash)
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:27.827765 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:27.828027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '159')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:27.828027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '150')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:27.829180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca', '151')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:27.830066 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538138ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:27.830274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:19:27.830507 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 330000000308f8c7d {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:19:27.885959 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:27.901436 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1933885818',display_name='tempest-AttachVolumeNegativeTest-server-1933885818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-attachvolumenegativetest-server-1933885818',id=61,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHioXA2b7RxtlwtEpNLhnbpt5IrykYIuMvMA30/2+Di6rKbMu3kaV6r8SSo3kbWS2dPCfAX4n6Zs46qeu15FhaPTbpKb3ykeU49slin6+DtpF/Gd/OVQVXtnqyZvbh/S4w==',key_name='tempest-keypair-37067785',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:32Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbd1ebe1144a427082b2a28cd85def6b',ramdisk_id='',reservation_id='r-7hsd72vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-981489683',owner_user_name='tempest-AttachVolumeNegativeTest-981489683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a614c2dbe3dc443cab3c16539edca35c',uuid=91bf4758-53d5-47c3-bdf2-02127b907893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:27.901982 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converting VIF {"id": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "address": "fa:16:3e:eb:56:e4", "network": {"id": "5c0c044b-bb12-4be3-97d4-2013b8c30bf7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2038326023-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cbd1ebe1144a427082b2a28cd85def6b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ee3b9-7d", "ovs_interfaceid": "4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:27.902347 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:27.902604 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:27.903703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.904051 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d5ee3b9-7d, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=680bf0a8-93e8-4617-b9da-030110d17ed4) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: INFO os_vif [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:56:e4,bridge_name='br-int',has_traffic_filtering=True,id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9,network=Network(5c0c044b-bb12-4be3-97d4-2013b8c30bf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ee3b9-7d')
Jun 27 04:19:27.912038 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Deleting instance files /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893_del
Jun 27 04:19:27.933850 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Deletion of /opt/stack/data/nova/instances/91bf4758-53d5-47c3-bdf2-02127b907893_del complete
Jun 27 04:19:27.946747 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:27.974687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:19:27.974687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:19:27.975709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:19:27.987383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:19:27.987654 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:27.999137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:28.039221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.40.100,3260]
Jun 27 04:19:28.039221 np0000003830 nova-compute[98984]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:28.039221 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:28.054687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:28.069033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:28.103825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.50.100,3260]
Jun 27 04:19:28.103825 np0000003830 nova-compute[98984]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-77330dab-efd6-4e32-a925-c049014083ca, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:28.103825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:28.123464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:28.123762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:28.123889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (325ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:28.124004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:28.124316 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Deleting instance files /opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c_del
Jun 27 04:19:28.124849 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Deletion of /opt/stack/data/nova/instances/6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c_del complete
Jun 27 04:19:28.279357 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.328s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:28.279625 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Migrating
Jun 27 04:19:28.279912 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:19:28.443146 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:19:28.444055 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:19:28.444794 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:19:28.444930 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:19:28.445239 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:28.510236 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0006123850002950348 future=<Future at 0x7ec518770f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:28.510830 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Emitting event <LifecycleEvent: 1782533953.509509, f5f5d222-bc04-45ff-b423-bef50fa2f194 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:28.511015 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:28.511256 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] VM Stopped (Lifecycle Event)
Jun 27 04:19:28.512351 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=8.086030889000085 future=<Future at 0x7ec5183f1790 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:28.512607 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=8.085761226000159 future=<Future at 0x7ec5183f1790 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:28.555720 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:28.631425 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Took 1.39 seconds to destroy the instance on the hypervisor.
Jun 27 04:19:28.632591 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:19:28.632989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:19:28.633158 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:19:28.633444 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:28.749329 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:28.794715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:28.794715 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:28.794715 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:19:29.014203 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: f5f5d222-bc04-45ff-b423-bef50fa2f194] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:29.296752 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:29.330348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-unplugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:29.330405 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] Acquiring lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:29.330573 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:29.330728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] Lock "91bf4758-53d5-47c3-bdf2-02127b907893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:29.330830 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] No waiting events found dispatching network-vif-unplugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:29.330941 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-unplugged-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:29.331045 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Received event network-vif-deleted-4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:29.331168 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Neutron deleted interface 4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9; detaching it from the instance and deleting it from the info cache
Jun 27 04:19:29.333336 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-81f13710-486f-4624-99ac-05d958a71cc5 req-7e7f08e5-a082-49e9-af59-857689e1053d service nova] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Detach interface failed, port_id=4d5ee3b9-7d19-43b3-a395-ebd5903ec1c9, reason: Instance 91bf4758-53d5-47c3-bdf2-02127b907893 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:19:29.384845 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4b69b4c3-e946-4baf-845e-8eff81181d4b req-25215280-81ab-43bf-937c-302f6d34fe51 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Received event network-vif-deleted-84730f36-2ee1-481f-b480-f80d5680fe84 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:29.385293 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-4b69b4c3-e946-4baf-845e-8eff81181d4b req-25215280-81ab-43bf-937c-302f6d34fe51 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Neutron deleted interface 84730f36-2ee1-481f-b480-f80d5680fe84; detaching it from the instance and deleting it from the info cache
Jun 27 04:19:29.386963 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4b69b4c3-e946-4baf-845e-8eff81181d4b req-25215280-81ab-43bf-937c-302f6d34fe51 service nova] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Detach interface failed, port_id=84730f36-2ee1-481f-b480-f80d5680fe84, reason: Instance 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:19:29.475971 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:29.663698 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:29.830700 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:29.831143 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:29.978594 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Took 1.53 seconds to deallocate network for instance.
Jun 27 04:19:30.165636 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Took 1.53 seconds to deallocate network for instance.
Jun 27 04:19:30.207778 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:30.361170 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:30.485048 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:30.485195 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:30.743849 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Took 0.58 seconds to detach 1 volumes for instance.
Jun 27 04:19:30.808548 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:30.808947 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:30.863872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:19:31.006669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:31.006894 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:31.100909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:31.253897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:31.311703 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:31.509152 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Detaching volume 03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d
Jun 27 04:19:31.590570 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Attempting to driver detach volume 03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d from mountpoint /dev/vdb
Jun 27 04:19:31.595649 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Found disk vdb by alias ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:19:31.596965 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Found disk vdb by alias ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:19:31.597072 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Attempting to detach device vdb from instance b7c534a5-7cfd-40d5-b88d-82faa79600fd from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:   <alias name="ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d"/>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:   <serial>03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d</serial>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:31.597277 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:19:31.606693 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully detached device vdb from instance b7c534a5-7cfd-40d5-b88d-82faa79600fd from the persistent domain config.
Jun 27 04:19:31.606873 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] (1/8): Attempting to detach device vdb with device alias ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d from instance b7c534a5-7cfd-40d5-b88d-82faa79600fd from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:   <alias name="ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d"/>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-5"/>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:   <serial>03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d</serial>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:19:31.607128 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:19:31.817807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.332s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:31.819377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.564s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:31.827947 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:31.828269 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:31.830024 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:31.831827 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:31.904515 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Deleted allocations for instance 91bf4758-53d5-47c3-bdf2-02127b907893
Jun 27 04:19:32.116623 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:32.116835 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:32.131077 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782533972.1307316, b7c534a5-7cfd-40d5-b88d-82faa79600fd => ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:19:32.132314 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d for instance b7c534a5-7cfd-40d5-b88d-82faa79600fd {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:19:32.139382 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully detached device vdb from instance b7c534a5-7cfd-40d5-b88d-82faa79600fd from the live domain config.
Jun 27 04:19:32.140567 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:32.140891 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:32.141071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:32.141449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:32.141790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:32.141936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:32.165817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.165817 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.165817 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:32.165817 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:32.165817 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:32.166082 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.166082 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.166082 np0000003830 nova-compute[98984]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:32.166082 np0000003830 nova-compute[98984]: tcp: [159] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d (non-flash)
Jun 27 04:19:32.166082 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:32.166198 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '155'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '158'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '159')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:32.166385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '158')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:32.168391 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', '159')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:32.169230 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181d14e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:32.169457 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Removing multipathed devices sdh, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:19:32.169733 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Flush multipath device 3300000007c2ce459 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:19:32.209134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:32.258300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:32.314871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:19:32.315084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:19:32.315858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:19:32.327850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:19:32.328072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:32.339413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.366779 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.40.100,3260]
Jun 27 04:19:32.366779 np0000003830 nova-compute[98984]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:32.366779 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.375740 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Starting migrate_disk_and_power_off {{(pid=98984) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12623}}
Jun 27 04:19:32.382238 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.392480 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.394363 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.394820 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.411191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.432898 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.445678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.50.100,3260]
Jun 27 04:19:32.445678 np0000003830 nova-compute[98984]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:32.445678 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.462117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.463270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:32.463270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== disconnect_volume: return (322ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:32.463270 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:32.543729 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f5d068e0-4acd-49f7-8c90-4cada2d43969 req-42216a1a-3754-4658-b6dc-09ce269d73dd service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:32.544147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f5d068e0-4acd-49f7-8c90-4cada2d43969 req-42216a1a-3754-4658-b6dc-09ce269d73dd service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:32.544313 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f5d068e0-4acd-49f7-8c90-4cada2d43969 req-42216a1a-3754-4658-b6dc-09ce269d73dd service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:32.544465 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f5d068e0-4acd-49f7-8c90-4cada2d43969 req-42216a1a-3754-4658-b6dc-09ce269d73dd service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:32.544607 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f5d068e0-4acd-49f7-8c90-4cada2d43969 req-42216a1a-3754-4658-b6dc-09ce269d73dd service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:32.544706 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-f5d068e0-4acd-49f7-8c90-4cada2d43969 req-42216a1a-3754-4658-b6dc-09ce269d73dd service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state active and task_state resize_migrating.
Jun 27 04:19:32.619131 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:32.714585 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999580373000299 future=<Future at 0x7ec5382837a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:32.717256 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance destroyed successfully.
Jun 27 04:19:32.718743 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:29Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:32.719012 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:32.719793 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:32.720084 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:32.721071 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.721285 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00c7251a-b1, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:32.722211 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.723196 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:32.723591 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.724198 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.724366 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=815e4ff1-0c76-4cc0-8850-a8b47b0e0375) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:32.724795 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.725380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:32.725542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:32.727534 np0000003830 nova-compute[98984]: INFO os_vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1')
Jun 27 04:19:32.730390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:32.730724 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:32.730856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:32.731146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:32.731442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:32.731593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:32.753521 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.753521 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.753521 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: tcp: [155] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '154'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '155')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '154')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '155')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538418540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:19:32.758146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flush multipath device 330000000fe904d7e {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:19:32.796005 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:32.839030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:32.890047 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:19:32.890207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:19:32.890819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:19:32.903075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:19:32.903194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:32.914854 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.915703 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b11e3d70-766f-4543-b22e-05f9138c1c16 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Lock "91bf4758-53d5-47c3-bdf2-02127b907893" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.366s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:32.938436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260]
Jun 27 04:19:32.938436 np0000003830 nova-compute[98984]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:32.938436 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.951606 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.963935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.988664 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260]
Jun 27 04:19:32.988664 np0000003830 nova-compute[98984]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:32.988664 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.998464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:32.999451 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:32.999620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== disconnect_volume: return (268ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:32.999733 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:33.002339 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:33.032741 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'flavor' on Instance uuid b7c534a5-7cfd-40d5-b88d-82faa79600fd {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:33.091566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:33.092378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:33.127176 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.309s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:33.188263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:33.188657 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:19:33.189212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_resize/disk /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:33.205567 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c
Jun 27 04:19:33.365018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "cp -r /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_resize/disk /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk" returned: 0 in 0.176s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:33.365379 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_resize/disk.config /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:33.410751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "cp -r /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_resize/disk.config /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config" returned: 0 in 0.045s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:33.411300 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_resize/disk.info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:33.457178 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "cp -r /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_resize/disk.info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:33.830576 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:34.041814 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e08006f3-006c-4e73-b580-1db03a875f21 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:34.042676 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.941s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:34.043093 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:34.043307 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:34.043535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:34.045674 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Terminating instance
Jun 27 04:19:34.217893 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-dc6422ae-3d3c-4a91-9de1-43a4c5496bcd tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.482s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:34.338916 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:34.339051 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:34.339226 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:34.339370 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:19:34.553651 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:19:34.572328 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.592077 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.597384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.617938 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.629363 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:34.629363 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:34.647395 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9ca6320-88c2-42ac-8e84-69e35b7cd14e req-a4905968-cea5-4400-bda7-907432a390d7 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:34.647622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9ca6320-88c2-42ac-8e84-69e35b7cd14e req-a4905968-cea5-4400-bda7-907432a390d7 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:34.647792 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9ca6320-88c2-42ac-8e84-69e35b7cd14e req-a4905968-cea5-4400-bda7-907432a390d7 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:34.651451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a9ca6320-88c2-42ac-8e84-69e35b7cd14e req-a4905968-cea5-4400-bda7-907432a390d7 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:34.651451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a9ca6320-88c2-42ac-8e84-69e35b7cd14e req-a4905968-cea5-4400-bda7-907432a390d7 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:34.651451 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a9ca6320-88c2-42ac-8e84-69e35b7cd14e req-a4905968-cea5-4400-bda7-907432a390d7 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state active and task_state resize_migrating.
Jun 27 04:19:34.704147 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Port 00c7251a-b156-475a-99a5-48dafe19e9b6 binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:19:34.836656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.863756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.868356 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.883585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:34.916991 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999623420999797 future=<Future at 0x7ec5381a3d70 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:34.919981 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Instance destroyed successfully.
Jun 27 04:19:34.920720 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lazy-loading 'resources' on Instance uuid b7c534a5-7cfd-40d5-b88d-82faa79600fd {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:35.166304 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.172224 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.173789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.194764 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.200896 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.289147 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.312300 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.363603 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:35.425648 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1790760693',display_name='tempest-VolumesSnapshotTestJSON-instance-1790760693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumessnapshottestjson-instance-1790760693',id=63,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrEyzVlf7zwgIi9BvnCH6sYfJiEPjU01LPGu4rBUcXTIl/b9VMo2dQsNmS0QWR13mJ74S6XhIrmQDzJZiMP1+2g6Ltc5elqVz7DHnsBT57DXrHoRKZ5wCb4PmF+0QyAYw==',key_name='tempest-keypair-718229701',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:36Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98005db8eb3947d8b16d88f66930edd4',ramdisk_id='',reservation_id='r-eczh80qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2040432487',owner_user_name='tempest-VolumesSnapshotTestJSON-2040432487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b37634a5befb4243a59d1ea76d47aa7a',uuid=b7c534a5-7cfd-40d5-b88d-82faa79600fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:35.425911 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converting VIF {"id": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "address": "fa:16:3e:89:0b:85", "network": {"id": "57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1774929885-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "98005db8eb3947d8b16d88f66930edd4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f94b6be-51", "ovs_interfaceid": "4f94b6be-5110-40ba-93f8-3fd23be38eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:35.426795 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:35.427107 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:35.429927 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.430414 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f94b6be-51, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:35.431843 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.433302 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:35.434960 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.435152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b619ce73-7ace-443e-abe1-ddcd45f7a9fa) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:35.435693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:35.436373 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:35.438373 np0000003830 nova-compute[98984]: INFO os_vif [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:0b:85,bridge_name='br-int',has_traffic_filtering=True,id=4f94b6be-5110-40ba-93f8-3fd23be38eb1,network=Network(57a05e97-30ea-4f8d-aba2-ad9dcbb4a60e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f94b6be-51')
Jun 27 04:19:35.442556 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:35.442995 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:35.443172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:35.443691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:35.444089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:35.444281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:35.449420 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:35.450164 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:35.464205 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Jun 27 04:19:35.464205 np0000003830 nova-compute[98984]: 
Jun 27 04:19:35.475977 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:19:35.475977 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:35.476207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:19:35.476207 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:35.476401 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:19:35.476401 np0000003830 nova-compute[98984]: 
Jun 27 04:19:35.476660 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Sessions list: [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:35.476894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:35.477057 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:19:35.477198 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d, 0): [] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:35.477517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03a80eb0-a0ff-4a6a-9eba-79b4f4b30b1d') {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
Jun 27 04:19:35.477693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518191760>, {}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:35.477875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Disconnecting from: [] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:35.478425 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:35.478611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] <== disconnect_volume: return (35ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:35.478831 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:35.479368 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Deleting instance files /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd_del
Jun 27 04:19:35.480203 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Deletion of /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd_del complete
Jun 27 04:19:35.535776 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json" returned: 1 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:35.536026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk --force-share --output=json' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:19:35.538085 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000003f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/b7c534a5-7cfd-40d5-b88d-82faa79600fd/disk
Jun 27 04:19:35.542308 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:35.641277 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:35.641774 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:35.713448 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:19:35.722787 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:35.723606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:35.723775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:35.730696 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:35.731609 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:19:35.736807 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:19:35.737914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:35.791448 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:35.791918 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51539MB free_disk=72.04028701782227GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:19:35.792075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:35.792320 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:35.989001 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Took 1.44 seconds to destroy the instance on the hypervisor.
Jun 27 04:19:35.990524 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:19:35.990732 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:19:35.990844 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:19:35.991221 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:36.054927 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:36.599004 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0006068399998184759 future=<Future at 0x7ec5183f1790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:36.602437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ce88f13c-9d5c-405d-a644-4ed05331be5a req-f6888bf8-1d9a-43a3-abcc-49b460bfe17f service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-deleted-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.602948 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782533961.598281, 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:36.603046 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:36.603354 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-ce88f13c-9d5c-405d-a644-4ed05331be5a req-f6888bf8-1d9a-43a3-abcc-49b460bfe17f service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Neutron deleted interface 4f94b6be-5110-40ba-93f8-3fd23be38eb1; detaching it from the instance and deleting it from the info cache
Jun 27 04:19:36.603672 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] VM Stopped (Lifecycle Event)
Jun 27 04:19:36.605765 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.789638586999899 future=<Future at 0x7ec5183f21b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:36.605969 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.789481840999997 future=<Future at 0x7ec5183f21b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:36.606899 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ce88f13c-9d5c-405d-a644-4ed05331be5a req-f6888bf8-1d9a-43a3-abcc-49b460bfe17f service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Detach interface failed, port_id=4f94b6be-5110-40ba-93f8-3fd23be38eb1, reason: Instance b7c534a5-7cfd-40d5-b88d-82faa79600fd could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:19:36.705259 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.705311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:36.705515 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:36.705701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:36.705932 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:36.706065 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:36.706247 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.707162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:36.708449 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:36.708449 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:36.708449 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:36.708449 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:36.708449 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.708967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:36.708967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:36.708967 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:36.709126 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:36.709304 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received unexpected event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with vm_state active and task_state deleting.
Jun 27 04:19:36.709458 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.709639 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:36.709957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:36.710130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:36.710578 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:36.710756 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received unexpected event network-vif-plugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with vm_state active and task_state deleting.
Jun 27 04:19:36.710929 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.711124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:36.711337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:36.711490 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:36.711671 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:36.711842 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:36.712007 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:36.712212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Acquiring lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:36.712389 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:36.712536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:36.712713 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] No waiting events found dispatching network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:36.712859 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-402722a4-8e4a-4384-b0f3-452199b4891c req-11bd3f50-4469-41f8-a3f4-fe5f227c9dec service nova] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Received event network-vif-unplugged-4f94b6be-5110-40ba-93f8-3fd23be38eb1 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:19:36.735632 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:36.798544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:36.798663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:36.798815 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:19:36.802044 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Applying migration context for instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 as it has an incoming, in-progress migration d149a5a6-4887-459b-9ca3-a8db0938e5d9. Migration status is post-migrating {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
Jun 27 04:19:36.802770 np0000003830 nova-compute[98984]: INFO nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating resource usage from migration d149a5a6-4887-459b-9ca3-a8db0938e5d9
Jun 27 04:19:36.870915 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance b7c534a5-7cfd-40d5-b88d-82faa79600fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:19:36.870915 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Migration d149a5a6-4887-459b-9ca3-a8db0938e5d9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
Jun 27 04:19:36.870915 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:19:36.871166 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 3 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:19:36.871166 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1088MB phys_disk=95GB used_disk=3GB total_vcpus=16 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:19:35 up 42 min,  2 users,  load average: 5.74, 7.80, 6.25\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_resize_migrated': '1', 'num_os_type_None': '2', 'num_proj_56c1eb5f65f0446eae1f4967af349cd1': '1', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_98005db8eb3947d8b16d88f66930edd4': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:19:36.976046 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:37.077177 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:37.077465 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:37.107340 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d906fc62-3219-48fc-b053-419526bbcab0 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6c9f9ae4-4c9c-4582-9efd-449eb82b4c4c] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:37.301012 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:37.477932 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Took 1.49 seconds to deallocate network for instance.
Jun 27 04:19:37.496457 np0000003830 nova-compute[98984]: WARNING nova.volume.cinder [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Attachment a02361d9-37b3-45ff-b09a-a83110cdb273 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a02361d9-37b3-45ff-b09a-a83110cdb273. (HTTP 404) (Request-ID: req-0003ca6c-ce55-4634-b02f-15f6c8e75f2e)
Jun 27 04:19:37.496838 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Took 0.02 seconds to detach 1 volumes for instance.
Jun 27 04:19:37.580550 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:37.626321 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:37.751868 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:38.003885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:38.087274 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:19:38.087434 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.295s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:38.087834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.084s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:38.088170 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:38.253944 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:19:38.277262 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:38.278076 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:38.640842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:38.761107 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:38.772688 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:19:38.780234 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:38.798771 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:38.843843 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:19:38.843969 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:19:38.853049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:19:38.854701 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f'] 
Jun 27 04:19:38.854928 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:19:38.854928 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:19:38.855239 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:39.288945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.201s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:39.341480 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Deleted allocations for instance b7c534a5-7cfd-40d5-b88d-82faa79600fd
Jun 27 04:19:39.889609 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:39.889994 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:39.973978 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Starting finish_migration {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12810}}
Jun 27 04:19:39.975356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance directory exists: not creating {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}}
Jun 27 04:19:39.975467 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Creating image(s)
Jun 27 04:19:39.976479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:40.066664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:40.067221 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:19:40.067536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:40.089459 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:40.090272 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:40.090656 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:40.090936 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:40.091250 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:19:40.091737 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.74 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:40.159023 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:40.160207 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:19:40.352935 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-80da70b3-9167-402c-a88d-dd9ce7d87976 tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Lock "b7c534a5-7cfd-40d5-b88d-82faa79600fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.311s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:40.391971 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:19:40.435652 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:40.663218 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:19:40.663425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Ensure instance console log exists: /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:19:40.663726 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:40.663932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:40.664126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:40.666900 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start _get_guest_xml network_info=[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '038ab68d-cf27-45ee-997c-bdf2a8dc66cf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '2026-06-27T04:19:39.000000', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:19:40.671917 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:19:40.673565 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1455892126', uuid='4ac6d302-e622-4d21-9ee8-ac0fe6b003f0'), owner=OwnerMeta(userid='c0a2a8189b804630997728bfb949fba1', username='tempest-TestEncryptedCinderVolumes-1777393507-project-member', projectid='56c1eb5f65f0446eae1f4967af349cd1', projectname='tempest-TestEncryptedCinderVolumes-1777393507'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-1048830873', flavorid='e5e79163-bc90-49f1-84d0-3556b2b497a5', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533980.6730845) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:19:40.675117 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:19:40.675427 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:19:40.676858 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:19:40.677138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:19:40.678599 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:19:40.679019 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:19:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='e5e79163-bc90-49f1-84d0-3556b2b497a5',id=13,is_public=True,memory_mb=192,name='tempest-1048830873',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:19:40.679213 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:19:40.679372 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:19:40.679562 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:19:40.679697 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:19:40.679840 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:19:40.680063 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:19:40.680211 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:19:40.680367 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:19:40.680527 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:19:40.680690 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:19:40.693587 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:40.803578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:40.804017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:40.804289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:40.804842 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:40.805277 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:19:40.805656 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:40.805803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:40.806138 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:40.806434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:19:40.817314 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:40.818123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:40.820032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:40.820674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:40.821086 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:40.821336 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:40.832193 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:40.832193 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:40.833487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:40.833487 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef] added
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:40.844163 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:40.844448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:40.844583 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:40.844743 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef] added
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:40.847817 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:40.848170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:40.848237 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:40.848409 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:40.943278 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:40.943712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:40.948551 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:19:40.949133 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Claim successful on node np0000003830
Jun 27 04:19:41.829617 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:19:41.830147 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:41.845128 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:41.848888 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:41.859276 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:41.861901 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.873886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.879042 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.885912 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:19:41.885912 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:41.886266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:19:41.886266 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:41.886266 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:19:41.886266 np0000003830 nova-compute[98984]: 
Jun 27 04:19:41.892133 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:19:41.892133 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:41.892256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:19:41.892256 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:41.892329 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:19:41.892329 np0000003830 nova-compute[98984]: 
Jun 27 04:19:41.909137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260]
Jun 27 04:19:41.909137 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:41.909137 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.919922 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.928994 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260]
Jun 27 04:19:41.928994 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:41.928994 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.933464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.933464 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.933464 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:41.933735 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.933735 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.933735 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:41.934048 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:41.934216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:41.934816 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('7', '-', '-', 0) found on session 160 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:41.934954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:41.940482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:41.951071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 160 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:41.951071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:41.954458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.954458 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.954458 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:41.954953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.954953 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:41.954953 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:41.954953 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:41.955171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:41.958244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('8', '-', '-', 0) found on session 161 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:41.958388 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:41.972056 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 161 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:42.136472 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:42.136738 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:42.395949 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004944289999002649 future=<Future at 0x7ec5183f21b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:42.396655 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782533967.395318, 91bf4758-53d5-47c3-bdf2-02127b907893 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:42.396915 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:42.397175 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] VM Stopped (Lifecycle Event)
Jun 27 04:19:42.398333 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.315768942999966 future=<Future at 0x7ec5382837a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:42.398513 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=5.315567635000207 future=<Future at 0x7ec5382837a0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:42.639738 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:42.900139 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c6bd1e40-a667-4c4c-a8f7-dae2e53dae2e tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 91bf4758-53d5-47c3-bdf2-02127b907893] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:42.971884 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 161 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:42.971884 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:43.146961 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.203s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:43.147233 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:19:43.652520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:19:43.652919 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:19:43.653313 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:43.653723 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:43.721735 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:19:43.836884 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found WWN 330000000fe904d7e for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:19:43.837234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:43.838422 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000fe904d7e', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000fe904d7e'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:43.838632 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fe904d7e', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000fe904d7e'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:19:43.872843 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '2026-06-27T04:19:39.000000', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:19:43.873487 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:19:43.873765 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:19:43.873964 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:19:43.887799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:19:43.887799 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:19:43.887799 np0000003830 nova-compute[98984]:     <volume>8f6390d4-a0db-489c-ac30-faae059a4aef</volume>
Jun 27 04:19:43.887799 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:19:43.887799 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:19:43.887799 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:19:44.114940 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Successfully created port: 47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:19:44.156304 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:19:44.396403 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:29Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:19:44.396758 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:44.397520 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <uuid>4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</uuid>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <name>instance-0000003c</name>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1455892126</nova:name>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:19:40</nova:creationTime>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:flavor name="tempest-1048830873" id="e5e79163-bc90-49f1-84d0-3556b2b497a5">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:extraSpecs/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:user uuid="c0a2a8189b804630997728bfb949fba1">tempest-TestEncryptedCinderVolumes-1777393507-project-member</nova:user>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:project uuid="56c1eb5f65f0446eae1f4967af349cd1">tempest-TestEncryptedCinderVolumes-1777393507</nova:project>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <nova:port uuid="00c7251a-b156-475a-99a5-48dafe19e9b6">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <entry name="serial">4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</entry>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <entry name="uuid">4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</entry>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <alias name="ua-8f6390d4-a0db-489c-ac30-faae059a4aef"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <serial>8f6390d4-a0db-489c-ac30-faae059a4aef</serial>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <encryption format="luks">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:         <secret type="passphrase" uuid="10fefb92-328e-4068-909f-7cce13d9c13b"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       </encryption>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:26:ae:8a"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <target dev="tap00c7251a-b1"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/console.log" append="off"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:19:44.399367 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:19:44.401817 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:18:29Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:19:44.401817 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "vif_mac": "fa:16:3e:26:ae:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:44.401817 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:44.401817 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:19:44.402388 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:44.402883 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:44.403141 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:19:44.405916 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:44.405916 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f912ca60-ec3c-5740-8d91-3ccae28d3374', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:44.406934 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:44.407601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:44.411901 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:44.411901 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00c7251a-b1, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:44.412662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00c7251a-b1, col_values=(('qos', UUID('cce8a1c9-ed89-4215-8d80-c4cf1a4f933a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:44.412889 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00c7251a-b1, col_values=(('external_ids', {'iface-id': '00c7251a-b156-475a-99a5-48dafe19e9b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ae:8a', 'vm-uuid': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:44.413837 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:44.416391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:44.420380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:44.421318 np0000003830 nova-compute[98984]: INFO os_vif [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1')
Jun 27 04:19:44.614655 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Successfully updated port: 47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:19:44.659679 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:19:44.677211 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-changed-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:44.677370 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Refreshing instance network info cache due to event network-changed-47ec8768-8197-4f94-9599-12d5b6d04d80. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:19:44.677803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] Acquiring lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:44.677803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] Acquired lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:44.677803 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Refreshing network info cache for port 47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:19:45.116443 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:45.165467 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Booting with volume 2426dd44-ad07-42db-9e44-cdf1f5d1c69e at /dev/vda
Jun 27 04:19:45.180683 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:45.202093 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:45.212832 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:19:45.234326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:45.252335 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:19:45.282661 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:19:45.283018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:19:45.292696 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:19:45.293580 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f'] 
Jun 27 04:19:45.293683 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:19:45.293793 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:19:45.294017 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:45.294200 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updating existing volume attachment record: 5c41eb83-6806-497c-a35c-293908406b55 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:19:45.401570 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:45.904408 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-556300ed-5961-4ead-81f3-6e6d53392ff4 req-1c44765c-e4af-4ae7-b7d8-17e0d23619d9 service nova] Releasing lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:19:45.905042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:45.905188 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:19:45.938644 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:45.938799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:45.938799 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:45.938953 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] No VIF found with MAC fa:16:3e:26:ae:8a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:19:45.939476 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Using config drive
Jun 27 04:19:46.350258 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.371694 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.462614 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.467376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.504558 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:19:46.665054 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:46.677359 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34f9c919-6938-42c3-a848-ea444c67e47b req-7ec4ef98-f423-4c61-9d6f-5a46e158b3f2 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:46.677359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34f9c919-6938-42c3-a848-ea444c67e47b req-7ec4ef98-f423-4c61-9d6f-5a46e158b3f2 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:46.677359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34f9c919-6938-42c3-a848-ea444c67e47b req-7ec4ef98-f423-4c61-9d6f-5a46e158b3f2 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:46.677359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34f9c919-6938-42c3-a848-ea444c67e47b req-7ec4ef98-f423-4c61-9d6f-5a46e158b3f2 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:46.677359 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34f9c919-6938-42c3-a848-ea444c67e47b req-7ec4ef98-f423-4c61-9d6f-5a46e158b3f2 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:46.678449 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-34f9c919-6938-42c3-a848-ea444c67e47b req-7ec4ef98-f423-4c61-9d6f-5a46e158b3f2 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state active and task_state resize_finish.
Jun 27 04:19:46.689394 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.690326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.693570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.694480 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.714809 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:46.809260 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updating instance_info_cache with network_info: [{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:47.012087 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:19:47.311264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:19:47.311444 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance network_info: |[{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:19:47.403862 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:19:47.404806 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:19:47.405058 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Creating image(s)
Jun 27 04:19:47.405386 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:19:47.405511 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Ensure instance console log exists: /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:19:47.405767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:47.405935 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:47.406055 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:47.406607 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Start _get_guest_xml network_info=[{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5c41eb83-6806-497c-a35c-293908406b55', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4266fe64-0d80-458a-9add-b7be6ac0bccc', 'attached_at': '', 'detached_at': '', 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'serial': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:19:47.410032 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:19:47.411214 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-375405601', uuid='4266fe64-0d80-458a-9add-b7be6ac0bccc'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782533987.410857) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:19:47.412543 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:19:47.412950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:19:47.414312 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:19:47.414529 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:19:47.415874 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:19:47.416225 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:19:47.416405 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:19:47.416543 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:19:47.416672 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:19:47.416748 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:19:47.416853 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:19:47.416995 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:19:47.417110 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:19:47.417248 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:19:47.417334 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:19:47.417447 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:19:47.426085 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:19:47.426358 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:47.426529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:47.426900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:47.427089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:19:47.441767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:47.442445 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:47.442967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:47.443155 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:47.444253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:47.444603 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:47.455035 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:47.455035 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:47.460825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:19:47.460825 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e] added
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:47.470018 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:47.471121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:47.471121 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:47.471288 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e] added
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:19:47.475011 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:47.475240 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:19:47.475392 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:19:47.475568 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:19:47.714624 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005146849998709513 future=<Future at 0x7ec5382837a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:47.714733 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:47.714908 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.187469331000102 future=<Future at 0x7ec5381a3d70 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:47.716193 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Emitting event <LifecycleEvent: 1782533972.7139971, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:47.716346 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.1860199109996756 future=<Future at 0x7ec5381a3d70 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:47.716572 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Stopped (Lifecycle Event)
Jun 27 04:19:47.881569 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 due to new event <LifecycleEvent: 1782533987.881186, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:19:47.881800 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533987.881186, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:47.882025 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Resumed (Lifecycle Event)
Jun 27 04:19:47.883298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:19:47.886238 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance running successfully.
Jun 27 04:19:47.887464 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Failed to set time: agent not configured {{(pid=98984) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
Jun 27 04:19:47.887778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-53d62732-3bf3-4163-a0c9-eff5523dbc7f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] finish_migration finished successfully. {{(pid=98984) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12905}}
Jun 27 04:19:48.222328 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:48.384865 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:48.387223 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:19:48.471708 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:19:48.476052 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:48.484599 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:19:48.491939 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.498669 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.505092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.512637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.512637 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.512637 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:48.512870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.512870 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.512870 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:48.519361 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.519361 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.519361 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:48.519525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.519525 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.519525 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:48.556018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260]
Jun 27 04:19:48.556018 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:48.556018 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.569114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.576284 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260]
Jun 27 04:19:48.576284 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:48.576284 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.587279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.587279 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.587279 np0000003830 nova-compute[98984]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.587279 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.587279 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:48.587529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.587529 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.587529 np0000003830 nova-compute[98984]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.587529 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.587529 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:48.587692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:48.587878 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:48.588412 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('9', '-', '-', 0) found on session 162 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:48.588538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:48.594702 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:48.605038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 162 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:48.605038 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:48.616845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.616845 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.616845 np0000003830 nova-compute[98984]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.616845 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.616845 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:48.617022 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.617022 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:48.617022 np0000003830 nova-compute[98984]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.617022 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:48.617022 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:48.617235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:48.617309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:19:48.617882 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('10', '-', '-', 0) found on session 163 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:19:48.617984 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:19:48.632247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 163 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:48.806118 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8fd99aa1-afd0-4eae-88d4-1a86d4f6b121 req-e2b5d887-d644-4416-a0bd-8f14bd5c277f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:48.806237 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8fd99aa1-afd0-4eae-88d4-1a86d4f6b121 req-e2b5d887-d644-4416-a0bd-8f14bd5c277f service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:48.806387 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8fd99aa1-afd0-4eae-88d4-1a86d4f6b121 req-e2b5d887-d644-4416-a0bd-8f14bd5c277f service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:48.806465 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8fd99aa1-afd0-4eae-88d4-1a86d4f6b121 req-e2b5d887-d644-4416-a0bd-8f14bd5c277f service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:48.806605 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8fd99aa1-afd0-4eae-88d4-1a86d4f6b121 req-e2b5d887-d644-4416-a0bd-8f14bd5c277f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:48.806752 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-8fd99aa1-afd0-4eae-88d4-1a86d4f6b121 req-e2b5d887-d644-4416-a0bd-8f14bd5c277f service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state resized and task_state None.
Jun 27 04:19:48.889623 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jun 27 04:19:48.889989 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533988.889723, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:48.890211 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Started (Lifecycle Event)
Jun 27 04:19:49.392789 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:49.395418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:19:49.425403 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:49.633347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 163 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:19:49.633786 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:19:49.652727 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:49.693672 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:49.845125 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:49.845435 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:49.845660 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:49.898117 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 27 04:19:49.902941 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005143299999872397 future=<Future at 0x7ec5381a3d70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:49.903627 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782533974.902292, b7c534a5-7cfd-40d5-b88d-82faa79600fd => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:49.903985 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:49.904122 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] VM Stopped (Lifecycle Event)
Jun 27 04:19:49.919630 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Port 00c7251a-b156-475a-99a5-48dafe19e9b6 binding to destination host np0000003830 is already ACTIVE {{(pid=98984) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3211}}
Jun 27 04:19:49.919822 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:49.919950 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:49.922163 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:19:50.406689 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-904b0631-847d-4313-a17d-6f4f1a134c36 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: b7c534a5-7cfd-40d5-b88d-82faa79600fd] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:50.422179 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:50.458448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 33000000066075f6c for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:19:50.458766 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:50.458998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000066075f6c', 'path': '/dev/dm-1', 'multipath_id': '33000000066075f6c'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:50.459104 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000066075f6c', 'path': '/dev/dm-1', 'multipath_id': '33000000066075f6c'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:19:50.729836 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:50.866149 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:19:50.967414 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-375405601',display_name='tempest-TestVolumeBootPattern-server-375405601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-375405601',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzwKD9L5+eOaLo5+4LX1FfFrZjdRoks72uLxfhP1LO8IbxMneGW4WXxfmVW+KceKBp/9/mlLmz7Xfn/ySaKmeDBGU4Xr4db6/43cXDP4LKYduucsKhm2mnxUbJNbKTWw==',key_name='tempest-keypair-1285558257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-cljjhtz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=4266fe64-0d80-458a-9add-b7be6ac0bccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:19:50.967732 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:50.968544 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:50.969348 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:51.368361 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <uuid>4266fe64-0d80-458a-9add-b7be6ac0bccc</uuid>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <name>instance-00000040</name>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-375405601</nova:name>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:19:47</nova:creationTime>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         <nova:port uuid="47ec8768-8197-4f94-9599-12d5b6d04d80">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <entry name="serial">4266fe64-0d80-458a-9add-b7be6ac0bccc</entry>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <entry name="uuid">4266fe64-0d80-458a-9add-b7be6ac0bccc</entry>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <alias name="ua-2426dd44-ad07-42db-9e44-cdf1f5d1c69e"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <serial>2426dd44-ad07-42db-9e44-cdf1f5d1c69e</serial>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:1b:58:3b"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <target dev="tap47ec8768-81"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/console.log" append="off"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:19:51.472148 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Preparing to wait for external event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-375405601',display_name='tempest-TestVolumeBootPattern-server-375405601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-375405601',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzwKD9L5+eOaLo5+4LX1FfFrZjdRoks72uLxfhP1LO8IbxMneGW4WXxfmVW+KceKBp/9/mlLmz7Xfn/ySaKmeDBGU4Xr4db6/43cXDP4LKYduucsKhm2mnxUbJNbKTWw==',key_name='tempest-keypair-1285558257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-cljjhtz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=4266fe64-0d80-458a-9add-b7be6ac0bccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:51.474268 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:19:51.474648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:51.474851 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:51.475116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:19:51.475719 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:51.475893 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a27c1528-3b3a-5e5a-8495-f23b585473da', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:51.476819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:51.477712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:51.479540 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:51.479742 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47ec8768-81, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:51.480116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47ec8768-81, col_values=(('qos', UUID('65f20c1d-feec-4e8a-b84a-ae5c8a96c110')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:51.480332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47ec8768-81, col_values=(('external_ids', {'iface-id': '47ec8768-8197-4f94-9599-12d5b6d04d80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:58:3b', 'vm-uuid': '4266fe64-0d80-458a-9add-b7be6ac0bccc'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:51.481460 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:51.483110 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:51.487377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:51.488448 np0000003830 nova-compute[98984]: INFO os_vif [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81')
Jun 27 04:19:51.871468 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Creating tmpfile /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/tmpospc57h3 to verify with other compute node that the instance is on the same shared storage. {{(pid=98984) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10570}}
Jun 27 04:19:51.871967 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:19:52.395516 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:52.398315 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:52.414404 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:52.446882 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:52.541563 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee148294-9d02-4d02-92de-79338d398a18 req-27f29cdd-7a42-4255-88ad-59840e55ad6b service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:52.542359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee148294-9d02-4d02-92de-79338d398a18 req-27f29cdd-7a42-4255-88ad-59840e55ad6b service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:52.542359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee148294-9d02-4d02-92de-79338d398a18 req-27f29cdd-7a42-4255-88ad-59840e55ad6b service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:52.542359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ee148294-9d02-4d02-92de-79338d398a18 req-27f29cdd-7a42-4255-88ad-59840e55ad6b service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:52.542359 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ee148294-9d02-4d02-92de-79338d398a18 req-27f29cdd-7a42-4255-88ad-59840e55ad6b service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:52.542359 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ee148294-9d02-4d02-92de-79338d398a18 req-27f29cdd-7a42-4255-88ad-59840e55ad6b service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state resized and task_state resize_reverting.
Jun 27 04:19:52.698602 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999628079000104 future=<Future at 0x7ec5181c7e00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:52.699210 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998954768000203 future=<Future at 0x7ec5181c7e00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:52.699372 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99877984900013 future=<Future at 0x7ec5181c7e00 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:19:52.701698 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance destroyed successfully.
Jun 27 04:19:52.702318 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'resources' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:53.008552 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:53.008964 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:19:53.008964 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:1b:58:3b, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:19:53.009095 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Using config drive
Jun 27 04:19:53.204838 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:48Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:19:53.204838 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:19:53.205360 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:19:53.205583 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:19:53.206676 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:53.206862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00c7251a-b1, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:53.207769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:53.208602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:53.213603 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:53.214408 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:53.214673 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cce8a1c9-ed89-4215-8d80-c4cf1a4f933a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:19:53.215169 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:53.215762 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:19:53.220731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:53.222461 np0000003830 nova-compute[98984]: INFO os_vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1')
Jun 27 04:19:53.225337 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:19:53.225680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:19:53.225809 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:19:53.226224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:19:53.226504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:19:53.226648 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:19:53.252713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:53.252713 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:53.252713 np0000003830 nova-compute[98984]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:53.252713 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:53.252713 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:19:53.253001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:53.253001 np0000003830 nova-compute[98984]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:19:53.253001 np0000003830 nova-compute[98984]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:53.253001 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:19:53.253001 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:19:53.253001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '163')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:19:53.253260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '161')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:53.253935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '160')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:19:53.254592 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518193240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:19:53.254795 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:19:53.255033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flush multipath device 330000000fe904d7e {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:19:53.302775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:53.357446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:19:53.402411 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:19:53.402572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:19:53.403252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:19:53.414168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:19:53.414333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:19:53.424992 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:53.462704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260]
Jun 27 04:19:53.462704 np0000003830 nova-compute[98984]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260] successful.
Jun 27 04:19:53.462704 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:53.477134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:53.488130 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:53.514709 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:53.517551 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260]
Jun 27 04:19:53.517551 np0000003830 nova-compute[98984]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260] successful.
Jun 27 04:19:53.517551 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:53.530037 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:19:53.531161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:19:53.531272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== disconnect_volume: return (305ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:19:53.531378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:19:53.645709 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Creating config drive at /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config
Jun 27 04:19:53.649728 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxv127dln {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:19:53.703227 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxv127dln" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:19:54.082879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.126256 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.182810 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.187022 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.322507 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-834d47ed-6fee-4d14-881e-e91ffdcf7a89 req-6c699559-356b-4b5f-ac3f-ebe0d704f924 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:54.323010 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-834d47ed-6fee-4d14-881e-e91ffdcf7a89 req-6c699559-356b-4b5f-ac3f-ebe0d704f924 service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:54.323179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-834d47ed-6fee-4d14-881e-e91ffdcf7a89 req-6c699559-356b-4b5f-ac3f-ebe0d704f924 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:54.323332 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-834d47ed-6fee-4d14-881e-e91ffdcf7a89 req-6c699559-356b-4b5f-ac3f-ebe0d704f924 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:54.323418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-834d47ed-6fee-4d14-881e-e91ffdcf7a89 req-6c699559-356b-4b5f-ac3f-ebe0d704f924 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Processing event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:19:54.370269 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.372244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.373883 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.393652 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.635710 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d36418e3-01b1-4b94-a8ef-30a4eafadfdf req-3882da29-6f71-4c71-ac20-3ddb93f3d332 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:54.635710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d36418e3-01b1-4b94-a8ef-30a4eafadfdf req-3882da29-6f71-4c71-ac20-3ddb93f3d332 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:54.635875 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d36418e3-01b1-4b94-a8ef-30a4eafadfdf req-3882da29-6f71-4c71-ac20-3ddb93f3d332 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:54.636110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d36418e3-01b1-4b94-a8ef-30a4eafadfdf req-3882da29-6f71-4c71-ac20-3ddb93f3d332 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:54.636222 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d36418e3-01b1-4b94-a8ef-30a4eafadfdf req-3882da29-6f71-4c71-ac20-3ddb93f3d332 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:54.636359 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-d36418e3-01b1-4b94-a8ef-30a4eafadfdf req-3882da29-6f71-4c71-ac20-3ddb93f3d332 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state resized and task_state resize_reverting.
Jun 27 04:19:54.654128 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:54.778538 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:54.778752 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:55.020419 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533995.0200343, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:55.021002 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:19:55.021195 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] VM Started (Lifecycle Event)
Jun 27 04:19:55.025466 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:19:55.029860 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance spawned successfully.
Jun 27 04:19:55.030196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:19:55.280867 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'migration_context' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:19:55.523687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:55.526202 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:19:55.538272 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:19:55.538401 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:19:55.539014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:19:55.539283 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:19:55.539629 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:19:55.539923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:19:55.783196 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Object Instance<4ac6d302-e622-4d21-9ee8-ac0fe6b003f0> lazy-loaded attributes: resources,migration_context {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:19:56.007341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:19:56.008032 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:19:56.028598 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:19:56.028887 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533996.0286937, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:56.029023 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] VM Paused (Lifecycle Event)
Jun 27 04:19:56.045759 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Took 8.64 seconds to spawn the instance on the hypervisor.
Jun 27 04:19:56.046121 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:56.393783 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dc8242c4-aca7-48eb-8b0c-bc0af0fb54cb req-8216a023-bc3f-4eb4-afbf-ea0b7ae28082 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:56.394244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dc8242c4-aca7-48eb-8b0c-bc0af0fb54cb req-8216a023-bc3f-4eb4-afbf-ea0b7ae28082 service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:19:56.394481 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dc8242c4-aca7-48eb-8b0c-bc0af0fb54cb req-8216a023-bc3f-4eb4-afbf-ea0b7ae28082 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:19:56.394665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-dc8242c4-aca7-48eb-8b0c-bc0af0fb54cb req-8216a023-bc3f-4eb4-afbf-ea0b7ae28082 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:56.394824 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-dc8242c4-aca7-48eb-8b0c-bc0af0fb54cb req-8216a023-bc3f-4eb4-afbf-ea0b7ae28082 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:19:56.395405 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-dc8242c4-aca7-48eb-8b0c-bc0af0fb54cb req-8216a023-bc3f-4eb4-afbf-ea0b7ae28082 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received unexpected event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with vm_state active and task_state None.
Jun 27 04:19:56.510693 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:19:56.532611 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:56.537305 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782533996.537105, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:19:56.537436 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] VM Resumed (Lifecycle Event)
Jun 27 04:19:56.556802 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Took 15.66 seconds to build instance.
Jun 27 04:19:57.039483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:19:57.049924 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:19:57.060018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-cfed4698-40ae-4f72-9a76-71f8efaf7111 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.168s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:57.522288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.743s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:19:57.522288 np0000003830 nova-compute[98984]: DEBUG nova.compute.rpcapi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98984) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
Jun 27 04:19:57.530307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:58.216096 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:58.726851 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-changed-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:19:58.727330 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Refreshing instance network info cache due to event network-changed-47ec8768-8197-4f94-9599-12d5b6d04d80. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:19:58.727373 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] Acquiring lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:58.727517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] Acquired lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:58.727649 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Refreshing network info cache for port 47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:19:59.109308 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Swapping old allocation on dict_keys(['d6db2083-b24e-4fc9-8e4d-9a740cf9bf37']) held by migration d149a5a6-4887-459b-9ca3-a8db0938e5d9 for instance
Jun 27 04:19:59.200975 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Overwriting current allocation {'allocations': {'d6db2083-b24e-4fc9-8e4d-9a740cf9bf37': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 82}}, 'project_id': '56c1eb5f65f0446eae1f4967af349cd1', 'user_id': 'c0a2a8189b804630997728bfb949fba1', 'consumer_generation': 1} on consumer 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
Jun 27 04:19:59.231648 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:59.389838 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:59.508280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:19:59.508474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquired lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:19:59.508617 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:19:59.654239 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:19:59.663508 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:19:59.782783 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updated VIF entry in instance network info cache for port 47ec8768-8197-4f94-9599-12d5b6d04d80. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:19:59.783261 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updating instance_info_cache with network_info: [{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:00.011055 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:00.273985 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:00.284963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bda9c5cb-844e-4459-afe0-3db0b7c92da1 req-1cb1fddc-d2a7-4d79-ae3f-0c764ca6ad5f service nova] Releasing lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:00.391518 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:00.896341 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Releasing lock "refresh_cache-4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:00.896341 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:00.904783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:20:00.927094 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:00.973909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:20:00.974218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:20:00.986211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:20:00.987244 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe1b:583b', 'fe80::a810:fdff:fe5d:dd65'] 
Jun 27 04:20:00.987387 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:20:00.987460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:20:00.987707 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:02.081392 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Starting finish_revert_migration {{(pid=98984) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12955}}
Jun 27 04:20:02.098986 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start _get_guest_xml network_info=[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '4c055e0d-5674-46fb-96bf-7d89f89ae894', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '2026-06-27T04:20:01.000000', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:20:02.101712 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:20:02.103966 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1455892126', uuid='4ac6d302-e622-4d21-9ee8-ac0fe6b003f0'), owner=OwnerMeta(userid='c0a2a8189b804630997728bfb949fba1', username='tempest-TestEncryptedCinderVolumes-1777393507-project-member', projectid='56c1eb5f65f0446eae1f4967af349cd1', projectname='tempest-TestEncryptedCinderVolumes-1777393507'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534002.1034515) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:20:02.105714 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:20:02.106173 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:20:02.107670 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:20:02.107922 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:20:02.109298 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:20:02.110044 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:20:02.110280 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:20:02.110487 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:20:02.110710 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:20:02.110856 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:20:02.111465 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:20:02.111465 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:20:02.111465 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:20:02.111639 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:20:02.111806 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:20:02.111994 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:20:02.112247 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:02.623910 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:02.712887 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:02.713548 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:02.713816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:02.714431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:02.714888 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:20:02.715275 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:02.715452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:02.715816 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:02.716073 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:20:02.727293 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:02.728619 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:02.728927 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:02.729232 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:20:02.729719 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:02.729904 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:20:02.741216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:20:02.741216 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:02.743421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:20:02.743421 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef] added
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:02.755239 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:02.755649 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:20:02.755749 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:20:02.755927 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef] added
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:02.759909 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:02.760081 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:20:02.760289 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:20:02.760587 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:20:03.217472 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:03.756483 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:20:03.761009 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:20:03.771219 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:20:03.777824 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.784291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.792341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.803851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.803851 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.803851 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:03.804143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.804143 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.804143 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:03.810529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.810529 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.810529 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:03.810866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.810866 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.810866 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:03.846310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260]
Jun 27 04:20:03.846310 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260] successful.
Jun 27 04:20:03.846310 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.860121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.868918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260]
Jun 27 04:20:03.868918 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260] successful.
Jun 27 04:20:03.868918 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.880900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.880900 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.880900 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.880900 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.880900 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:03.881201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.881201 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.881201 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.881201 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.881201 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:03.883309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:03.883309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:20:03.883309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('7', '-', '-', 0) found on session 164 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:20:03.883309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:20:03.893121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:03.905352 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 164 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:03.913634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.913634 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.913634 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.913634 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.913634 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:03.913907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.913907 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:03.913907 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.913907 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:03.913907 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:03.914043 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:03.914156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:20:03.914727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] HCTL ('8', '-', '-', 0) found on session 165 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:20:03.914831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:20:03.935601 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 165 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:04.665625 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:04.905995 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 164 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:04.906217 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:20:04.935377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Searching for a device in session 165 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:04.935650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:20:05.729577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:20:06.747598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found WWN 330000000fe904d7e for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:20:06.747998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.032s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:06.750261 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '330000000fe904d7e', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000fe904d7e'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:06.750487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fe904d7e', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000fe904d7e'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:20:06.791405 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '2026-06-27T04:20:01.000000', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:20:06.792200 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:20:06.792468 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:20:06.792690 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:20:06.806125 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:20:06.806125 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:20:06.806125 np0000003830 nova-compute[98984]:     <volume>8f6390d4-a0db-489c-ac30-faae059a4aef</volume>
Jun 27 04:20:06.806125 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:20:06.806125 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:20:06.806125 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:20:07.316365 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:48Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:20:07.316632 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:07.318028 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <uuid>4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</uuid>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <name>instance-0000003c</name>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1455892126</nova:name>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:20:02</nova:creationTime>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:user uuid="c0a2a8189b804630997728bfb949fba1">tempest-TestEncryptedCinderVolumes-1777393507-project-member</nova:user>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:project uuid="56c1eb5f65f0446eae1f4967af349cd1">tempest-TestEncryptedCinderVolumes-1777393507</nova:project>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <nova:port uuid="00c7251a-b156-475a-99a5-48dafe19e9b6">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <entry name="serial">4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</entry>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <entry name="uuid">4ac6d302-e622-4d21-9ee8-ac0fe6b003f0</entry>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk.config"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <alias name="ua-8f6390d4-a0db-489c-ac30-faae059a4aef"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <serial>8f6390d4-a0db-489c-ac30-faae059a4aef</serial>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <encryption format="luks">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:         <secret type="passphrase" uuid="3ae2f71d-2d5b-4e30-83d2-fb3a3b684cda"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       </encryption>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:26:ae:8a"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <target dev="tap00c7251a-b1"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/console.log" append="off"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:20:07.319901 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Preparing to wait for external event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:48Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000003830',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:19:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:07.323509 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:20:07.324123 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.324123 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f912ca60-ec3c-5740-8d91-3ccae28d3374', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:07.324702 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.325354 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:07.326040 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.327870 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.328061 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00c7251a-b1, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:07.328385 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00c7251a-b1, col_values=(('qos', UUID('cdc932ac-0725-4fb9-a568-6b24a087a560')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:07.328580 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00c7251a-b1, col_values=(('external_ids', {'iface-id': '00c7251a-b156-475a-99a5-48dafe19e9b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:ae:8a', 'vm-uuid': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:07.329355 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.330393 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:07.334543 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.335390 np0000003830 nova-compute[98984]: INFO os_vif [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1')
Jun 27 04:20:07.698754 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0005504949999703967 future=<Future at 0x7ec5181c7e00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:07.699355 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782533992.6980662, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:07.700514 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:07.700514 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Stopped (Lifecycle Event)
Jun 27 04:20:07.789520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.822854 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.822854 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:07.897391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:08.019271 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d0f1905e-4c84-42b3-b9bb-f3b118810bae req-dfedcdc5-697a-4c6a-be42-5e9e81fffbe5 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:08.019689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d0f1905e-4c84-42b3-b9bb-f3b118810bae req-dfedcdc5-697a-4c6a-be42-5e9e81fffbe5 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:08.019826 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d0f1905e-4c84-42b3-b9bb-f3b118810bae req-dfedcdc5-697a-4c6a-be42-5e9e81fffbe5 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:08.019972 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d0f1905e-4c84-42b3-b9bb-f3b118810bae req-dfedcdc5-697a-4c6a-be42-5e9e81fffbe5 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:08.020031 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d0f1905e-4c84-42b3-b9bb-f3b118810bae req-dfedcdc5-697a-4c6a-be42-5e9e81fffbe5 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Processing event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:20:08.161682 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:08.164979 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:08.166429 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:08.187946 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:08.203546 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2cf96236-8f9a-4b19-84ed-63204a7a81ae tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:09.591708 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534009.5911782, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:09.592188 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:20:09.592362 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Started (Lifecycle Event)
Jun 27 04:20:09.598645 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance running successfully.
Jun 27 04:20:09.598991 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] finish_revert_migration finished successfully. {{(pid=98984) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:13001}}
Jun 27 04:20:09.666750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:10.084516 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-693733d6-426b-4bef-ae6f-50efccca4713 req-9bba0fae-81b0-4a8c-97da-d60c19210852 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:10.085076 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-693733d6-426b-4bef-ae6f-50efccca4713 req-9bba0fae-81b0-4a8c-97da-d60c19210852 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:10.085311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-693733d6-426b-4bef-ae6f-50efccca4713 req-9bba0fae-81b0-4a8c-97da-d60c19210852 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:10.085519 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-693733d6-426b-4bef-ae6f-50efccca4713 req-9bba0fae-81b0-4a8c-97da-d60c19210852 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:10.085747 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-693733d6-426b-4bef-ae6f-50efccca4713 req-9bba0fae-81b0-4a8c-97da-d60c19210852 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:10.085922 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-693733d6-426b-4bef-ae6f-50efccca4713 req-9bba0fae-81b0-4a8c-97da-d60c19210852 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state resized and task_state resize_reverting.
Jun 27 04:20:10.095227 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:10.097626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:10.600103 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jun 27 04:20:10.600629 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534010.6000545, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:10.600629 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Paused (Lifecycle Event)
Jun 27 04:20:10.671223 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8f49b8c4-f378-4611-9556-6969c22260a8 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance to original state: 'active'
Jun 27 04:20:10.750750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:11.106642 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:11.114539 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534011.1133897, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:11.114539 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Resumed (Lifecycle Event)
Jun 27 04:20:11.617436 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:11.619299 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:12.233015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:12.233015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:12.331287 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:12.734102 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Detaching volume 8f6390d4-a0db-489c-ac30-faae059a4aef
Jun 27 04:20:12.788623 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Attempting to driver detach volume 8f6390d4-a0db-489c-ac30-faae059a4aef from mountpoint /dev/vdb
Jun 27 04:20:12.822165 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'attaching', 'instance': '4ac6d302-e622-4d21-9ee8-ac0fe6b003f0', 'attached_at': '2026-06-27T04:20:01.000000', 'detached_at': '', 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'serial': '8f6390d4-a0db-489c-ac30-faae059a4aef'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Attempting to detach device vdb from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <alias name="ua-8f6390d4-a0db-489c-ac30-faae059a4aef"/>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <serial>8f6390d4-a0db-489c-ac30-faae059a4aef</serial>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="3ae2f71d-2d5b-4e30-83d2-fb3a3b684cda"/>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:20:12.842249 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 from the persistent domain config.
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] (1/8): Attempting to detach device vdb with device alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <alias name="ua-8f6390d4-a0db-489c-ac30-faae059a4aef"/>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <serial>8f6390d4-a0db-489c-ac30-faae059a4aef</serial>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="3ae2f71d-2d5b-4e30-83d2-fb3a3b684cda"/>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:20:12.858213 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:20:13.742340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:14.668040 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:15.339891 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:15.585656 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:17.045332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:17.332577 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:17.866715 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef for instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:20:18.149806 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:19.669893 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:19.882384 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:20.057126 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:22.334650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:22.777936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:24.209007 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:24.209523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:24.673247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:24.711437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:20:25.261986 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:25.262386 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:25.272570 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:20:25.272864 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Claim successful on node np0000003830
Jun 27 04:20:26.507679 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:20:26.508068 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:20:27.011321 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:20:27.337312 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:27.520480 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.258s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:27.521064 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:20:27.628264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:27.628508 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:28.027805 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:20:28.028124 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:20:28.029018 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:28.029296 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:28.119620 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f84976ecddb1446baf656173f32940f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e8dbaf15594c24944a445d42712c19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:20:28.130247 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:20:28.527117 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Successfully created port: fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:20:28.531434 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:20:28.679238 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:28.679385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:28.682732 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:20:28.682934 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Claim successful on node np0000003830
Jun 27 04:20:28.939617 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Successfully updated port: fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:20:28.981880 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-changed-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:28.982064 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Refreshing instance network info cache due to event network-changed-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:20:28.982125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] Acquiring lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:28.982225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] Acquired lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:28.982329 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Refreshing network info cache for port fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:20:29.035018 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:20:29.441326 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:29.484075 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:29.545882 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:20:29.671562 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:29.673909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:29.830553 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:29.830996 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:20:29.879142 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:20:29.879368 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:20:30.042318 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:20:30.043232 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:20:30.043482 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Creating image(s)
Jun 27 04:20:30.044038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "/opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:30.044188 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "/opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:30.044667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "/opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:30.045271 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:20:30.047734 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:20:30.048677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:30.135509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:30.135965 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:30.136636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:30.137199 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:20:30.141108 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:20:30.141513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:30.175788 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3150d150-3cf1-4c7d-8594-9138cad33b0b req-040eb43c-4d2e-41ec-aa37-69bfa39d0e19 service nova] Releasing lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:30.176697 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquired lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:30.176991 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:20:30.227780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:30.228253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:30.281868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk 1073741824" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:30.282356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:30.282709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:30.382844 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:20:30.392825 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.110s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:30.393238 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:20:30.393577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:30.486612 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:30.487090 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Cannot resize image /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:20:30.487848 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:20:30.488089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Ensure instance console log exists: /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:20:30.488578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:30.488838 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:30.489034 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:30.740387 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:20:30.883184 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:30.894704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.215s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:30.895138 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:20:31.008518 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updating instance_info_cache with network_info: [{"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:31.402920 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:20:31.403113 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:20:31.403423 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:31.403686 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:31.474946 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65af8bebc9f64e179fabdbd5fb64c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440506966fc7496e9b8956b939ce8a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:20:31.510406 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Releasing lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:31.510718 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Instance network_info: |[{"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:20:31.512255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Start _get_guest_xml network_info=[{"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:20:31.516981 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:20:31.518161 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-676402104', uuid='09ca8b1e-3f64-46ce-8448-dd96acf76688'), owner=OwnerMeta(userid='f84976ecddb1446baf656173f32940f2', username='tempest-TestServerVolumeAttachmentScenario-747119314-project-member', projectid='39e8dbaf15594c24944a445d42712c19', projectname='tempest-TestServerVolumeAttachmentScenario-747119314'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534031.5177991) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:20:31.519675 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:20:31.520028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:20:31.520980 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:20:31.521157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:20:31.522204 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:20:31.522558 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:20:31.522744 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:20:31.522878 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:20:31.523041 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:20:31.523161 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:20:31.523304 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:20:31.523528 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:20:31.523685 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:20:31.523833 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:20:31.523978 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:20:31.524143 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:20:31.537177 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-676402104',display_name='tempest-TestServerVolumeAttachmentScenario-server-676402104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testservervolumeattachmentscenario-server-676402104',id=65,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1nWl/mWcCABpBlq6CxW4OjF1sD3GhwAqZjfJXch7t+gid+g+cXJCIgFgthWokEyECwXdSlvWDmHt1ulzrSWIC/G4eWEEhCT8sp58BCWsAyaQ9J9DtwAuSBNnBsJVKEOw==',key_name='tempest-keypair-253988185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39e8dbaf15594c24944a445d42712c19',ramdisk_id='',reservation_id='r-0p29hslo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-747119314',owner_user_name='tempest-TestServerVolumeAttachmentScenario-747119314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f84976ecddb1446baf656173f32940f2',uuid=09ca8b1e-3f64-46ce-8448-dd96acf76688,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:20:31.537446 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Converting VIF {"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:31.538013 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:31.538633 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'pci_devices' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:31.830934 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:31.831330 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:20:31.844958 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Successfully created port: 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:20:31.906063 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <uuid>09ca8b1e-3f64-46ce-8448-dd96acf76688</uuid>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <name>instance-00000041</name>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-676402104</nova:name>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:20:31</nova:creationTime>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:user uuid="f84976ecddb1446baf656173f32940f2">tempest-TestServerVolumeAttachmentScenario-747119314-project-member</nova:user>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:project uuid="39e8dbaf15594c24944a445d42712c19">tempest-TestServerVolumeAttachmentScenario-747119314</nova:project>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         <nova:port uuid="fbbd9f71-9262-430f-a5a9-e3a7a3e591fc">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <entry name="serial">09ca8b1e-3f64-46ce-8448-dd96acf76688</entry>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <entry name="uuid">09ca8b1e-3f64-46ce-8448-dd96acf76688</entry>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.config"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:3f:3f:41"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <target dev="tapfbbd9f71-92"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/console.log" append="off"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:20:32.041446 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Preparing to wait for external event network-vif-plugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-676402104',display_name='tempest-TestServerVolumeAttachmentScenario-server-676402104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testservervolumeattachmentscenario-server-676402104',id=65,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1nWl/mWcCABpBlq6CxW4OjF1sD3GhwAqZjfJXch7t+gid+g+cXJCIgFgthWokEyECwXdSlvWDmHt1ulzrSWIC/G4eWEEhCT8sp58BCWsAyaQ9J9DtwAuSBNnBsJVKEOw==',key_name='tempest-keypair-253988185',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39e8dbaf15594c24944a445d42712c19',ramdisk_id='',reservation_id='r-0p29hslo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-747119314',owner_user_name='tempest-TestServerVolumeAttachmentScenario-747119314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f84976ecddb1446baf656173f32940f2',uuid=09ca8b1e-3f64-46ce-8448-dd96acf76688,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Converting VIF {"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:32.043632 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:20:32.043975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.044065 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:32.044347 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:20:32.044983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.045124 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab00b8de-f140-5749-a4b6-5ca83cefb6ee', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:32.045958 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.046636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:32.047137 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.048658 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.048783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbbd9f71-92, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:32.049072 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbbd9f71-92, col_values=(('qos', UUID('19fa7188-e8eb-49f7-b00d-67116dff8b06')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:32.049219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbbd9f71-92, col_values=(('external_ids', {'iface-id': 'fbbd9f71-9262-430f-a5a9-e3a7a3e591fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:3f:41', 'vm-uuid': '09ca8b1e-3f64-46ce-8448-dd96acf76688'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:32.049853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.050932 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:32.054979 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:32.055790 np0000003830 nova-compute[98984]: INFO os_vif [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92')
Jun 27 04:20:32.272882 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Successfully updated port: 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:20:32.317664 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-changed-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:32.318282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing instance network info cache due to event network-changed-3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:20:32.318282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:32.318282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:32.318770 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:20:32.457479 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:20:32.774619 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:32.971792 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Booting with volume b468b327-367a-4f62-ad68-e80f923c36d7 at /dev/vda
Jun 27 04:20:32.973534 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:33.015320 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:33.025113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:20:33.029475 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:20:33.043296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:33.085338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:20:33.085687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:20:33.093469 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:20:33.094321 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe1b:583b', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fe26:ae8a', 'fe80::419:d6ff:fe7a:6f35'] 
Jun 27 04:20:33.094904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:20:33.095010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:20:33.095351 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:33.095559 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating existing volume attachment record: 64cbadcf-3b6e-4182-8e74-5b4b47b94730 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:20:33.171693 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:33.576728 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:20:33.576857 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:20:33.576969 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No VIF found with MAC fa:16:3e:3f:3f:41, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:20:33.577491 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Using config drive
Jun 27 04:20:33.673789 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-f20103b4-9c43-45c7-adbd-ce28830bab2e req-f6a0935e-61a7-4099-8918-6701ed947ff3 service nova] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:33.674472 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:33.674726 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:20:34.082811 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:34.189330 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Creating config drive at /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.config
Jun 27 04:20:34.195199 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpck_hwf74 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:34.246678 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:20:34.249396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpck_hwf74" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:34.374338 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:34.497160 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:34.629714 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.647999 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.682204 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.734946 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.813862 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5dc6847f-f880-44e8-b190-928f2dc8d6e7 req-603a5c5a-8468-41a9-8318-2cf19b7986f4 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-plugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:34.814466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5dc6847f-f880-44e8-b190-928f2dc8d6e7 req-603a5c5a-8468-41a9-8318-2cf19b7986f4 service nova] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:34.814767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5dc6847f-f880-44e8-b190-928f2dc8d6e7 req-603a5c5a-8468-41a9-8318-2cf19b7986f4 service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:34.814767 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5dc6847f-f880-44e8-b190-928f2dc8d6e7 req-603a5c5a-8468-41a9-8318-2cf19b7986f4 service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:34.814767 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5dc6847f-f880-44e8-b190-928f2dc8d6e7 req-603a5c5a-8468-41a9-8318-2cf19b7986f4 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Processing event network-vif-plugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:20:34.963206 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.967432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.970106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.987312 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:34.999470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:34.999784 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance network_info: |[{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:20:35.185389 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:20:35.186461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:20:35.187656 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Creating image(s)
Jun 27 04:20:35.188937 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:20:35.189139 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Ensure instance console log exists: /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:20:35.189423 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:35.189633 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:35.189756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:35.190248 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Start _get_guest_xml network_info=[{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '64cbadcf-3b6e-4182-8e74-5b4b47b94730', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd59bcbdc-07e2-4623-b40d-21387c81a517', 'attached_at': '', 'detached_at': '', 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'serial': 'b468b327-367a-4f62-ad68-e80f923c36d7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:20:35.195174 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:20:35.196242 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-58106531', uuid='d59bcbdc-07e2-4623-b40d-21387c81a517'), owner=OwnerMeta(userid='65af8bebc9f64e179fabdbd5fb64c177', username='tempest-TestShelveInstance-2061898292-project-member', projectid='440506966fc7496e9b8956b939ce8a2a', projectname='tempest-TestShelveInstance-2061898292'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534035.1958988) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:20:35.199229 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:20:35.199575 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:20:35.201017 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:20:35.201197 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:20:35.202146 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:20:35.202476 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:20:35.202646 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:20:35.202737 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:20:35.202857 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:20:35.202943 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:20:35.203052 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:20:35.203242 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:20:35.203341 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:20:35.203447 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:20:35.203561 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:20:35.203705 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:20:35.213997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:20:35.214339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:35.214658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:35.215002 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:35.215267 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:20:35.228935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:35.229698 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:35.230196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:35.230384 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:20:35.230936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:35.231183 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:20:35.241408 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:20:35.241408 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:35.249185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:20:35.249185 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7] added
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:35.254924 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:35.255321 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:20:35.255321 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:20:35.255404 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7] added
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:35.261249 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:35.261650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:20:35.261843 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:20:35.262000 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:20:35.421523 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534035.4208632, 09ca8b1e-3f64-46ce-8448-dd96acf76688 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:35.421523 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] VM Started (Lifecycle Event)
Jun 27 04:20:35.422305 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:20:35.425261 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:20:35.427573 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Instance spawned successfully.
Jun 27 04:20:35.427846 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:20:35.485943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:35.486176 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:35.486348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:35.488814 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98984) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
Jun 27 04:20:35.489491 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'flavor' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:35.830306 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:35.924240 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:35.926034 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:35.933966 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:35.934121 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:35.934463 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:35.934732 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:35.935009 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:35.935269 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:36.255829 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:20:36.262437 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:20:36.271428 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:20:36.281581 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.287259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.295442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.309524 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:36.312378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.312378 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.312378 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.312378 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.312378 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:36.312583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.312583 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.312583 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.312583 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.312583 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:36.334294 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:36.334439 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:36.334611 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:36.334739 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:20:36.341679 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260]
Jun 27 04:20:36.341679 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260] successful.
Jun 27 04:20:36.341679 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.347234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260]
Jun 27 04:20:36.347234 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260] successful.
Jun 27 04:20:36.347234 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.355175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.363421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.376117 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.376368 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:36.376483 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:36.376623 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:20:36.377433 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] HCTL ('11', '-', '-', 0) found on session 166 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:20:36.377569 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.378557 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:36.378778 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:36.379001 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:36.379109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:20:36.379990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] HCTL ('12', '-', '-', 0) found on session 167 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:20:36.380105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:20:36.393216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching for a device in session 166 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:36.393416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:20:36.404944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching for a device in session 167 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:36.428044 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:20:36.428344 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534036.4281652, 09ca8b1e-3f64-46ce-8448-dd96acf76688 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:36.428484 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] VM Paused (Lifecycle Event)
Jun 27 04:20:36.439771 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Took 6.40 seconds to spawn the instance on the hypervisor.
Jun 27 04:20:36.440017 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:36.522105 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:36.523636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:36.545899 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:36.554321 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:36.580190 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:36.716354 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a5f5a6a7-60b1-4ed2-8722-9fc07e8b6b59 req-60b79b3a-8479-4e0c-b229-1cd4539d454f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:36.716354 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a5f5a6a7-60b1-4ed2-8722-9fc07e8b6b59 req-60b79b3a-8479-4e0c-b229-1cd4539d454f service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:36.716354 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a5f5a6a7-60b1-4ed2-8722-9fc07e8b6b59 req-60b79b3a-8479-4e0c-b229-1cd4539d454f service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:36.716354 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a5f5a6a7-60b1-4ed2-8722-9fc07e8b6b59 req-60b79b3a-8479-4e0c-b229-1cd4539d454f service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:36.716354 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a5f5a6a7-60b1-4ed2-8722-9fc07e8b6b59 req-60b79b3a-8479-4e0c-b229-1cd4539d454f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:36.716354 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-a5f5a6a7-60b1-4ed2-8722-9fc07e8b6b59 req-60b79b3a-8479-4e0c-b229-1cd4539d454f service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received unexpected event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with vm_state active and task_state powering-off.
Jun 27 04:20:36.853097 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance destroyed successfully.
Jun 27 04:20:36.853667 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'numa_topology' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:36.895796 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-de2cbb4a-c356-4f15-9043-2026187f3e36 req-729e5722-9870-47a1-872f-b7e486becf09 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-plugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:36.896084 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-de2cbb4a-c356-4f15-9043-2026187f3e36 req-729e5722-9870-47a1-872f-b7e486becf09 service nova] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:36.896084 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-de2cbb4a-c356-4f15-9043-2026187f3e36 req-729e5722-9870-47a1-872f-b7e486becf09 service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:36.896469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-de2cbb4a-c356-4f15-9043-2026187f3e36 req-729e5722-9870-47a1-872f-b7e486becf09 service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:36.896469 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-de2cbb4a-c356-4f15-9043-2026187f3e36 req-729e5722-9870-47a1-872f-b7e486becf09 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] No waiting events found dispatching network-vif-plugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:36.896643 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-de2cbb4a-c356-4f15-9043-2026187f3e36 req-729e5722-9870-47a1-872f-b7e486becf09 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received unexpected event network-vif-plugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc for instance with vm_state active and task_state None.
Jun 27 04:20:36.931061 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:36.933612 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534036.9332876, 09ca8b1e-3f64-46ce-8448-dd96acf76688 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:36.933753 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] VM Resumed (Lifecycle Event)
Jun 27 04:20:36.948188 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Took 11.73 seconds to build instance.
Jun 27 04:20:37.051251 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:37.360974 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<4266fe64-0d80-458a-9add-b7be6ac0bccc> lazy-loaded attributes: flavor,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:20:37.361435 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:37.365678 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:20:37.367937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:37.408245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching for a device in session 167 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:37.408455 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:20:37.436521 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:37.441116 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:37.450197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.241s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:37.453666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:37.456857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:37.546572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:37.552528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:37.647453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:37.647959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:37.740902 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:37.741318 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:20:37.746750 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:20:37.748119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:37.794648 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:37.795785 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51130MB free_disk=72.00691223144531GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:20:37.795785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:37.796130 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:37.868011 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Waiting for libvirt event about the detach of device vdb with device alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 is timed out.
Jun 27 04:20:37.871930 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-55947145-1780-4880-9bdd-c82c4fe53c27 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.386s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Found disk vdb by alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Failed to detach device vdb with device alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 from the live domain config. Libvirt did not report any error but the device is still in the config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2684}}
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] (2/8): Attempting to detach device vdb with device alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <alias name="ua-8f6390d4-a0db-489c-ac30-faae059a4aef"/>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <serial>8f6390d4-a0db-489c-ac30-faae059a4aef</serial>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="3ae2f71d-2d5b-4e30-83d2-fb3a3b684cda"/>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:20:37.877759 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:20:37.944156 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999677339999835 future=<Future at 0x7ec5181fc950 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:37.944382 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999400684999728 future=<Future at 0x7ec5181fc950 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:37.944528 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999262762999933 future=<Future at 0x7ec5181fc950 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:38.250477 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Found WWN 33000000028e06acb for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:20:38.250805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:38.250974 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000028e06acb', 'path': '/dev/dm-4', 'multipath_id': '33000000028e06acb'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:38.251117 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000028e06acb', 'path': '/dev/dm-4', 'multipath_id': '33000000028e06acb'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:20:38.456165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-changed-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:38.456570 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Refreshing instance network info cache due to event network-changed-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:20:38.456570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] Acquiring lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:38.456570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] Acquired lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:38.456931 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Refreshing network info cache for port fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:20:38.601987 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534038.6016002, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => ua-8f6390d4-a0db-489c-ac30-faae059a4aef> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:20:38.603578 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8f6390d4-a0db-489c-ac30-faae059a4aef for instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:20:38.606941 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully detached device vdb from instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 from the live domain config.
Jun 27 04:20:38.611838 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:20:38.611838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:38.611838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:38.611838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:38.611838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f6390d4-a0db-489c-ac30-faae059a4aef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:20:38.611838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '167')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '164')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef', '165')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:20:38.642575 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538295bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:20:38.643695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:20:38.644163 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Flush multipath device 330000000fe904d7e {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:20:38.679889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:20:38.732063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:20:38.757876 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-58106531',display_name='tempest-TestShelveInstance-server-58106531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testshelveinstance-server-58106531',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe+ejNG6I/pWb+AZCcwWinJ33GgAdTksGeIm3ue+7XPhNJalPHAyF13nvR0eWLQZWWe4NEYEkJtgAl7BHh2eiWVNjgi+SI02463wKpK/bE8asn7iZ/qRbDMVrr7RQtiiw==',key_name='tempest-TestShelveInstance-1562266970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='440506966fc7496e9b8956b939ce8a2a',ramdisk_id='',reservation_id='r-gjclb679',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2061898292',owner_user_name='tempest-TestShelveInstance-2061898292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:20:32Z,user_data=None,user_id='65af8bebc9f64e179fabdbd5fb64c177',uuid=d59bcbdc-07e2-4623-b40d-21387c81a517,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:20:38.758086 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converting VIF {"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:38.758745 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:38.759374 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'pci_devices' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:38.768289 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0855d21-aee8-4ddc-bc1e-63c57e9bf76b req-95cf3b59-d69f-43bd-ad1c-948bfaf1fc57 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:38.768289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0855d21-aee8-4ddc-bc1e-63c57e9bf76b req-95cf3b59-d69f-43bd-ad1c-948bfaf1fc57 service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:38.768289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0855d21-aee8-4ddc-bc1e-63c57e9bf76b req-95cf3b59-d69f-43bd-ad1c-948bfaf1fc57 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:38.768289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0855d21-aee8-4ddc-bc1e-63c57e9bf76b req-95cf3b59-d69f-43bd-ad1c-948bfaf1fc57 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:38.768289 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0855d21-aee8-4ddc-bc1e-63c57e9bf76b req-95cf3b59-d69f-43bd-ad1c-948bfaf1fc57 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:38.768289 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c0855d21-aee8-4ddc-bc1e-63c57e9bf76b req-95cf3b59-d69f-43bd-ad1c-948bfaf1fc57 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received unexpected event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with vm_state stopped and task_state None.
Jun 27 04:20:38.778467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:20:38.778467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:20:38.779178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:20:38.789819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:20:38.790008 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:20:38.801324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:38.841544 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260]
Jun 27 04:20:38.841544 np0000003830 nova-compute[98984]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.40.100,3260] successful.
Jun 27 04:20:38.841544 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:38.854194 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:20:38.854305 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4266fe64-0d80-458a-9add-b7be6ac0bccc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:20:38.854402 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:20:38.854522 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance d59bcbdc-07e2-4623-b40d-21387c81a517 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:20:38.854673 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 4 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:20:38.854787 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=16 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:20:37 up 43 min,  2 users,  load average: 4.65, 7.13, 6.11\n', 'num_instances': '4', 'num_vm_active': '2', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_56c1eb5f65f0446eae1f4967af349cd1': '1', 'io_workload': '1', 'num_vm_stopped': '1', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '1', 'num_proj_39e8dbaf15594c24944a445d42712c19': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_440506966fc7496e9b8956b939ce8a2a': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:20:38.858191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:38.869317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:38.901272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260]
Jun 27 04:20:38.901272 np0000003830 nova-compute[98984]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-8f6390d4-a0db-489c-ac30-faae059a4aef, portal: 192.168.50.100,3260] successful.
Jun 27 04:20:38.901272 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:38.926247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:38.927473 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:38.927674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] <== disconnect_volume: return (316ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:38.927835 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:20:38.958773 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:39.138795 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:20:39.139023 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <uuid>d59bcbdc-07e2-4623-b40d-21387c81a517</uuid>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <name>instance-00000042</name>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestShelveInstance-server-58106531</nova:name>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:20:35</nova:creationTime>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:user uuid="65af8bebc9f64e179fabdbd5fb64c177">tempest-TestShelveInstance-2061898292-project-member</nova:user>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:project uuid="440506966fc7496e9b8956b939ce8a2a">tempest-TestShelveInstance-2061898292</nova:project>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         <nova:port uuid="3797d972-cb4e-41f3-990f-8342e3789814">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <entry name="serial">d59bcbdc-07e2-4623-b40d-21387c81a517</entry>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <entry name="uuid">d59bcbdc-07e2-4623-b40d-21387c81a517</entry>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <alias name="ua-b468b327-367a-4f62-ad68-e80f923c36d7"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-4"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <serial>b468b327-367a-4f62-ad68-e80f923c36d7</serial>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:59:7b:3a"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <target dev="tap3797d972-cb"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/console.log" append="off"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:20:39.265078 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:20:39.267169 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Preparing to wait for external event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:20:39.267169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:39.267169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:39.267169 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:39.267169 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-58106531',display_name='tempest-TestShelveInstance-server-58106531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testshelveinstance-server-58106531',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe+ejNG6I/pWb+AZCcwWinJ33GgAdTksGeIm3ue+7XPhNJalPHAyF13nvR0eWLQZWWe4NEYEkJtgAl7BHh2eiWVNjgi+SI02463wKpK/bE8asn7iZ/qRbDMVrr7RQtiiw==',key_name='tempest-TestShelveInstance-1562266970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='440506966fc7496e9b8956b939ce8a2a',ramdisk_id='',reservation_id='r-gjclb679',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2061898292',owner_user_name='tempest-TestShelveInstance-2061898292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:20:32Z,user_data=None,user_id='65af8bebc9f64e179fabdbd5fb64c177',uuid=d59bcbdc-07e2-4623-b40d-21387c81a517,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:20:39.267169 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converting VIF {"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:39.267400 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:39.267668 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:20:39.268218 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.268576 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:39.268857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:20:39.269553 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.269712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46e596e3-dba8-5721-98cd-ed9406412cb8', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:39.270421 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.271146 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:39.277542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.278792 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.278950 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3797d972-cb, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:39.279337 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3797d972-cb, col_values=(('qos', UUID('30e84ecc-1b21-4a01-af74-86f1b368dce2')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:39.279529 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3797d972-cb, col_values=(('external_ids', {'iface-id': '3797d972-cb4e-41f3-990f-8342e3789814', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:7b:3a', 'vm-uuid': 'd59bcbdc-07e2-4623-b40d-21387c81a517'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:39.281523 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.281523 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:39.290520 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:39.291864 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.293066 np0000003830 nova-compute[98984]: INFO os_vif [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb')
Jun 27 04:20:39.403967 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updated VIF entry in instance network info cache for port fbbd9f71-9262-430f-a5a9-e3a7a3e591fc. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:20:39.404265 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updating instance_info_cache with network_info: [{"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:39.425131 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'flavor' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:39.496878 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'flavor' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:39.644544 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:20:39.687381 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:39.906435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8dc94eba-93e4-4fa1-9f7b-e8817f580cb7 req-1386158b-fbed-4b02-a8e1-ff46ecf2f407 service nova] Releasing lock "refresh_cache-09ca8b1e-3f64-46ce-8448-dd96acf76688" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:39.928936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:39.929140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:39.929208 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:20:39.929360 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'info_cache' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:40.150857 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:20:40.151356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.355s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:40.151697 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:20:40.431898 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<4266fe64-0d80-458a-9add-b7be6ac0bccc> lazy-loaded attributes: flavor,info_cache {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:20:40.502613 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-da3bfda7-54e2-417d-a736-0f7e4d59b732 tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.271s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:40.823512 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:20:40.823802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:20:40.823867 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] No VIF found with MAC fa:16:3e:59:7b:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:20:40.824327 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Using config drive
Jun 27 04:20:40.933871 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:41.152050 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:41.152392 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:41.152747 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:41.153140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:20:41.153473 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.67 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:20:41.264283 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:41.332055 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:41.421627 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updating instance_info_cache with network_info: [{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:41.464042 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Creating config drive at /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config
Jun 27 04:20:41.469384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv_ukne0h {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:41.547999 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv_ukne0h" returned: 0 in 0.078s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:41.611191 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:41.611370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:41.611598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:41.611741 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:41.611850 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:41.615338 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Terminating instance
Jun 27 04:20:41.827838 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:41.828537 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:20:41.830071 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:20:41.830340 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:20:41.926011 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-4266fe64-0d80-458a-9add-b7be6ac0bccc" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:41.946145 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:41.947834 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:41.969288 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.065710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.118591 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:20:42.152778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.161242 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8d62ec38-b36b-49c3-a83d-223129bc8417 req-6e588e4d-4f55-489c-9e79-223a6ab9c066 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:42.161422 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.161605 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8d62ec38-b36b-49c3-a83d-223129bc8417 req-6e588e4d-4f55-489c-9e79-223a6ab9c066 service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:42.161780 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8d62ec38-b36b-49c3-a83d-223129bc8417 req-6e588e4d-4f55-489c-9e79-223a6ab9c066 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:42.162119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8d62ec38-b36b-49c3-a83d-223129bc8417 req-6e588e4d-4f55-489c-9e79-223a6ab9c066 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:42.162119 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8d62ec38-b36b-49c3-a83d-223129bc8417 req-6e588e4d-4f55-489c-9e79-223a6ab9c066 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Processing event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:20:42.174425 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.284606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.298650 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.302955 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.326568 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.338974 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.347426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a854d4a-2207-4380-bef1-f92e56af636d req-a1d25883-46e3-48e3-8f55-4868164ef6f1 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:42.347426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a854d4a-2207-4380-bef1-f92e56af636d req-a1d25883-46e3-48e3-8f55-4868164ef6f1 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:42.347426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a854d4a-2207-4380-bef1-f92e56af636d req-a1d25883-46e3-48e3-8f55-4868164ef6f1 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:42.347426 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-8a854d4a-2207-4380-bef1-f92e56af636d req-a1d25883-46e3-48e3-8f55-4868164ef6f1 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:42.347426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a854d4a-2207-4380-bef1-f92e56af636d req-a1d25883-46e3-48e3-8f55-4868164ef6f1 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:42.347426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8a854d4a-2207-4380-bef1-f92e56af636d req-a1d25883-46e3-48e3-8f55-4868164ef6f1 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:20:42.444682 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.479590 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.481622 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998829673000273 future=<Future at 0x7ec5181fdca0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:42.487010 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Instance destroyed successfully.
Jun 27 04:20:42.487519 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lazy-loading 'resources' on Instance uuid 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:42.494533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.527994 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.941390 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance destroyed successfully.
Jun 27 04:20:42.941801 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'numa_topology' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:42.952214 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534042.9516928, d59bcbdc-07e2-4623-b40d-21387c81a517 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:42.952588 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:20:42.953767 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Started (Lifecycle Event)
Jun 27 04:20:42.954482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:20:42.958076 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance spawned successfully.
Jun 27 04:20:42.959280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:20:42.990078 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1455892126',display_name='tempest-TestEncryptedCinderVolumes-server-1455892126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testencryptedcindervolumes-server-1455892126',id=60,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBvtnVuAVh7Stk99WNr+9hS0gvcv6pagXf95fsollMl5Fq/uCKYvgIhdezsebaaHTUuhsjgW9VATomMObn8EirlkSWTLXRKARz8ZqT2vt7pcIXhZ6rivIohdoYCqZLjGw==',key_name='tempest-keypair-2052302505',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:20:10Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c1eb5f65f0446eae1f4967af349cd1',ramdisk_id='',reservation_id='r-zafxnuhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1777393507',owner_user_name='tempest-TestEncryptedCinderVolumes-1777393507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0a2a8189b804630997728bfb949fba1',uuid=4ac6d302-e622-4d21-9ee8-ac0fe6b003f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:20:42.990383 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converting VIF {"id": "00c7251a-b156-475a-99a5-48dafe19e9b6", "address": "fa:16:3e:26:ae:8a", "network": {"id": "dc0d082c-7efc-4863-850f-d9522331301e", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1035141523-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56c1eb5f65f0446eae1f4967af349cd1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap00c7251a-b1", "ovs_interfaceid": "00c7251a-b156-475a-99a5-48dafe19e9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:42.991288 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:42.991545 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:20:42.992821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.993082 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00c7251a-b1, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:42.993965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:42.994856 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:42.999761 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.000714 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.000861 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdc932ac-0725-4fb9-a568-6b24a087a560) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:43.001255 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.001702 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:43.006300 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.008509 np0000003830 nova-compute[98984]: INFO os_vif [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:ae:8a,bridge_name='br-int',has_traffic_filtering=True,id=00c7251a-b156-475a-99a5-48dafe19e9b6,network=Network(dc0d082c-7efc-4863-850f-d9522331301e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00c7251a-b1')
Jun 27 04:20:43.008904 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Deleting instance files /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_del
Jun 27 04:20:43.015974 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Deletion of /opt/stack/data/nova/instances/4ac6d302-e622-4d21-9ee8-ac0fe6b003f0_del complete
Jun 27 04:20:43.443598 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<4266fe64-0d80-458a-9add-b7be6ac0bccc> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:20:43.443940 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:43.457193 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:43.459592 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:43.471521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:43.471521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:43.471521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:43.471521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:43.471521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:43.471521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:20:43.525904 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Took 1.41 seconds to destroy the instance on the hypervisor.
Jun 27 04:20:43.526678 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:20:43.527112 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:20:43.527281 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:20:43.527712 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:43.602481 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:43.945738 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<4266fe64-0d80-458a-9add-b7be6ac0bccc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:20:43.946345 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-375405601',display_name='tempest-TestVolumeBootPattern-server-375405601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-375405601',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzwKD9L5+eOaLo5+4LX1FfFrZjdRoks72uLxfhP1LO8IbxMneGW4WXxfmVW+KceKBp/9/mlLmz7Xfn/ySaKmeDBGU4Xr4db6/43cXDP4LKYduucsKhm2mnxUbJNbKTWw==',key_name='tempest-keypair-1285558257',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:56Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-cljjhtz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=4266fe64-0d80-458a-9add-b7be6ac0bccc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:20:43.946561 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:43.946990 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:43.947184 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:20:43.949800 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.950060 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47ec8768-81, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:43.951162 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.951934 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:43.954794 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.955016 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65f20c1d-feec-4e8a-b84a-ae5c8a96c110) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:43.955565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.956132 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:43.956480 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:43.958254 np0000003830 nova-compute[98984]: INFO os_vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81')
Jun 27 04:20:43.959687 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:20:43.960081 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:43.960232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:43.960620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:43.960955 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:20:43.961131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:20:43.966325 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:20:43.966882 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534043.9664361, d59bcbdc-07e2-4623-b40d-21387c81a517 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:43.967513 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Paused (Lifecycle Event)
Jun 27 04:20:43.977141 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Took 8.79 seconds to spawn the instance on the hypervisor.
Jun 27 04:20:43.977570 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:43.987757 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:43.987757 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:43.987757 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:43.987757 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:43.987757 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '167')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '162')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '163')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518776ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sde, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:20:43.994218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 33000000066075f6c {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:20:44.060676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:20:44.106055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:20:44.146956 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:20:44.147137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:20:44.147986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:20:44.159509 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:20:44.159692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:20:44.170109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.206718 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260]
Jun 27 04:20:44.206718 np0000003830 nova-compute[98984]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260] successful.
Jun 27 04:20:44.206718 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.220564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.231244 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e9679534-9f77-4be6-b5cd-a9bed8b4f7d1 req-3e495d65-2768-4ba5-89b7-0c2fa5a44a30 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.231397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e9679534-9f77-4be6-b5cd-a9bed8b4f7d1 req-3e495d65-2768-4ba5-89b7-0c2fa5a44a30 service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.231550 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e9679534-9f77-4be6-b5cd-a9bed8b4f7d1 req-3e495d65-2768-4ba5-89b7-0c2fa5a44a30 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.231681 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e9679534-9f77-4be6-b5cd-a9bed8b4f7d1 req-3e495d65-2768-4ba5-89b7-0c2fa5a44a30 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.231807 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e9679534-9f77-4be6-b5cd-a9bed8b4f7d1 req-3e495d65-2768-4ba5-89b7-0c2fa5a44a30 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] No waiting events found dispatching network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:44.231965 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e9679534-9f77-4be6-b5cd-a9bed8b4f7d1 req-3e495d65-2768-4ba5-89b7-0c2fa5a44a30 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received unexpected event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 for instance with vm_state active and task_state None.
Jun 27 04:20:44.232514 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.259439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260]
Jun 27 04:20:44.259439 np0000003830 nova-compute[98984]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260] successful.
Jun 27 04:20:44.259439 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.271420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.271665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:44.271803 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (311ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:44.271954 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:20:44.275551 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Start _get_guest_xml network_info=[{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '5c41eb83-6806-497c-a35c-293908406b55', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '4266fe64-0d80-458a-9add-b7be6ac0bccc', 'attached_at': '', 'detached_at': '', 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'serial': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:20:44.277433 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:20:44.278732 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-375405601', uuid='4266fe64-0d80-458a-9add-b7be6ac0bccc'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534044.2783217) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:20:44.279770 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:20:44.280112 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:20:44.281146 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:20:44.281330 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:20:44.282346 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:20:44.282622 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:20:44.282780 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:20:44.282908 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:20:44.283059 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:20:44.283171 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:20:44.283291 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:20:44.283459 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:20:44.283602 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:20:44.283733 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:20:44.283871 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:20:44.284013 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:20:44.284179 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:44.398665 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.399018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.399172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.399282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.399376 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:44.399478 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:20:44.399596 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.399742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.399877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.399954 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.400051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:44.400184 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state active and task_state deleting.
Jun 27 04:20:44.400285 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.400384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.400598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.400598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.400687 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:44.400864 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received unexpected event network-vif-plugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with vm_state active and task_state deleting.
Jun 27 04:20:44.400864 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.400976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.401086 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.401185 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.401301 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:44.401395 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:20:44.401486 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.401604 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Acquiring lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.401755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.402157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.402278 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] No waiting events found dispatching network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:44.402424 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-unplugged-00c7251a-b156-475a-99a5-48dafe19e9b6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:20:44.402424 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Received event network-vif-deleted-00c7251a-b156-475a-99a5-48dafe19e9b6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:44.402576 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Neutron deleted interface 00c7251a-b156-475a-99a5-48dafe19e9b6; detaching it from the instance and deleting it from the info cache
Jun 27 04:20:44.404026 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-361ad6f0-3699-4b7b-aab8-e4b38aadc6ca req-712bb663-7174-42f3-a1b0-b0a87cdd1536 service nova] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Detach interface failed, port_id=00c7251a-b156-475a-99a5-48dafe19e9b6, reason: Instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:20:44.470483 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:44.473127 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534044.4728076, d59bcbdc-07e2-4623-b40d-21387c81a517 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:44.473306 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Resumed (Lifecycle Event)
Jun 27 04:20:44.487548 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Took 15.85 seconds to build instance.
Jun 27 04:20:44.568930 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:44.689508 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:44.789075 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<4266fe64-0d80-458a-9add-b7be6ac0bccc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:20:44.801297 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:20:44.900024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:20:44.900577 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:44.900943 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:44.901526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:44.901973 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:20:44.902388 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:44.902584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:44.904273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:44.904585 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:20:44.917807 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:44.918372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:44.918619 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:20:44.920136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:44.921734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:44.921946 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:20:44.932841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:20:44.932841 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.938750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:20:44.938750 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e] added
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:44.947429 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.948197 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:20:44.948197 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:20:44.948197 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e] added
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:20:44.952566 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:44.953104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:20:44.953104 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:20:44.953226 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:20:44.977021 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:44.982174 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:44.989147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.360s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:45.071328 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Took 1.54 seconds to deallocate network for instance.
Jun 27 04:20:45.579884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:45.580117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:45.806452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:20:45.806730 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:20:45.948509 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:20:45.954140 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:20:45.961918 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:20:45.971249 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:45.984191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:45.997041 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:46.001401 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.001401 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.001401 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:46.001584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.001584 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.001584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:46.009000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.009000 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.009000 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:46.009156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.009156 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.009156 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:46.035273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260]
Jun 27 04:20:46.035273 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260] successful.
Jun 27 04:20:46.035273 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:46.047461 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:46.052856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260]
Jun 27 04:20:46.052856 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260] successful.
Jun 27 04:20:46.052856 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:46.061829 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.061829 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.061829 np0000003830 nova-compute[98984]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.061829 np0000003830 nova-compute[98984]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.061829 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:46.062255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.062255 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.062255 np0000003830 nova-compute[98984]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.062255 np0000003830 nova-compute[98984]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.062255 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:46.062434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:46.062434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:20:46.063157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('7', '-', '-', 0) found on session 168 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:20:46.063319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:20:46.070237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:46.082293 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 168 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('8', '-', '-', 0) found on session 169 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:20:46.104722 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:20:46.121563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 169 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:46.121563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:20:46.316187 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:20:46.570051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-changed-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:46.570303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing instance network info cache due to event network-changed-3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:20:46.570464 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:20:46.570578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:20:46.570738 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:20:46.817015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.237s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:46.904065 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Deleted allocations for instance 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0
Jun 27 04:20:47.072777 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:47.082773 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 168 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:20:47.083010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:20:47.378848 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:47.540523 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updated VIF entry in instance network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:20:47.540523 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:47.911518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1ba89b49-a918-455a-af05-2c1a5444516f tempest-TestEncryptedCinderVolumes-1777393507 tempest-TestEncryptedCinderVolumes-1777393507-project-member] Lock "4ac6d302-e622-4d21-9ee8-ac0fe6b003f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.300s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:47.936524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 33000000066075f6c for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:20:47.936871 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:47.937079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000066075f6c', 'path': '/dev/dm-0', 'multipath_id': '33000000066075f6c'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:47.937240 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000066075f6c', 'path': '/dev/dm-0', 'multipath_id': '33000000066075f6c'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:20:48.042340 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9d9868ce-0e23-4344-a2b7-f5ab519b88ad req-d42dcd15-fbd2-4b1d-9a77-67396d06155b service nova] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:20:48.443027 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-375405601',display_name='tempest-TestVolumeBootPattern-server-375405601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-375405601',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzwKD9L5+eOaLo5+4LX1FfFrZjdRoks72uLxfhP1LO8IbxMneGW4WXxfmVW+KceKBp/9/mlLmz7Xfn/ySaKmeDBGU4Xr4db6/43cXDP4LKYduucsKhm2mnxUbJNbKTWw==',key_name='tempest-keypair-1285558257',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:56Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-cljjhtz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=4266fe64-0d80-458a-9add-b7be6ac0bccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:20:48.443578 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:48.443969 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:48.444545 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:48.946330 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Object Instance<4266fe64-0d80-458a-9add-b7be6ac0bccc> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <uuid>4266fe64-0d80-458a-9add-b7be6ac0bccc</uuid>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <name>instance-00000040</name>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-375405601</nova:name>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:20:44</nova:creationTime>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         <nova:port uuid="47ec8768-8197-4f94-9599-12d5b6d04d80">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <entry name="serial">4266fe64-0d80-458a-9add-b7be6ac0bccc</entry>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <entry name="uuid">4266fe64-0d80-458a-9add-b7be6ac0bccc</entry>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/disk.config"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <alias name="ua-2426dd44-ad07-42db-9e44-cdf1f5d1c69e"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <serial>2426dd44-ad07-42db-9e44-cdf1f5d1c69e</serial>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:1b:58:3b"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <target dev="tap47ec8768-81"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc/console.log" append="off"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:20:48.947314 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:20:48.949544 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:20:48.949544 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-375405601',display_name='tempest-TestVolumeBootPattern-server-375405601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-375405601',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzwKD9L5+eOaLo5+4LX1FfFrZjdRoks72uLxfhP1LO8IbxMneGW4WXxfmVW+KceKBp/9/mlLmz7Xfn/ySaKmeDBGU4Xr4db6/43cXDP4LKYduucsKhm2mnxUbJNbKTWw==',key_name='tempest-keypair-1285558257',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:56Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-cljjhtz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=4266fe64-0d80-458a-9add-b7be6ac0bccc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:20:48.949544 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:48.949544 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:48.949544 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:20:48.949892 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.950126 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:48.950412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:20:48.951127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.951289 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a27c1528-3b3a-5e5a-8495-f23b585473da', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:48.952107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.952731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:48.953171 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.954734 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.954897 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47ec8768-81, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:48.955275 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47ec8768-81, col_values=(('qos', UUID('d9987fb5-a5ee-43a4-99a7-ff79f057ec35')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:48.955432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47ec8768-81, col_values=(('external_ids', {'iface-id': '47ec8768-8197-4f94-9599-12d5b6d04d80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:58:3b', 'vm-uuid': '4266fe64-0d80-458a-9add-b7be6ac0bccc'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:48.956416 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.957272 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:48.961572 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:48.962690 np0000003830 nova-compute[98984]: INFO os_vif [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81')
Jun 27 04:20:49.362778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.390700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.484643 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.553654 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ac6ddebf-2597-40ba-824c-96057b7ab23a req-fac13718-1185-4b50-8ba2-023eeaaed6fe service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:49.553850 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ac6ddebf-2597-40ba-824c-96057b7ab23a req-fac13718-1185-4b50-8ba2-023eeaaed6fe service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:49.554001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ac6ddebf-2597-40ba-824c-96057b7ab23a req-fac13718-1185-4b50-8ba2-023eeaaed6fe service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:49.554091 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ac6ddebf-2597-40ba-824c-96057b7ab23a req-fac13718-1185-4b50-8ba2-023eeaaed6fe service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:49.554822 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ac6ddebf-2597-40ba-824c-96057b7ab23a req-fac13718-1185-4b50-8ba2-023eeaaed6fe service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:49.554953 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-ac6ddebf-2597-40ba-824c-96057b7ab23a req-fac13718-1185-4b50-8ba2-023eeaaed6fe service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received unexpected event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:20:49.691202 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.711578 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.713876 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.717475 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:49.734712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:50.209962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Removed pending STOPPED event for 4266fe64-0d80-458a-9add-b7be6ac0bccc due to new event <LifecycleEvent: 1782534050.2094862, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Resumed> {{(pid=98984) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}}
Jun 27 04:20:50.210172 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534050.2094862, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:50.210301 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] VM Resumed (Lifecycle Event)
Jun 27 04:20:50.211690 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance event wait completed in 0 seconds for  {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:20:50.215821 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance rebooted successfully.
Jun 27 04:20:50.714197 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:50.716725 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:51.220032 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 27 04:20:51.220374 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534051.2201338, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:51.220575 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] VM Started (Lifecycle Event)
Jun 27 04:20:51.398194 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:51.642307 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-126a9182-11fc-4cb8-a666-905ed190ea76 req-66d37c9d-f3a9-4e28-8b57-ce3e6ec519b2 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:51.643008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-126a9182-11fc-4cb8-a666-905ed190ea76 req-66d37c9d-f3a9-4e28-8b57-ce3e6ec519b2 service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:51.643008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-126a9182-11fc-4cb8-a666-905ed190ea76 req-66d37c9d-f3a9-4e28-8b57-ce3e6ec519b2 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:51.643008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-126a9182-11fc-4cb8-a666-905ed190ea76 req-66d37c9d-f3a9-4e28-8b57-ce3e6ec519b2 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:51.643639 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-126a9182-11fc-4cb8-a666-905ed190ea76 req-66d37c9d-f3a9-4e28-8b57-ce3e6ec519b2 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:51.643639 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-126a9182-11fc-4cb8-a666-905ed190ea76 req-66d37c9d-f3a9-4e28-8b57-ce3e6ec519b2 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received unexpected event network-vif-plugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with vm_state stopped and task_state powering-on.
Jun 27 04:20:51.728298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:51.734678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:20:51.737266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:20:51.737266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:20:51.737266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:1b:58:3b, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:20:51.737676 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2b4f845d-02a3-4c59-9013-e3fff8d684ea tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:52.239176 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] During sync_power_state the instance has a pending task (powering-on). Skip.
Jun 27 04:20:52.530922 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-91ed4169-d22c-4692-b4c7-7fe5a7410d40 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Get console output
Jun 27 04:20:52.536436 np0000003830 nova-compute[98984]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jun 27 04:20:52.944196 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003666030002023035 future=<Future at 0x7ec5181fc950 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:52.944755 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:52.944755 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.535503329000221 future=<Future at 0x7ec5181fdca0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:52.944755 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=4.535425956999916 future=<Future at 0x7ec5181fdca0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:53.193308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:54.185011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:54.700693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:54.725265 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:54.725441 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:54.725658 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:54.725798 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:54.725927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:54.728263 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Terminating instance
Jun 27 04:20:55.234595 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:20:55.251962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:55.254982 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:55.272367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:55.277287 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:55.303749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:55.397228 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b01776ec-e1c7-4076-8a0b-7809664902d0 req-4946c332-6df8-44b9-b242-02eedd555b47 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:55.397432 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b01776ec-e1c7-4076-8a0b-7809664902d0 req-4946c332-6df8-44b9-b242-02eedd555b47 service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:55.397680 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b01776ec-e1c7-4076-8a0b-7809664902d0 req-4946c332-6df8-44b9-b242-02eedd555b47 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:55.397816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b01776ec-e1c7-4076-8a0b-7809664902d0 req-4946c332-6df8-44b9-b242-02eedd555b47 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:55.397928 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b01776ec-e1c7-4076-8a0b-7809664902d0 req-4946c332-6df8-44b9-b242-02eedd555b47 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:55.398035 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b01776ec-e1c7-4076-8a0b-7809664902d0 req-4946c332-6df8-44b9-b242-02eedd555b47 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:20:55.563200 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999747630000002 future=<Future at 0x7ec5382c8a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:55.564995 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Instance destroyed successfully.
Jun 27 04:20:55.565282 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 4266fe64-0d80-458a-9add-b7be6ac0bccc {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:20:56.067557 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-375405601',display_name='tempest-TestVolumeBootPattern-server-375405601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-375405601',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzwKD9L5+eOaLo5+4LX1FfFrZjdRoks72uLxfhP1LO8IbxMneGW4WXxfmVW+KceKBp/9/mlLmz7Xfn/ySaKmeDBGU4Xr4db6/43cXDP4LKYduucsKhm2mnxUbJNbKTWw==',key_name='tempest-keypair-1285558257',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:19:56Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-cljjhtz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=4266fe64-0d80-458a-9add-b7be6ac0bccc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:20:56.067787 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "47ec8768-8197-4f94-9599-12d5b6d04d80", "address": "fa:16:3e:1b:58:3b", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ec8768-81", "ovs_interfaceid": "47ec8768-8197-4f94-9599-12d5b6d04d80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:20:56.068310 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:20:56.068576 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:20:56.069765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:56.069969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47ec8768-81, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:56.070955 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:56.071825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:56.072463 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:56.072636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9987fb5-a5ee-43a4-99a7-ff79f057ec35) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:20:56.073069 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:56.073515 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:20:56.073703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:20:56.075281 np0000003830 nova-compute[98984]: INFO os_vif [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:58:3b,bridge_name='br-int',has_traffic_filtering=True,id=47ec8768-8197-4f94-9599-12d5b6d04d80,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ec8768-81')
Jun 27 04:20:56.076785 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:20:56.077072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:20:56.077200 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:20:56.077546 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:20:56.077869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:20:56.077994 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:20:56.100083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:56.100083 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:56.100083 np0000003830 nova-compute[98984]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:56.100083 np0000003830 nova-compute[98984]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:56.100083 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:20:56.100263 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:56.100263 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:20:56.100263 np0000003830 nova-compute[98984]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:56.100263 np0000003830 nova-compute[98984]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e (non-flash)
Jun 27 04:20:56.100263 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:20:56.100380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '169')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:20:56.100465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '168')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:20:56.101268 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e', '169')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:20:56.102103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:20:56.102364 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:20:56.102602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 33000000066075f6c {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:20:56.154764 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:20:56.194960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:20:56.231906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:20:56.232058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:20:56.232802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:20:56.243756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:20:56.244101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:20:56.255129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:56.288065 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260]
Jun 27 04:20:56.288065 np0000003830 nova-compute[98984]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.40.100,3260] successful.
Jun 27 04:20:56.288065 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:56.302132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:56.313678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:56.347970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260]
Jun 27 04:20:56.347970 np0000003830 nova-compute[98984]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-2426dd44-ad07-42db-9e44-cdf1f5d1c69e, portal: 192.168.50.100,3260] successful.
Jun 27 04:20:56.347970 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:56.360362 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:20:56.360678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:20:56.360831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (283ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:20:56.360956 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:20:56.361265 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Deleting instance files /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc_del
Jun 27 04:20:56.361860 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Deletion of /opt/stack/data/nova/instances/4266fe64-0d80-458a-9add-b7be6ac0bccc_del complete
Jun 27 04:20:56.867904 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Took 1.63 seconds to destroy the instance on the hypervisor.
Jun 27 04:20:56.868667 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:20:56.868974 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:20:56.869077 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:20:56.869357 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:56.930651 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:20:57.451164 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:57.451702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] Acquiring lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:57.451702 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:57.451866 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:20:57.451957 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] No waiting events found dispatching network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:20:57.452072 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-unplugged-47ec8768-8197-4f94-9599-12d5b6d04d80 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:20:57.452204 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Received event network-vif-deleted-47ec8768-8197-4f94-9599-12d5b6d04d80 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:20:57.452314 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Neutron deleted interface 47ec8768-8197-4f94-9599-12d5b6d04d80; detaching it from the instance and deleting it from the info cache
Jun 27 04:20:57.454258 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4354b72d-bead-4a40-96ea-5c4bee87e366 req-b7deb47c-d882-4058-bf34-6812dc388751 service nova] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Detach interface failed, port_id=47ec8768-8197-4f94-9599-12d5b6d04d80, reason: Instance 4266fe64-0d80-458a-9add-b7be6ac0bccc could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:20:57.480343 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004028670000479906 future=<Future at 0x7ec5181fdca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:57.481002 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Emitting event <LifecycleEvent: 1782534042.4798017, 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:20:57.481180 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:57.481415 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] VM Stopped (Lifecycle Event)
Jun 27 04:20:57.481545 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=13.081391139000061 future=<Future at 0x7ec5382c8a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:57.481687 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=13.081241104999663 future=<Future at 0x7ec5382c8a40 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:20:57.817163 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:20:57.983976 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: 4ac6d302-e622-4d21-9ee8-ac0fe6b003f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:20:58.319435 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:20:58.876284 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Took 0.56 seconds to detach 1 volumes for instance.
Jun 27 04:20:59.381725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:20:59.381913 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:20:59.545984 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:20:59.546170 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:20:59.710539 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:00.048644 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:00.554881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.173s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:00.602387 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 4266fe64-0d80-458a-9add-b7be6ac0bccc
Jun 27 04:21:01.073566 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:01.613518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6b026982-c7ea-4ae4-b4c7-fdee9037900a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "4266fe64-0d80-458a-9add-b7be6ac0bccc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.886s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:04.719152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:06.074995 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:06.671400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:06.671614 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:07.173343 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:21:07.720150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:07.720452 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:07.724406 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:21:07.724618 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Claim successful on node np0000003830
Jun 27 04:21:08.891301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:08.891737 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:09.395651 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:09.721009 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:09.902600 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.182s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:09.903230 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:21:10.410123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:21:10.410358 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:21:10.410688 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:10.411020 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:10.543178 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:21:10.563295 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00034346100028415094 future=<Future at 0x7ec5382c8a40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:10.563719 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] Emitting event <LifecycleEvent: 1782534055.5628514, 4266fe64-0d80-458a-9add-b7be6ac0bccc => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:10.563855 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:10.563978 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] VM Stopped (Lifecycle Event)
Jun 27 04:21:10.913234 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:21:11.066436 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a6adf743-d03e-43c0-920c-00e20a10a2d9 tempest-ServersNegativeTestJSON-1704939525 tempest-ServersNegativeTestJSON-1704939525-project-member] [instance: 4266fe64-0d80-458a-9add-b7be6ac0bccc] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:11.081834 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:11.204519 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Successfully created port: 3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:21:11.417540 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:21:11.469114 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:11.792586 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Successfully updated port: 3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:21:11.878387 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-changed-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:11.878730 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Refreshing instance network info cache due to event network-changed-3909db0f-7e44-4988-9f68-283ba88d6631. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:21:11.878948 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] Acquiring lock "refresh_cache-7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:11.879092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] Acquired lock "refresh_cache-7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:11.879245 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Refreshing network info cache for port 3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:21:11.922002 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Booting with volume snapshot a181b25e-15ab-4540-ba6d-4aa3ac79044e at /dev/vda
Jun 27 04:21:12.294655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:12.381887 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:12.447104 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:21:12.583554 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:13.085380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-371a1d82-4a75-490a-a264-310ea53b8092 req-2fb86765-93b0-4793-a114-0282db9c76aa service nova] Releasing lock "refresh_cache-7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:13.085853 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:13.086029 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:21:13.655506 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:21:13.808154 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:13.951794 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Updating instance_info_cache with network_info: [{"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:14.453653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:14.454220 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Instance network_info: |[{"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:21:14.522120 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:14.522711 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:14.523987 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Shelve offloading
Jun 27 04:21:14.723364 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:15.110456 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:15.110657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:15.368804 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:15.380011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:21:15.401488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:15.450544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:21:15.450886 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:21:15.458790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:21:15.461515 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe3f:3f41', 'fe80::b8db:42ff:feed:256c', 'fe80::fc16:3eff:fe59:7b3a', 'fe80::f84b:90ff:fed6:7073'] 
Jun 27 04:21:15.461690 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:21:15.461825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:21:15.462107 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:15.462347 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Updating existing volume attachment record: 42898625-322b-4cd1-95ba-6217367f6b05 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:21:15.548909 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:15.551219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:15.567264 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:15.589006 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:15.614021 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'flavor' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:15.675073 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-351012a2-2d8f-437b-8549-68c3db064d99 req-f4a78a43-ae57-4d5f-b3a6-e8ee247d4c15 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:15.675568 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-351012a2-2d8f-437b-8549-68c3db064d99 req-f4a78a43-ae57-4d5f-b3a6-e8ee247d4c15 service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:15.675778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-351012a2-2d8f-437b-8549-68c3db064d99 req-f4a78a43-ae57-4d5f-b3a6-e8ee247d4c15 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:15.675905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-351012a2-2d8f-437b-8549-68c3db064d99 req-f4a78a43-ae57-4d5f-b3a6-e8ee247d4c15 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:15.676040 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-351012a2-2d8f-437b-8549-68c3db064d99 req-f4a78a43-ae57-4d5f-b3a6-e8ee247d4c15 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] No waiting events found dispatching network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:15.676150 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-351012a2-2d8f-437b-8549-68c3db064d99 req-f4a78a43-ae57-4d5f-b3a6-e8ee247d4c15 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received unexpected event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 for instance with vm_state active and task_state shelving.
Jun 27 04:21:15.842338 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999685406000026 future=<Future at 0x7ec518353f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:15.842763 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999261171000398 future=<Future at 0x7ec518353f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:15.843028 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998960232000172 future=<Future at 0x7ec518353f80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:15.844902 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance destroyed successfully.
Jun 27 04:21:15.845299 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'numa_topology' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:16.076544 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:16.347115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:16.349174 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:16.349269 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:16.349392 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:21:16.619167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:16.851419 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:17.121624 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:17.238734 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:17.563945 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:21:17.565134 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:21:17.565405 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Creating image(s)
Jun 27 04:21:17.565788 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:21:17.565958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Ensure instance console log exists: /opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:21:17.566198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:17.566353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:17.566464 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:17.566915 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Start _get_guest_xml network_info=[{"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '42898625-322b-4cd1-95ba-6217367f6b05', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7afdbcc6-4088-4cce-a6b3-08dc1712a3f0', 'attached_at': '', 'detached_at': '', 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'serial': '2183f3d2-df81-4b09-bb3a-8679205ce721'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:21:17.569456 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:21:17.570466 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-151152098', uuid='7afdbcc6-4088-4cce-a6b3-08dc1712a3f0'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534077.5701432) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:21:17.571510 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:21:17.571827 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:21:17.572747 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:21:17.572900 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:21:17.573697 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:21:17.573944 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:21:17.574073 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:21:17.574166 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:21:17.574272 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:21:17.574355 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:21:17.574446 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:21:17.574615 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:21:17.574731 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:21:17.574828 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:21:17.574923 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:21:17.575040 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:21:17.584257 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:21:17.584532 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:17.584672 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:17.684292 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:17.684745 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:17.684817 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attaching volume c1805556-67c6-482f-9da6-e7dc2946166e to /dev/vdb
Jun 27 04:21:17.721172 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:17.727484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2ff5249b-3f1d-4681-b683-15192e75053c req-591b1a32-e109-4eb3-a302-5ef0366e7255 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:17.727790 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2ff5249b-3f1d-4681-b683-15192e75053c req-591b1a32-e109-4eb3-a302-5ef0366e7255 service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:17.727973 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2ff5249b-3f1d-4681-b683-15192e75053c req-591b1a32-e109-4eb3-a302-5ef0366e7255 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:17.728131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2ff5249b-3f1d-4681-b683-15192e75053c req-591b1a32-e109-4eb3-a302-5ef0366e7255 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:17.728282 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2ff5249b-3f1d-4681-b683-15192e75053c req-591b1a32-e109-4eb3-a302-5ef0366e7255 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] No waiting events found dispatching network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:17.728418 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2ff5249b-3f1d-4681-b683-15192e75053c req-591b1a32-e109-4eb3-a302-5ef0366e7255 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received unexpected event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 for instance with vm_state active and task_state shelving.
Jun 27 04:21:17.731869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:21:17.741017 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:17.741618 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:17.741618 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:17.754402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:17.797559 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:21:17.798021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:21:17.807272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:21:17.808651 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe3f:3f41', 'fe80::b8db:42ff:feed:256c'] 
Jun 27 04:21:17.808651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:21:17.808796 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:21:17.809001 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:17.809292 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updating existing volume attachment record: ab90aeee-b5c4-4fe8-87eb-553bceabe2c2 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:21:18.139691 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance destroyed successfully.
Jun 27 04:21:18.140542 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'resources' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:18.361877 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:21:18.362265 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1805556-67c6-482f-9da6-e7dc2946166e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:18.362460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:18.642929 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Object Instance<d59bcbdc-07e2-4623-b40d-21387c81a517> lazy-loaded attributes: numa_topology,resources {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:21:18.643554 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-58106531',display_name='tempest-TestShelveInstance-server-58106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testshelveinstance-server-58106531',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe+ejNG6I/pWb+AZCcwWinJ33GgAdTksGeIm3ue+7XPhNJalPHAyF13nvR0eWLQZWWe4NEYEkJtgAl7BHh2eiWVNjgi+SI02463wKpK/bE8asn7iZ/qRbDMVrr7RQtiiw==',key_name='tempest-TestShelveInstance-1562266970',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:20:43Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='440506966fc7496e9b8956b939ce8a2a',ramdisk_id='',reservation_id='r-gjclb679',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2061898292',owner_user_name='tempest-TestShelveInstance-2061898292-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:44Z,user_data=None,user_id='65af8bebc9f64e179fabdbd5fb64c177',uuid=d59bcbdc-07e2-4623-b40d-21387c81a517,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:21:18.643750 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converting VIF {"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:18.644513 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:18.644732 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:21:18.646730 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:18.647183 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3797d972-cb, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:18.648361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:18.649419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:18.650029 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:18.650192 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30e84ecc-1b21-4a01-af74-86f1b368dce2) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:18.650640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:18.651077 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:18.651196 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:18.652969 np0000003830 nova-compute[98984]: INFO os_vif [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb')
Jun 27 04:21:18.654379 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:21:18.654725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:18.654872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:19.339759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.755s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:19.340181 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:21:19.351670 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:19.352269 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:19.352777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:19.353012 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:19.353360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:19.353531 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:19.365262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:19.365262 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:19.369375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:19.369375 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721] added
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:19.376682 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:19.376934 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:19.377093 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:19.377278 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721] added
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:19.381439 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:19.381637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:19.381731 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:19.381856 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:19.724117 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:19.786424 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-changed-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:19.786854 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing instance network info cache due to event network-changed-3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:21:19.787021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:19.787137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:19.787258 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:21:20.289722 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:20.377764 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:20.382252 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:20.390810 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:20.406456 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.413504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.421182 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.426775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.426775 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.426775 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.426775 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:20.426952 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.426952 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.426952 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.426952 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:20.434883 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.434883 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.434883 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.434883 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:20.435070 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.435070 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.435070 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.435070 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:20.462178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.50.100,3260]
Jun 27 04:21:20.462178 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:20.462178 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.462891 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.40.100,3260]
Jun 27 04:21:20.462891 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:20.462891 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.475531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.480007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.490540 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:20.490899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:20.490899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:20.491641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('9', '-', '-', 0) found on session 173 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:20.491779 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:20.497171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.497171 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.497171 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.497171 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.497171 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.497171 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:20.497391 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.497391 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:20.497391 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:20.497391 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.497391 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:20.497391 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:20.497736 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:20.497851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:20.499049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('8', '-', '-', 0) found on session 172 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:20.499232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:20.510639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 173 and hctl ['9', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:20.510763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:20.513782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 172 and hctl ['8', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:20.513782 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:20.621642 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:20.768229 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updated VIF entry in instance network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:21:20.768480 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": null, "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3797d972-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:21.270373 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19a04cb0-f7a9-438d-862b-b31dbed5db1b req-d53008f1-c5a8-40e2-aea9-fcc998fe6a4b service nova] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:21.353650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:21:22.368968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 33000000000f3e083 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:21:22.369337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:22.369337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (4784ms) {'type': 'block', 'scsi_wwn': '33000000000f3e083', 'path': '/dev/dm-0', 'multipath_id': '33000000000f3e083'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:22.369399 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000000f3e083', 'path': '/dev/dm-0', 'multipath_id': '33000000000f3e083'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:21:22.369962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.007s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:22.370777 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1805556-67c6-482f-9da6-e7dc2946166e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:21:22.383988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:22.384856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:22.386154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:22.386154 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:22.386521 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:22.387300 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:22.396133 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:22.396133 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:22.401584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:22.401584 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e] added
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:22.407179 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:22.407464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:22.407583 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:22.407751 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e] added
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:22.412517 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:22.412741 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:22.413030 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:22.413261 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:22.875178 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-151152098',display_name='tempest-TestVolumeBootPattern-server-151152098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-151152098',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-tqpe9fsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:21:11Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=7afdbcc6-4088-4cce-a6b3-08dc1712a3f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:21:22.875436 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:22.875922 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:22.876670 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <uuid>7afdbcc6-4088-4cce-a6b3-08dc1712a3f0</uuid>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <name>instance-00000043</name>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-151152098</nova:name>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:21:17</nova:creationTime>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         <nova:port uuid="3909db0f-7e44-4988-9f68-283ba88d6631">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <entry name="serial">7afdbcc6-4088-4cce-a6b3-08dc1712a3f0</entry>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <entry name="uuid">7afdbcc6-4088-4cce-a6b3-08dc1712a3f0</entry>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0/disk.config"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <alias name="ua-2183f3d2-df81-4b09-bb3a-8679205ce721"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <serial>2183f3d2-df81-4b09-bb3a-8679205ce721</serial>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:e8:aa:ab"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <target dev="tap3909db0f-7e"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0/console.log" append="off"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:21:23.379683 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:21:23.381960 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Preparing to wait for external event network-vif-plugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:21:23.381960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:23.381960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:23.381960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:23.381960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-151152098',display_name='tempest-TestVolumeBootPattern-server-151152098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-151152098',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-tqpe9fsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:21:11Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=7afdbcc6-4088-4cce-a6b3-08dc1712a3f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:21:23.381960 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:23.382188 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:23.382309 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:21:23.382773 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.383044 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:23.383249 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:21:23.383963 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.384106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c11f5dbe-3c31-5582-bd79-74323af1789d', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:23.384889 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.385533 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:23.385827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.387799 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.387949 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3909db0f-7e, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:23.388225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3909db0f-7e, col_values=(('qos', UUID('68bd598d-1676-4899-8298-d613eb9cf4bf')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:23.388365 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3909db0f-7e, col_values=(('external_ids', {'iface-id': '3909db0f-7e44-4988-9f68-283ba88d6631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:aa:ab', 'vm-uuid': '7afdbcc6-4088-4cce-a6b3-08dc1712a3f0'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:23.389020 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.390219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:23.394774 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:23.395860 np0000003830 nova-compute[98984]: INFO os_vif [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e')
Jun 27 04:21:23.408178 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:23.413624 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:23.420305 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:23.427070 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.432417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.444483 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.444483 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.444483 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.444483 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.444483 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.444483 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:23.444664 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.444664 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.444664 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.444664 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.444664 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.444664 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:23.445276 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.462047 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.462047 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.462047 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.462047 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.462047 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.462047 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:23.462232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.462232 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.462232 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.462232 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.462232 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.462232 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:23.478876 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.40.100,3260]
Jun 27 04:21:23.478876 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:23.478876 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.489800 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.500064 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.50.100,3260]
Jun 27 04:21:23.500064 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:23.500064 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.507601 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.507847 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:23.508035 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:23.508148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:23.509026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] HCTL ('10', '-', '-', 0) found on session 174 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:23.509143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:23.513213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:23.523947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching for a device in session 174 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:23.523947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1805556-67c6-482f-9da6-e7dc2946166e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.530026 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:23.531084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:23.531419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] HCTL ('13', '-', '-', 0) found on session 175 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:23.531474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:23.549749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching for a device in session 175 and hctl ['13', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:24.548580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching for a device in session 175 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:24.549100 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c1805556-67c6-482f-9da6-e7dc2946166e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:24.919168 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:24.919309 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:24.919377 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:e8:aa:ab, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:21:24.919735 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Using config drive
Jun 27 04:21:25.400671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Found WWN 330000000633e97b1 for multipath device dm-3 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:21:25.400927 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:25.401105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] <== connect_volume: return (7038ms) {'type': 'block', 'scsi_wwn': '330000000633e97b1', 'path': '/dev/dm-3', 'multipath_id': '330000000633e97b1'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:25.401350 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000633e97b1', 'path': '/dev/dm-3', 'multipath_id': '330000000633e97b1'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:21:25.401817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 6.747s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:25.402201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:21:25.402335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:21:25.405265 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'flavor' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:25.424718 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:25.427584 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:25.427873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '175')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:21:25.428114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '166')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:25.431006 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '167')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:25.431821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53841bb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:21:25.432044 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:21:25.432287 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Flush multipath device 33000000028e06acb {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:21:25.492117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:25.547994 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Creating config drive at /opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0/disk.config
Jun 27 04:21:25.549056 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:25.552468 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbd1tot9d {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:25.597751 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:21:25.597946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:21:25.599567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:21:25.610299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:21:25.610644 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:21:25.611440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbd1tot9d" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:21:25.622054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:25.650543 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260]
Jun 27 04:21:25.650543 np0000003830 nova-compute[98984]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:25.650543 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:25.669879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:25.681738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:25.732759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260]
Jun 27 04:21:25.732759 np0000003830 nova-compute[98984]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:25.732759 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:25.748851 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:25.749263 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:25.749515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] <== disconnect_volume: return (7094ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:25.749705 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:21:25.749991 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Deleting instance files /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517_del
Jun 27 04:21:25.750516 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Deletion of /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517_del complete
Jun 27 04:21:25.908609 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attempting to attach volume c1805556-67c6-482f-9da6-e7dc2946166e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]:   <alias name="ua-c1805556-67c6-482f-9da6-e7dc2946166e"/>
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-3"/>
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]:   <serial>c1805556-67c6-482f-9da6-e7dc2946166e</serial>
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:21:25.910149 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:21:26.158228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.181534 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.182561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.283307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.413165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34ceb778-506d-4041-a54e-052f1e88f80d req-4240ec97-9a19-4b3c-91de-14a0492591cd service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-plugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:26.413390 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34ceb778-506d-4041-a54e-052f1e88f80d req-4240ec97-9a19-4b3c-91de-14a0492591cd service nova] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:26.413653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34ceb778-506d-4041-a54e-052f1e88f80d req-4240ec97-9a19-4b3c-91de-14a0492591cd service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:26.413839 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-34ceb778-506d-4041-a54e-052f1e88f80d req-4240ec97-9a19-4b3c-91de-14a0492591cd service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:26.414014 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-34ceb778-506d-4041-a54e-052f1e88f80d req-4240ec97-9a19-4b3c-91de-14a0492591cd service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Processing event network-vif-plugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:21:26.539039 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.541794 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.545038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.546695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.562770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:26.990293 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534086.9898887, 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:26.990888 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:21:26.991327 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] VM Started (Lifecycle Event)
Jun 27 04:21:26.993193 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:21:26.995827 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Instance spawned successfully.
Jun 27 04:21:26.996215 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:21:27.494022 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:27.497312 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:21:27.502777 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Deleted allocations for instance d59bcbdc-07e2-4623-b40d-21387c81a517
Jun 27 04:21:27.510103 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:27.510316 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:27.510806 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:27.511119 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:27.511396 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:27.511721 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:27.604847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:27.605258 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:27.605258 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:27.605258 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No VIF found with MAC fa:16:3e:3f:3f:41, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:21:28.002531 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:21:28.002888 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534088.0026393, 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:28.003090 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] VM Paused (Lifecycle Event)
Jun 27 04:21:28.008024 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:28.008282 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:28.017085 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Took 10.45 seconds to spawn the instance on the hypervisor.
Jun 27 04:21:28.017761 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:28.165671 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:28.165959 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:28.390971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:28.477841 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4beea0a9-bf73-4905-b498-6bfcfe71ea61 req-4d7729cb-0a09-47c2-b11a-61b5bdca2fd2 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-plugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:28.477841 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4beea0a9-bf73-4905-b498-6bfcfe71ea61 req-4d7729cb-0a09-47c2-b11a-61b5bdca2fd2 service nova] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:28.477841 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4beea0a9-bf73-4905-b498-6bfcfe71ea61 req-4d7729cb-0a09-47c2-b11a-61b5bdca2fd2 service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:28.477841 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4beea0a9-bf73-4905-b498-6bfcfe71ea61 req-4d7729cb-0a09-47c2-b11a-61b5bdca2fd2 service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:28.477841 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4beea0a9-bf73-4905-b498-6bfcfe71ea61 req-4d7729cb-0a09-47c2-b11a-61b5bdca2fd2 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] No waiting events found dispatching network-vif-plugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:28.477998 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-4beea0a9-bf73-4905-b498-6bfcfe71ea61 req-4d7729cb-0a09-47c2-b11a-61b5bdca2fd2 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received unexpected event network-vif-plugged-3909db0f-7e44-4988-9f68-283ba88d6631 for instance with vm_state active and task_state None.
Jun 27 04:21:28.506026 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:28.508037 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534088.507827, 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:28.508161 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] VM Resumed (Lifecycle Event)
Jun 27 04:21:28.525831 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Took 20.85 seconds to build instance.
Jun 27 04:21:28.672472 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:29.010798 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:29.012513 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:21:29.027383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.356s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:29.172074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3608b472-7fb1-4131-86f8-cf48e008d950 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.488s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:29.185020 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.177s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:29.514733 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 27 04:21:29.525284 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:29.525670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:29.525956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:29.526138 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:29.526330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:29.529538 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Terminating instance
Jun 27 04:21:29.694009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1cd51bf0-a08e-405d-a03a-6795a526066d tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 15.171s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:29.725418 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.033512 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:21:30.047125 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.049095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:30.049095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:30.049603 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Unshelving
Jun 27 04:21:30.050998 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.068115 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.070457 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.092729 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.351624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.358842 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.374626 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999632879000274 future=<Future at 0x7ec518387ef0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:30.376684 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Instance destroyed successfully.
Jun 27 04:21:30.377232 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:30.529135 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-unplugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:30.529327 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:30.529477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:30.529625 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:30.529744 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] No waiting events found dispatching network-vif-unplugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:30.529853 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-unplugged-3909db0f-7e44-4988-9f68-283ba88d6631 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:21:30.529953 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-unplugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:30.530104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] Acquiring lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:30.530233 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:30.530339 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:30.530452 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] No waiting events found dispatching network-vif-unplugged-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:30.530575 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e4c1718a-4f06-4eac-b598-4072f9af7ded req-2aef4958-c1ee-4b42-82a5-c87ffd338f59 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-unplugged-3909db0f-7e44-4988-9f68-283ba88d6631 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:21:30.799009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:30.799388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:30.842414 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003682269998535048 future=<Future at 0x7ec518353f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:30.842765 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Emitting event <LifecycleEvent: 1782534075.8419154, d59bcbdc-07e2-4623-b40d-21387c81a517 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:30.842883 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:30.843038 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Stopped (Lifecycle Event)
Jun 27 04:21:30.843979 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.530238128000292 future=<Future at 0x7ec518387ef0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:30.844136 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.530073018000166 future=<Future at 0x7ec518387ef0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:30.879598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-151152098',display_name='tempest-TestVolumeBootPattern-server-151152098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-151152098',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:21:28Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-tqpe9fsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:21:28Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=7afdbcc6-4088-4cce-a6b3-08dc1712a3f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:21:30.879793 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "3909db0f-7e44-4988-9f68-283ba88d6631", "address": "fa:16:3e:e8:aa:ab", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3909db0f-7e", "ovs_interfaceid": "3909db0f-7e44-4988-9f68-283ba88d6631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:30.880505 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:30.880774 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:21:30.881916 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.883900 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3909db0f-7e, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:30.891829 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.893026 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:30.893579 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.893738 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68bd598d-1676-4899-8298-d613eb9cf4bf) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:30.894182 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.894702 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:30.894886 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:30.896388 np0000003830 nova-compute[98984]: INFO os_vif [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:aa:ab,bridge_name='br-int',has_traffic_filtering=True,id=3909db0f-7e44-4988-9f68-283ba88d6631,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3909db0f-7e')
Jun 27 04:21:30.897973 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:21:30.898293 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:30.898452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:30.898747 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:30.899019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2183f3d2-df81-4b09-bb3a-8679205ce721', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:21:30.899145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:21:30.920929 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:30.920929 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:30.920929 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:30.920929 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:30.920929 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:30.920929 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:30.921128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5 (non-flash)
Jun 27 04:21:30.921128 np0000003830 nova-compute[98984]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:30.921128 np0000003830 nova-compute[98984]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721 (non-flash)
Jun 27 04:21:30.921128 np0000003830 nova-compute[98984]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:30.921128 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:30.921128 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:30.921256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c46cda1c-491c-4a79-8758-f1da018465c5', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '175')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:21:30.921324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', '172')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:30.922202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721', '173')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:30.922941 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518777c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:21:30.923114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdc, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:21:30.923336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 33000000000f3e083 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:21:30.979053 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:31.024217 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:31.057873 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Booting with volume b468b327-367a-4f62-ad68-e80f923c36d7 at /dev/vda
Jun 27 04:21:31.069972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:21:31.070128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:21:31.071211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:21:31.085907 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:21:31.086101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:21:31.096470 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:31.098711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:31.108819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:21:31.129085 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.40.100,3260]
Jun 27 04:21:31.129085 np0000003830 nova-compute[98984]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:31.129085 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:31.134321 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:31.148516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:31.161487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:31.179931 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:21:31.180226 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:21:31.190610 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:21:31.191430 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe3f:3f41', 'fe80::b8db:42ff:feed:256c'] 
Jun 27 04:21:31.191703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:21:31.191815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:21:31.192029 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:31.192270 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating existing volume attachment record: 980fe904-625e-40c7-b10b-504949aea736 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:21:31.195390 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.50.100,3260]
Jun 27 04:21:31.195390 np0000003830 nova-compute[98984]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-2183f3d2-df81-4b09-bb3a-8679205ce721, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:31.195390 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:31.210232 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:31.210623 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:31.210765 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (312ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:31.210928 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:21:31.211340 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Deleting instance files /opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0_del
Jun 27 04:21:31.211869 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Deletion of /opt/stack/data/nova/instances/7afdbcc6-4088-4cce-a6b3-08dc1712a3f0_del complete
Jun 27 04:21:31.302825 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'flavor' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:31.345521 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:31.720974 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Took 1.69 seconds to destroy the instance on the hypervisor.
Jun 27 04:21:31.721836 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:21:31.722219 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:21:31.722370 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:21:31.722712 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:31.826990 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:31.827701 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:31.829934 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:31.830153 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:31.830781 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=98984) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 27 04:21:31.833511 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:32.091513 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e14c1627-b141-454f-9e21-7f066a524cc4 req-e4371a47-d52c-4af0-b820-4b30a9f0f8a4 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Received event network-vif-deleted-3909db0f-7e44-4988-9f68-283ba88d6631 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:32.091901 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-e14c1627-b141-454f-9e21-7f066a524cc4 req-e4371a47-d52c-4af0-b820-4b30a9f0f8a4 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Neutron deleted interface 3909db0f-7e44-4988-9f68-283ba88d6631; detaching it from the instance and deleting it from the info cache
Jun 27 04:21:32.093720 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e14c1627-b141-454f-9e21-7f066a524cc4 req-e4371a47-d52c-4af0-b820-4b30a9f0f8a4 service nova] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Detach interface failed, port_id=3909db0f-7e44-4988-9f68-283ba88d6631, reason: Instance 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:21:32.308289 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:32.335162 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:32.551022 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:32.816583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:32.816801 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:32.818969 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'pci_requests' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:33.052917 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Took 1.33 seconds to deallocate network for instance.
Jun 27 04:21:33.321655 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'numa_topology' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:33.335312 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:33.335703 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:33.366537 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:33.366734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:33.366927 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attaching volume 7621b600-36e1-4b84-b07b-fd862c5c0134 to /dev/vdc
Jun 27 04:21:33.398926 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:33.410356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:21:33.434119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:33.487560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:21:33.487793 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:21:33.496221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:21:33.497032 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe3f:3f41', 'fe80::b8db:42ff:feed:256c'] 
Jun 27 04:21:33.497152 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:21:33.497250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:21:33.497465 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:33.497717 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updating existing volume attachment record: 0f5f3691-e0a4-4ca5-a254-08e310a566d3 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:21:33.595259 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Took 0.54 seconds to detach 1 volumes for instance.
Jun 27 04:21:33.597452 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Deleting volume: 2183f3d2-df81-4b09-bb3a-8679205ce721 {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:21:33.823774 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:21:33.823906 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Claim successful on node np0000003830
Jun 27 04:21:34.045790 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:21:34.046166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7621b600-36e1-4b84-b07b-fd862c5c0134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:34.046311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:34.046743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:34.046947 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7621b600-36e1-4b84-b07b-fd862c5c0134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:21:34.058094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:34.058484 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:34.058704 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:34.059954 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:34.060482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:34.060698 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:34.069744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:34.069744 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:34.074413 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:34.074413 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134] added
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:34.081134 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:34.081349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:34.081439 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:34.081604 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134] added
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:34.084349 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:34.084564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:34.084658 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:34.084787 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:34.133583 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:34.995471 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:34.995742 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:35.082231 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:35.085513 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:35.095106 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:35.100548 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.107202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.113030 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.118395 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.118395 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.118395 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:35.118557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.118557 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.118557 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:35.124942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.124942 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.124942 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:35.125062 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.125062 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.125062 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:35.151130 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.40.100,3260]
Jun 27 04:21:35.151130 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:35.151130 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.163895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.50.100,3260]
Jun 27 04:21:35.163895 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:35.163895 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.168270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.175356 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:35.182110 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.182110 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.182110 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.182110 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.182110 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:35.182220 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.182220 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.182220 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.182220 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.182220 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:35.182507 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.124s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:35.182642 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:35.183305 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] HCTL ('7', '-', '-', 0) found on session 176 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:35.183437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:35.188552 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:35.188855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:35.188855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:35.189482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] HCTL ('8', '-', '-', 0) found on session 177 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:35.189696 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:35.195626 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching for a device in session 176 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:35.195823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7621b600-36e1-4b84-b07b-fd862c5c0134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:35.203268 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Searching for a device in session 177 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:35.203319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7621b600-36e1-4b84-b07b-fd862c5c0134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:35.498116 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:35.830271 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:35.900371 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:35.900855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:35.900942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:21:35.901050 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:21:35.906482 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:35.906720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:21:36.004892 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.188s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:36.005597 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.872s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:36.005857 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:36.061100 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:21:36.085311 np0000003830 nova-compute[98984]: INFO nova.network.neutron [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating port 3797d972-cb4e-41f3-990f-8342e3789814 with attributes {'binding:host_id': 'np0000003830', 'device_owner': 'compute:nova'}
Jun 27 04:21:36.213195 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:36.213421 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:36.347113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:36.618072 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:36.618216 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:36.618367 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:21:36.662509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-changed-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:36.662873 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing instance network info cache due to event network-changed-3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:21:36.663071 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:36.716372 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:37.075728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Found WWN 3300000007d903d54 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:21:37.076011 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:37.076194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000007d903d54', 'path': '/dev/dm-0', 'multipath_id': '3300000007d903d54'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:37.076344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d903d54', 'path': '/dev/dm-0', 'multipath_id': '3300000007d903d54'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:21:37.078875 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'flavor' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:37.122716 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:37.241560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.220s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:37.241560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.892s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:37.241560 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:37.241560 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:21:37.342001 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0
Jun 27 04:21:37.413204 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:37.547191 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:37.581432 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attempting to attach volume 7621b600-36e1-4b84-b07b-fd862c5c0134 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]:   <alias name="ua-7621b600-36e1-4b84-b07b-fd862c5c0134"/>
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]:   <serial>7621b600-36e1-4b84-b07b-fd862c5c0134</serial>
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:21:37.582795 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:21:38.049059 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:38.050003 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:21:38.050330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:38.050604 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Creating image(s)
Jun 27 04:21:38.050940 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:21:38.051926 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:21:38.052044 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Ensure instance console log exists: /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:21:38.052233 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:38.052374 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:38.052484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:38.052862 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Start _get_guest_xml network_info=[{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '980fe904-625e-40c7-b10b-504949aea736', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd59bcbdc-07e2-4623-b40d-21387c81a517', 'attached_at': '', 'detached_at': '', 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'serial': 'b468b327-367a-4f62-ad68-e80f923c36d7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:21:38.055448 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:21:38.056336 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-58106531', uuid='d59bcbdc-07e2-4623-b40d-21387c81a517'), owner=OwnerMeta(userid='65af8bebc9f64e179fabdbd5fb64c177', username='tempest-TestShelveInstance-2061898292-project-member', projectid='440506966fc7496e9b8956b939ce8a2a', projectname='tempest-TestShelveInstance-2061898292'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534098.056069) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:21:38.057347 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:21:38.057648 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:21:38.058691 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:21:38.058833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:21:38.059595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:21:38.059818 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:21:38.059946 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:21:38.060039 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:21:38.060148 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:21:38.060224 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:21:38.060308 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:21:38.060443 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:21:38.060556 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:21:38.060654 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:21:38.060743 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:21:38.061102 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:21:38.061246 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'vcpu_model' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:38.263745 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:38.340949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:21:38.341403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:38.363553 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c1137cb4-24e6-4df8-b9dd-5e11b6317faf tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "7afdbcc6-4088-4cce-a6b3-08dc1712a3f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.838s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:38.432300 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:21:38.432693 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:21:38.432800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:21:38.436651 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:21:38.443598 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:38.485592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:21:38.486088 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51371MB free_disk=71.99055480957031GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:21:38.486306 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:38.486623 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:38.554223 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:38.563826 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Object Instance<d59bcbdc-07e2-4623-b40d-21387c81a517> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:21:38.579853 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:21:38.580306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:38.580531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:38.972724 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:39.165008 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updated VIF entry in instance network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:21:39.165220 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:39.227938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:39.227938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:39.227938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:39.228147 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:39.228147 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] No VIF found with MAC fa:16:3e:3f:3f:41, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:21:39.333426 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.753s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:39.333935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:21:39.357970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:39.357970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:39.357970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:39.357970 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:39.357970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:39.357970 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:39.362520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:39.362520 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:39.366297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:39.366297 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7] added
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:39.376727 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:39.378045 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:39.378045 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:39.378045 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7] added
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:39.380049 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:39.380314 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:39.380401 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:39.380573 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:39.538515 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:21:39.538725 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance d59bcbdc-07e2-4623-b40d-21387c81a517 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:21:39.538898 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:21:39.539044 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:21:38 up 44 min,  2 users,  load average: 3.87, 6.47, 5.95\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_39e8dbaf15594c24944a445d42712c19': '1', 'io_workload': '0', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '1', 'num_proj_440506966fc7496e9b8956b939ce8a2a': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:21:39.665460 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:39.665662 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:39.667221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e975d271-22d7-489d-bc4d-78f28af9b045 req-8b48dab2-de45-4e67-98ae-8d42520a2b9a service nova] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:40.168242 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:40.377926 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:40.380986 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:40.388964 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:40.395146 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.400093 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.409183 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.414365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.414365 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.414365 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.414365 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.414365 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.414365 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:40.414617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.414617 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.414617 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.414617 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.414617 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.414617 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:40.425332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.425332 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.425332 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.425332 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.425332 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.425332 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:40.425506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.425506 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.425506 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.425506 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.425506 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.425506 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:40.449904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260]
Jun 27 04:21:40.449904 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:40.449904 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.461574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.471870 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260]
Jun 27 04:21:40.471870 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:40.471870 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.476151 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.476359 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:40.476663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:40.476750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:40.477797 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] HCTL ('11', '-', '-', 0) found on session 179 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:40.477797 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:40.483938 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:40.491996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching for a device in session 179 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:40.491996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:40.498866 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:40.499289 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:40.499289 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:40.499865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] HCTL ('12', '-', '-', 0) found on session 180 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:40.500170 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:40.512092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching for a device in session 180 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:40.674975 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:21:40.677477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.188s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:40.677477 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:40.779260 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e4544e51-bc76-45cb-9ee1-048203434ec4 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.412s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:40.912005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:40.912327 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:40.912411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:21:40.912471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:21:40.913098 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:40.913261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:21:41.302097 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:41.302347 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:41.512805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Searching for a device in session 180 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:41.513055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:41.804876 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Detaching volume 7621b600-36e1-4b84-b07b-fd862c5c0134
Jun 27 04:21:41.845453 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attempting to driver detach volume 7621b600-36e1-4b84-b07b-fd862c5c0134 from mountpoint /dev/vdc
Jun 27 04:21:41.849763 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Found disk vdc by alias ua-7621b600-36e1-4b84-b07b-fd862c5c0134 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:21:41.850784 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Found disk vdc by alias ua-7621b600-36e1-4b84-b07b-fd862c5c0134 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:21:41.850898 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Attempting to detach device vdc from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:   <alias name="ua-7621b600-36e1-4b84-b07b-fd862c5c0134"/>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:   <serial>7621b600-36e1-4b84-b07b-fd862c5c0134</serial>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:21:41.851108 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:21:41.857278 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Successfully detached device vdc from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the persistent domain config.
Jun 27 04:21:41.857466 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] (1/8): Attempting to detach device vdc with device alias ua-7621b600-36e1-4b84-b07b-fd862c5c0134 from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:   <alias name="ua-7621b600-36e1-4b84-b07b-fd862c5c0134"/>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:   <serial>7621b600-36e1-4b84-b07b-fd862c5c0134</serial>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:21:41.857814 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:21:42.342862 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534102.3423789, 09ca8b1e-3f64-46ce-8448-dd96acf76688 => ua-7621b600-36e1-4b84-b07b-fd862c5c0134> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:21:42.344081 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-7621b600-36e1-4b84-b07b-fd862c5c0134 for instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:21:42.346436 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Successfully detached device vdc from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the live domain config.
Jun 27 04:21:42.347489 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:21:42.347805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7621b600-36e1-4b84-b07b-fd862c5c0134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:42.347944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:42.366678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Found WWN 33000000028e06acb for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:21:42.367104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:42.367476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] <== connect_volume: return (3786ms) {'type': 'block', 'scsi_wwn': '33000000028e06acb', 'path': '/dev/dm-1', 'multipath_id': '33000000028e06acb'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:42.367738 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000028e06acb', 'path': '/dev/dm-1', 'multipath_id': '33000000028e06acb'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:21:42.368589 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.020s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:42.369019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7621b600-36e1-4b84-b07b-fd862c5c0134', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:21:42.369173 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:42.426161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134 (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:42.426552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '180')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:21:42.426855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', '176')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:42.428247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134', '177')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:42.429146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518774ae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:21:42.429345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:21:42.429613 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Flush multipath device 3300000007d903d54 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:21:42.487736 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:42.549958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:42.599074 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:21:42.599240 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:21:42.600225 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:21:42.610934 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:21:42.611104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:21:42.622241 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:42.653326 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.40.100,3260]
Jun 27 04:21:42.653326 np0000003830 nova-compute[98984]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:42.653326 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:42.668058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:42.678788 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:42.713938 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.50.100,3260]
Jun 27 04:21:42.713938 np0000003830 nova-compute[98984]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-7621b600-36e1-4b84-b07b-fd862c5c0134, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:42.713938 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:42.725708 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:42.725912 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:42.726017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] <== disconnect_volume: return (378ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:42.726123 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:21:42.874802 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-58106531',display_name='tempest-TestShelveInstance-server-58106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testshelveinstance-server-58106531',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1562266970',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:20:43Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='440506966fc7496e9b8956b939ce8a2a',ramdisk_id='',reservation_id='r-gjclb679',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2061898292',owner_user_name='tempest-TestShelveInstance-2061898292-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:21:31Z,user_data=None,user_id='65af8bebc9f64e179fabdbd5fb64c177',uuid=d59bcbdc-07e2-4623-b40d-21387c81a517,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:21:42.875058 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converting VIF {"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:42.875907 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:42.876753 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'pci_devices' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:43.271437 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'flavor' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:43.378894 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Object Instance<d59bcbdc-07e2-4623-b40d-21387c81a517> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <uuid>d59bcbdc-07e2-4623-b40d-21387c81a517</uuid>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <name>instance-00000042</name>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestShelveInstance-server-58106531</nova:name>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:21:38</nova:creationTime>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:user uuid="65af8bebc9f64e179fabdbd5fb64c177">tempest-TestShelveInstance-2061898292-project-member</nova:user>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:project uuid="440506966fc7496e9b8956b939ce8a2a">tempest-TestShelveInstance-2061898292</nova:project>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         <nova:port uuid="3797d972-cb4e-41f3-990f-8342e3789814">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <entry name="serial">d59bcbdc-07e2-4623-b40d-21387c81a517</entry>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <entry name="uuid">d59bcbdc-07e2-4623-b40d-21387c81a517</entry>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <alias name="ua-b468b327-367a-4f62-ad68-e80f923c36d7"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <serial>b468b327-367a-4f62-ad68-e80f923c36d7</serial>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:59:7b:3a"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <target dev="tap3797d972-cb"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/console.log" append="off"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:21:43.379871 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Preparing to wait for external event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-58106531',display_name='tempest-TestShelveInstance-server-58106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testshelveinstance-server-58106531',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1562266970',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:20:43Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='440506966fc7496e9b8956b939ce8a2a',ramdisk_id='',reservation_id='r-gjclb679',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2061898292',owner_user_name='tempest-TestShelveInstance-2061898292-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:21:31Z,user_data=None,user_id='65af8bebc9f64e179fabdbd5fb64c177',uuid=d59bcbdc-07e2-4623-b40d-21387c81a517,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converting VIF {"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:43.382056 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:21:43.382349 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:43.382424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:43.382806 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:21:43.383438 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:43.383605 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46e596e3-dba8-5721-98cd-ed9406412cb8', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:43.384278 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:43.385102 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:43.386691 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:43.386825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3797d972-cb, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:43.387107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3797d972-cb, col_values=(('qos', UUID('1ff57659-56dc-4ba8-86cd-5b5bedc255d9')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:43.387243 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3797d972-cb, col_values=(('external_ids', {'iface-id': '3797d972-cb4e-41f3-990f-8342e3789814', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:7b:3a', 'vm-uuid': 'd59bcbdc-07e2-4623-b40d-21387c81a517'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:43.388054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:43.389386 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:43.394120 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:43.395036 np0000003830 nova-compute[98984]: INFO os_vif [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb')
Jun 27 04:21:43.675436 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:43.675902 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:43.675902 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:43.675989 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:43.676158 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:43.676266 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:21:43.676467 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.15 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:43.860362 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:43.860580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:44.277673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b9341f1-b44b-4615-b154-ab063d5d7ef5 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.975s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:44.362946 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:21:44.619567 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:44.619802 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:44.905885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:44.906253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:44.909058 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:21:44.909185 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Claim successful on node np0000003830
Jun 27 04:21:44.913318 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:44.913449 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:44.913519 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] No VIF found with MAC fa:16:3e:59:7b:3a, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:21:44.913945 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Using config drive
Jun 27 04:21:45.122587 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Detaching volume c1805556-67c6-482f-9da6-e7dc2946166e
Jun 27 04:21:45.159107 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Attempting to driver detach volume c1805556-67c6-482f-9da6-e7dc2946166e from mountpoint /dev/vdb
Jun 27 04:21:45.163806 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Found disk vdb by alias ua-c1805556-67c6-482f-9da6-e7dc2946166e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:21:45.165368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Found disk vdb by alias ua-c1805556-67c6-482f-9da6-e7dc2946166e {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:21:45.165368 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Attempting to detach device vdb from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:   <alias name="ua-c1805556-67c6-482f-9da6-e7dc2946166e"/>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-3"/>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:   <serial>c1805556-67c6-482f-9da6-e7dc2946166e</serial>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:21:45.165596 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Successfully detached device vdb from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the persistent domain config.
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] (1/8): Attempting to detach device vdb with device alias ua-c1805556-67c6-482f-9da6-e7dc2946166e from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:   <alias name="ua-c1805556-67c6-482f-9da6-e7dc2946166e"/>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-3"/>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:   <serial>c1805556-67c6-482f-9da6-e7dc2946166e</serial>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:21:45.171461 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:21:45.374701 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00041932799967980827 future=<Future at 0x7ec518387ef0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:45.374851 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:45.375057 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782534090.3741417, 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:45.375185 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] VM Stopped (Lifecycle Event)
Jun 27 04:21:45.416687 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'ec2_ids' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:45.677158 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534105.6767306, 09ca8b1e-3f64-46ce-8448-dd96acf76688 => ua-c1805556-67c6-482f-9da6-e7dc2946166e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:21:45.678161 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c1805556-67c6-482f-9da6-e7dc2946166e for instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:21:45.680623 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Successfully detached device vdb from instance 09ca8b1e-3f64-46ce-8448-dd96acf76688 from the live domain config.
Jun 27 04:21:45.681707 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:21:45.682027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1805556-67c6-482f-9da6-e7dc2946166e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:45.682146 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:45.682436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:45.682818 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c1805556-67c6-482f-9da6-e7dc2946166e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:21:45.682978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:21:45.706360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:45.706360 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:45.706360 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:45.706360 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:45.706360 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:45.706360 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e (non-flash)
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:45.706729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '180')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:21:45.707029 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '174')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:45.707562 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e', '175')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:21:45.708297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5384131a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:21:45.708552 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Removing multipathed devices sdh, sde {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:21:45.708754 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Flush multipath device 330000000633e97b1 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:21:45.756154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:45.812121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:21:45.860808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Checking to see if SCSI volumes sdh, sde have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:21:45.860982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] SCSI volumes sdh, sde have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:21:45.861898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Checking to see if device paths {'sdh', 'sde'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:21:45.873569 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Device paths {'sdh', 'sde'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:21:45.873756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:21:45.877737 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1145b3e1-3158-4869-afe2-26c588dbede7 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 7afdbcc6-4088-4cce-a6b3-08dc1712a3f0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:45.886772 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:45.919530 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.40.100,3260]
Jun 27 04:21:45.919530 np0000003830 nova-compute[98984]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:45.919530 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:45.920524 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Object Instance<d59bcbdc-07e2-4623-b40d-21387c81a517> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:21:45.920720 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'keypairs' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:45.934753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:45.946296 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:45.980295 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.50.100,3260]
Jun 27 04:21:45.980295 np0000003830 nova-compute[98984]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-c1805556-67c6-482f-9da6-e7dc2946166e, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:45.980295 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:45.994865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:45.995134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:45.995271 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] <== disconnect_volume: return (312ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:45.995435 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:21:46.130167 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:46.130372 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:46.423182 np0000003830 nova-compute[98984]: DEBUG nova.objects.base [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Object Instance<d59bcbdc-07e2-4623-b40d-21387c81a517> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98984) wrapper /opt/stack/nova/nova/objects/base.py:136}}
Jun 27 04:21:46.425833 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:46.543133 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Creating config drive at /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config
Jun 27 04:21:46.546377 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'flavor' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:46.548884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprwnx8wfa {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:46.616412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprwnx8wfa" returned: 0 in 0.067s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:21:46.633421 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:46.998362 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.014556 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:47.023152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.026156 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.111982 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.141054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.235s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:47.141458 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:21:47.213746 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3b33a065-d4f3-473e-a83b-bbf60454b830 req-5c63c955-6707-4731-aca5-dc4799f4d9ff service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:47.214232 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b33a065-d4f3-473e-a83b-bbf60454b830 req-5c63c955-6707-4731-aca5-dc4799f4d9ff service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:47.214435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b33a065-d4f3-473e-a83b-bbf60454b830 req-5c63c955-6707-4731-aca5-dc4799f4d9ff service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:47.214632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3b33a065-d4f3-473e-a83b-bbf60454b830 req-5c63c955-6707-4731-aca5-dc4799f4d9ff service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:47.214885 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3b33a065-d4f3-473e-a83b-bbf60454b830 req-5c63c955-6707-4731-aca5-dc4799f4d9ff service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Processing event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:21:47.352046 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.353514 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.356445 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.357512 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.378169 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:47.554615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3eb01d7d-6ccd-46a7-be90-c17ca2324f0a tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.935s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:47.647850 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:21:47.648114 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:21:47.648561 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:47.648861 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:47.721570 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:21:47.783085 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:21:47.783452 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534107.7832117, d59bcbdc-07e2-4623-b40d-21387c81a517 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:47.783635 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Started (Lifecycle Event)
Jun 27 04:21:47.785700 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:21:47.788855 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance spawned successfully.
Jun 27 04:21:47.789708 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:47.918297 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:47.918433 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:47.918624 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:47.918746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:47.918847 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:47.920751 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Terminating instance
Jun 27 04:21:48.137303 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Successfully created port: e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:21:48.152849 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:21:48.288642 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:48.293693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:21:48.299617 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e2d9a788-7842-4e0f-ab17-9605c11ea967 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.250s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:48.389592 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:48.424324 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:21:48.442168 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:48.461789 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:48.462879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:48.478790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:48.483956 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:48.656325 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:21:48.661468 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Successfully updated port: e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:21:48.722786 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-changed-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:48.723335 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Refreshing instance network info cache due to event network-changed-e16cba4a-1649-4f55-9562-7ce92f5d9917. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:21:48.723335 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] Acquiring lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:48.723335 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] Acquired lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:48.723335 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Refreshing network info cache for port e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:21:48.775976 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Instance destroyed successfully.
Jun 27 04:21:48.776660 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lazy-loading 'resources' on Instance uuid 09ca8b1e-3f64-46ce-8448-dd96acf76688 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:48.795398 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534108.795059, d59bcbdc-07e2-4623-b40d-21387c81a517 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:48.795663 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Paused (Lifecycle Event)
Jun 27 04:21:49.160871 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Booting with volume b480c122-2b0c-416e-99f5-9ec5964ada3e at /dev/vda
Jun 27 04:21:49.163488 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:21:49.195827 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:49.208523 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:21:49.226640 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:49.231187 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:49.274397 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:49.274898 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] No waiting events found dispatching network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received unexpected event network-vif-plugged-3797d972-cb4e-41f3-990f-8342e3789814 for instance with vm_state active and task_state None.
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-unplugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] No waiting events found dispatching network-vif-unplugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-unplugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-unplugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Acquiring lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] No waiting events found dispatching network-vif-unplugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:21:49.277518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5a483745-6e84-4560-a8c9-0c1432b0825d req-1734aad8-c3f3-4bcb-933a-8faec89da5ab service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-unplugged-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:21:49.279684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:20:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-676402104',display_name='tempest-TestServerVolumeAttachmentScenario-server-676402104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testservervolumeattachmentscenario-server-676402104',id=65,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1nWl/mWcCABpBlq6CxW4OjF1sD3GhwAqZjfJXch7t+gid+g+cXJCIgFgthWokEyECwXdSlvWDmHt1ulzrSWIC/G4eWEEhCT8sp58BCWsAyaQ9J9DtwAuSBNnBsJVKEOw==',key_name='tempest-keypair-253988185',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:20:36Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39e8dbaf15594c24944a445d42712c19',ramdisk_id='',reservation_id='r-0p29hslo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-747119314',owner_user_name='tempest-TestServerVolumeAttachmentScenario-747119314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f84976ecddb1446baf656173f32940f2',uuid=09ca8b1e-3f64-46ce-8448-dd96acf76688,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:21:49.279931 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Converting VIF {"id": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "address": "fa:16:3e:3f:3f:41", "network": {"id": "5af189bb-7b1c-40bf-9cce-d6252966dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1106689232-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39e8dbaf15594c24944a445d42712c19", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbbd9f71-92", "ovs_interfaceid": "fbbd9f71-9262-430f-a5a9-e3a7a3e591fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:49.281007 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:49.281351 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:21:49.281889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbbd9f71-92, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19fa7188-e8eb-49f7-b00d-67116dff8b06) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:49.291905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:49.292646 np0000003830 nova-compute[98984]: INFO os_vif [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:3f:41,bridge_name='br-int',has_traffic_filtering=True,id=fbbd9f71-9262-430f-a5a9-e3a7a3e591fc,network=Network(5af189bb-7b1c-40bf-9cce-d6252966dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbbd9f71-92')
Jun 27 04:21:49.293045 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Deleting instance files /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688_del
Jun 27 04:21:49.294784 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:21:49.295904 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe59:7b3a', 'fe80::f84b:90ff:fed6:7073'] 
Jun 27 04:21:49.296318 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:21:49.296574 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Deletion of /opt/stack/data/nova/instances/09ca8b1e-3f64-46ce-8448-dd96acf76688_del complete
Jun 27 04:21:49.300091 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:21:49.300456 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:49.300789 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:49.306262 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Updating existing volume attachment record: d56caac2-dce1-495f-a12a-e1583554c4c4 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:21:49.309138 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:21:49.312839 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534109.3125145, d59bcbdc-07e2-4623-b40d-21387c81a517 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:49.312993 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Resumed (Lifecycle Event)
Jun 27 04:21:49.496209 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:49.728506 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:49.804204 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Took 1.38 seconds to destroy the instance on the hypervisor.
Jun 27 04:21:49.804910 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:21:49.805252 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:21:49.805361 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:21:49.805695 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:49.816419 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:49.818533 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:21:49.904757 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:50.000868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2c010996-2aa5-4533-96f7-7a7a874966fb req-edc88920-67a9-4a50-8483-78515155f878 service nova] Releasing lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:50.001594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:21:50.001875 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:21:50.321273 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999691127000006 future=<Future at 0x7ec5383312b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:50.321704 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99939558699998 future=<Future at 0x7ec5383312b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:50.321704 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99924430100009 future=<Future at 0x7ec5383312b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:21:50.584378 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:21:50.738435 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:50.831041 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:50.863266 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Updating instance_info_cache with network_info: [{"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:50.903785 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:21:51.333069 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:51.339078 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-44cf5bde-82d4-4c4c-a77a-5211b933ad98 req-672f71d6-32a0-43f6-a675-45ec6c796d3d service nova] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Received event network-vif-deleted-fbbd9f71-9262-430f-a5a9-e3a7a3e591fc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:51.367291 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:21:51.367563 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Instance network_info: |[{"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:21:51.405503 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Took 1.60 seconds to deallocate network for instance.
Jun 27 04:21:51.547578 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:21:51.548666 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:21:51.548903 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Creating image(s)
Jun 27 04:21:51.549162 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:21:51.549281 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Ensure instance console log exists: /opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:21:51.550271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:51.550449 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:51.550614 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:51.551045 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Start _get_guest_xml network_info=[{"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'd56caac2-dce1-495f-a12a-e1583554c4c4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '67f683c0-a514-400c-a7f9-7e3aacb161b5', 'attached_at': '', 'detached_at': '', 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'serial': 'b480c122-2b0c-416e-99f5-9ec5964ada3e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:21:51.553903 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:21:51.555147 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-585326607', uuid='67f683c0-a514-400c-a7f9-7e3aacb161b5'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534111.554847) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:21:51.556640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:21:51.557010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:21:51.558332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:21:51.558535 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:21:51.559273 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:21:51.559552 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:21:51.560555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:21:51.560746 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:21:51.560788 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:21:51.573734 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:21:51.574172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:21:51.574367 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:51.574866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:51.575083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:21:51.585885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:51.586725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:21:51.587217 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:51.587468 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:51.588024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:21:51.588251 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:51.597894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:51.597894 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:51.605144 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:21:51.605144 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e] added
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:51.609790 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:51.610097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:51.610238 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:51.610442 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e] added
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:21:51.617444 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:51.617725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:21:51.617811 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:21:51.617982 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:21:51.911615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:51.911762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:52.140048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:21:52.140292 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:21:52.610941 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:21:52.618440 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:52.626760 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:21:52.632189 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.637221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.646277 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:21:52.653704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.654396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.654396 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.654396 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:52.654623 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.654623 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.654623 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:52.665627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.665627 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.665627 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:52.665812 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.665812 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.665812 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:52.682928 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.40.100,3260]
Jun 27 04:21:52.682928 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.40.100,3260] successful.
Jun 27 04:21:52.682928 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.694253 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.700946 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.50.100,3260]
Jun 27 04:21:52.700946 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.50.100,3260] successful.
Jun 27 04:21:52.700946 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.707418 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.707418 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.707418 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.707418 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.707418 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.121s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:52.708282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:52.708853 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('7', '-', '-', 0) found on session 181 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:52.709272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:52.714185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:21:52.727598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 181 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:52.727598 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:52.729632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.729632 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.729632 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.729632 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.729632 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:21:52.729827 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.729827 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:21:52.729827 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.729827 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:21:52.729827 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:21:52.730083 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:52.730133 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:21:52.731783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('8', '-', '-', 0) found on session 182 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:21:52.731783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:21:52.743657 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 182 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:53.155491 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.244s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:53.201579 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Deleted allocations for instance 09ca8b1e-3f64-46ce-8448-dd96acf76688
Jun 27 04:21:53.334675 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:21:53.334675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 27 04:21:53.743543 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 182 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:21:53.743879 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:21:53.835892 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] There are 0 instances to clean {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 27 04:21:53.836447 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 24.15 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:21:54.208734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-2a05cfe3-8d93-42ae-93d6-1d3de6906867 tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Lock "09ca8b1e-3f64-46ce-8448-dd96acf76688" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.290s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:54.290695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:54.608017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 330000000557f562d for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:21:54.608017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:21:54.608017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000557f562d', 'path': '/dev/dm-0', 'multipath_id': '330000000557f562d'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:21:54.608017 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000557f562d', 'path': '/dev/dm-0', 'multipath_id': '330000000557f562d'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:21:54.729692 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.115704 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-585326607',display_name='tempest-TestVolumeBootPattern-volume-backed-server-585326607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-volume-backed-server-585326607',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgUcz6o8j8bMiIDoqNdxT0Y7dYPeopck7BfQ3XDfe7+E3d22/a8t87K1HsbG+M00tviRjegSu19rML8YDBy+9RLk0TF/UmRvLWv21CgUl2eUnpn9o2krjNnDz6KeCCKdA==',key_name='tempest-keypair-852571463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-99sj4shg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=67f683c0-a514-400c-a7f9-7e3aacb161b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:21:55.115704 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:55.115704 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:55.116518 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 67f683c0-a514-400c-a7f9-7e3aacb161b5 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <uuid>67f683c0-a514-400c-a7f9-7e3aacb161b5</uuid>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <name>instance-00000044</name>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-585326607</nova:name>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:21:51</nova:creationTime>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         <nova:port uuid="e16cba4a-1649-4f55-9562-7ce92f5d9917">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <entry name="serial">67f683c0-a514-400c-a7f9-7e3aacb161b5</entry>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <entry name="uuid">67f683c0-a514-400c-a7f9-7e3aacb161b5</entry>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5/disk.config"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <alias name="ua-b480c122-2b0c-416e-99f5-9ec5964ada3e"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <serial>b480c122-2b0c-416e-99f5-9ec5964ada3e</serial>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:81:66:8c"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <target dev="tape16cba4a-16"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5/console.log" append="off"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Preparing to wait for external event network-vif-plugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-585326607',display_name='tempest-TestVolumeBootPattern-volume-backed-server-585326607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-volume-backed-server-585326607',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgUcz6o8j8bMiIDoqNdxT0Y7dYPeopck7BfQ3XDfe7+E3d22/a8t87K1HsbG+M00tviRjegSu19rML8YDBy+9RLk0TF/UmRvLWv21CgUl2eUnpn9o2krjNnDz6KeCCKdA==',key_name='tempest-keypair-852571463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-99sj4shg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=67f683c0-a514-400c-a7f9-7e3aacb161b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:21:55.620957 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:21:55.623293 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.623293 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:55.623293 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:21:55.623855 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.624017 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5302d388-432a-5c3f-a7e5-8872e7ffd917', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:55.631964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.632720 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:55.633272 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.635112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.635277 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape16cba4a-16, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:55.635608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape16cba4a-16, col_values=(('qos', UUID('ef296485-4e91-4b6e-9628-39e7835fbc62')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:55.635776 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape16cba4a-16, col_values=(('external_ids', {'iface-id': 'e16cba4a-1649-4f55-9562-7ce92f5d9917', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:66:8c', 'vm-uuid': '67f683c0-a514-400c-a7f9-7e3aacb161b5'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:21:55.636564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.637717 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:21:55.641378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:55.642291 np0000003830 nova-compute[98984]: INFO os_vif [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16')
Jun 27 04:21:57.162997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:57.163518 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:21:57.163518 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:81:66:8c, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:21:57.163685 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Using config drive
Jun 27 04:21:57.484850 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:57.671406 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:21:57.800679 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Creating config drive at /opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5/disk.config
Jun 27 04:21:57.804705 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaophi8w4 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:21:57.858891 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaophi8w4" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:21:58.280725 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.305626 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.414370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.516705 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39ae1520-e945-4bd3-a606-ad48073d2a1d req-581ab15c-68bd-4d81-b959-256ef5695c7e service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-plugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:21:58.517528 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39ae1520-e945-4bd3-a606-ad48073d2a1d req-581ab15c-68bd-4d81-b959-256ef5695c7e service nova] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:21:58.517857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39ae1520-e945-4bd3-a606-ad48073d2a1d req-581ab15c-68bd-4d81-b959-256ef5695c7e service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:21:58.518784 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-39ae1520-e945-4bd3-a606-ad48073d2a1d req-581ab15c-68bd-4d81-b959-256ef5695c7e service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:21:58.518980 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-39ae1520-e945-4bd3-a606-ad48073d2a1d req-581ab15c-68bd-4d81-b959-256ef5695c7e service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Processing event network-vif-plugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:21:58.699314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.699314 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.704391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.710000 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.806535 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:58.818905 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:59.326078 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:21:59.328068 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534119.3276317, 67f683c0-a514-400c-a7f9-7e3aacb161b5 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:21:59.328236 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] VM Started (Lifecycle Event)
Jun 27 04:21:59.329941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:21:59.333237 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Instance spawned successfully.
Jun 27 04:21:59.333740 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:21:59.734292 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:21:59.831522 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:21:59.834061 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:21:59.842356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:59.842604 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:59.843030 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:59.843351 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:59.843615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:21:59.843820 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:00.336794 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:22:00.337342 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534120.3368766, 67f683c0-a514-400c-a7f9-7e3aacb161b5 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:00.337342 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] VM Paused (Lifecycle Event)
Jun 27 04:22:00.350244 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Took 8.80 seconds to spawn the instance on the hypervisor.
Jun 27 04:22:00.350801 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:00.568914 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b782a45b-5a94-43cb-8079-02d89dfa5e8c req-628f694e-0a1f-4efd-976a-a294a6a82adb service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-plugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:00.568914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b782a45b-5a94-43cb-8079-02d89dfa5e8c req-628f694e-0a1f-4efd-976a-a294a6a82adb service nova] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:00.568914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b782a45b-5a94-43cb-8079-02d89dfa5e8c req-628f694e-0a1f-4efd-976a-a294a6a82adb service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:00.568914 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b782a45b-5a94-43cb-8079-02d89dfa5e8c req-628f694e-0a1f-4efd-976a-a294a6a82adb service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:00.568914 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b782a45b-5a94-43cb-8079-02d89dfa5e8c req-628f694e-0a1f-4efd-976a-a294a6a82adb service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] No waiting events found dispatching network-vif-plugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:22:00.568914 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-b782a45b-5a94-43cb-8079-02d89dfa5e8c req-628f694e-0a1f-4efd-976a-a294a6a82adb service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received unexpected event network-vif-plugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 for instance with vm_state active and task_state None.
Jun 27 04:22:00.639310 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:00.840253 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:00.842232 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534120.8420322, 67f683c0-a514-400c-a7f9-7e3aacb161b5 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:00.842358 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] VM Resumed (Lifecycle Event)
Jun 27 04:22:00.867353 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Took 16.00 seconds to build instance.
Jun 27 04:22:00.886983 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:01.346371 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:01.353538 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:22:01.368821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-69887297-0d96-48c5-acf9-a7ecb807d3a6 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:02.736203 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-changed-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:02.736585 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Refreshing instance network info cache due to event network-changed-e16cba4a-1649-4f55-9562-7ce92f5d9917. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:22:02.736585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] Acquiring lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:02.736585 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] Acquired lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:02.736835 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Refreshing network info cache for port e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:22:03.240701 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:03.598951 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:03.752993 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Updated VIF entry in instance network info cache for port e16cba4a-1649-4f55-9562-7ce92f5d9917. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:22:03.753416 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Updating instance_info_cache with network_info: [{"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:04.255344 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07d185aa-cba1-41b9-853a-061383309d15 req-e7d8b9af-5dee-4232-8df6-37a4a75332a2 service nova] Releasing lock "refresh_cache-67f683c0-a514-400c-a7f9-7e3aacb161b5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:04.733350 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:05.321310 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003856940002151532 future=<Future at 0x7ec5383312b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:05.321753 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Emitting event <LifecycleEvent: 1782534110.3208022, 09ca8b1e-3f64-46ce-8448-dd96acf76688 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:05.321821 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:05.322030 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] VM Stopped (Lifecycle Event)
Jun 27 04:22:05.638747 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:05.652470 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:05.825998 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: 09ca8b1e-3f64-46ce-8448-dd96acf76688] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:07.884583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:09.735000 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:10.467258 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:10.639680 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:11.967512 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:14.737246 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:15.649710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:16.057429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:16.057429 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:16.560630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:22:17.128985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:17.128985 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:17.132940 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:22:17.133300 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Claim successful on node np0000003830
Jun 27 04:22:17.989648 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:18.189581 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Refreshing inventories for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 27 04:22:18.249766 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Updating ProviderTree inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 27 04:22:18.250533 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:22:18.290432 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Refreshing aggregate associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, aggregates: None {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 27 04:22:18.350743 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Refreshing trait associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, traits: HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_PPC64LE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NODE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 27 04:22:18.495525 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Jun 27 04:22:18.495666 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 67f683c0-a514-400c-a7f9-7e3aacb161b5 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:22:18.495853 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 6d0722c2-911a-4f04-ba22-55af13b84ea5 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:22:18.495995 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:22:18.496588 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:18.496821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:18.497278 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:18.498021 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 14.84 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:22:18.498192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:18.498457 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:18.531524 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:22:18.531524 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:22:19.002831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:19.003268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:19.034636 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:22:19.542139 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.414s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:19.542757 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:22:19.737513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:20.049709 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:22:20.050007 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:22:20.050417 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:20.051587 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:20.115556 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '167cf43243714b078a04b4c192717bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c06b4d16f4ddc96d9a367ad400f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:22:20.539090 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Successfully created port: 83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:22:20.551744 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:22:20.666061 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:20.955121 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Successfully updated port: 83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:22:21.010557 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-changed-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:21.010677 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Refreshing instance network info cache due to event network-changed-83de74f9-c135-40af-a036-3caee6233adc. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:22:21.011370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] Acquiring lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:21.011515 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] Acquired lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:21.011625 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Refreshing network info cache for port 83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:22:21.054848 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:22:21.457205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:21.513612 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:21.559125 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Booting with volume 090c2fae-a036-4767-860c-397ca192bd00 at /dev/vda
Jun 27 04:22:21.574930 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:22:21.598827 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:22:21.608831 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:22:21.628382 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:21.676694 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:22:21.676997 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:22:21.685914 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:22:21.687132 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe59:7b3a', 'fe80::f84b:90ff:fed6:7073', 'fe80::fc16:3eff:fe81:668c', 'fe80::a810:fdff:fe5d:dd65'] 
Jun 27 04:22:21.687316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:22:21.687504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:22:21.687802 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:22:21.688074 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Updating existing volume attachment record: f3aa9133-57dd-4869-8719-a08d3009ab38 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:22:21.728082 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:22.231078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2d7ddcc8-5b00-40bc-ab20-d4054f453797 req-b5986604-776d-48be-8e5a-f947855850d6 service nova] Releasing lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:22.231287 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquired lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:22.231443 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:22:22.793104 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:22:22.926182 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:23.044510 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Updating instance_info_cache with network_info: [{"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:23.546378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Releasing lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:23.547051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Instance network_info: |[{"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:22:23.801623 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:22:23.802739 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:22:23.802941 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Creating image(s)
Jun 27 04:22:23.803179 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:22:23.803302 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Ensure instance console log exists: /opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:22:23.803546 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:23.803721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:23.803831 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:23.804196 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Start _get_guest_xml network_info=[{"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'f3aa9133-57dd-4869-8719-a08d3009ab38', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6d0722c2-911a-4f04-ba22-55af13b84ea5', 'attached_at': '', 'detached_at': '', 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'serial': '090c2fae-a036-4767-860c-397ca192bd00'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:22:23.808279 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:22:23.809311 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1849460374', uuid='6d0722c2-911a-4f04-ba22-55af13b84ea5'), owner=OwnerMeta(userid='167cf43243714b078a04b4c192717bd3', username='tempest-TestVolumeBootPatternV346-1310252554-project-member', projectid='1b2c06b4d16f4ddc96d9a367ad400f1d', projectname='tempest-TestVolumeBootPatternV346-1310252554'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534143.8090227) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:22:23.810550 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:22:23.810765 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:22:23.812978 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:22:23.812978 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:22:23.812978 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:22:23.812978 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:22:23.813204 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:22:23.813204 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:22:23.813296 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:22:23.813333 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:22:23.813446 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:22:23.813612 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:22:23.813723 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:22:23.813847 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:22:23.813944 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:22:23.814051 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:22:23.823837 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:22:23.824140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:22:23.824281 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:23.824627 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:23.824824 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:22:23.836239 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:23.836981 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:23.837539 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:23.837750 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:22:23.838147 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:23.838368 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:22:23.850277 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:22:23.850277 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:23.851121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:22:23.851121 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00] added
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:22:23.868029 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00] added
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:23.870128 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:23.872875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:22:23.872875 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:22:23.872875 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:22:24.738637 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:24.863515 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:22:24.871243 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:22:24.878904 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:22:24.886460 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.893822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.900451 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.907858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.907858 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.907858 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.907858 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.907858 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:24.907858 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:24.908223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.908223 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.908223 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.908223 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.908223 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:24.908223 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:24.914617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.914617 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.914617 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.914617 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.914617 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:24.914617 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:24.914822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.914822 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.914822 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.914822 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.914822 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:24.914822 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:24.944889 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.40.100,3260]
Jun 27 04:22:24.944889 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.40.100,3260] successful.
Jun 27 04:22:24.944889 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.953875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.50.100,3260]
Jun 27 04:22:24.953875 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.50.100,3260] successful.
Jun 27 04:22:24.953875 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.958343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:24.974962 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] HCTL ('10', '-', '-', 0) found on session 186 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:22:24.982007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:22:25.004529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 186 and hctl ['10', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:22:25.004529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:25.017927 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:25.018159 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:25.018337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:22:25.018407 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:22:25.019143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] HCTL ('13', '-', '-', 0) found on session 187 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:22:25.019283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:22:25.040655 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 187 and hctl ['13', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:22:25.228548 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-changed-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:25.239272 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing instance network info cache due to event network-changed-3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:22:25.239272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] Acquiring lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:25.239272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] Acquired lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:25.239272 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Refreshing network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:22:25.667881 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:25.732451 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:25.791025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:25.791211 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:25.791424 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:25.791586 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:25.791731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:25.794675 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Terminating instance
Jun 27 04:22:25.998541 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 186 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:22:25.999112 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:22:26.040813 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 187 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:22:26.041406 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:22:26.088850 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:26.237001 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updated VIF entry in instance network info cache for port 3797d972-cb4e-41f3-990f-8342e3789814. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:22:26.237323 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [{"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:26.298163 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:22:26.320378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:26.339395 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:26.360154 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:26.624220 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999666702000013 future=<Future at 0x7ec5382924b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:26.638415 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998754007000116 future=<Future at 0x7ec5382924b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:26.638415 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998640659000102 future=<Future at 0x7ec5382924b0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:26.638415 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Instance destroyed successfully.
Jun 27 04:22:26.638415 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lazy-loading 'resources' on Instance uuid d59bcbdc-07e2-4623-b40d-21387c81a517 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:22:26.739557 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a14ee9f2-44ea-43f2-ae4c-ed8a51e6f405 req-35bb47fd-ac42-4be9-bc2e-cdc0ad8212fb service nova] Releasing lock "refresh_cache-d59bcbdc-07e2-4623-b40d-21387c81a517" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:26.838869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:22:27.130395 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-27T04:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-58106531',display_name='tempest-TestShelveInstance-server-58106531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testshelveinstance-server-58106531',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe+ejNG6I/pWb+AZCcwWinJ33GgAdTksGeIm3ue+7XPhNJalPHAyF13nvR0eWLQZWWe4NEYEkJtgAl7BHh2eiWVNjgi+SI02463wKpK/bE8asn7iZ/qRbDMVrr7RQtiiw==',key_name='tempest-TestShelveInstance-1562266970',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:21:47Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='440506966fc7496e9b8956b939ce8a2a',ramdisk_id='',reservation_id='r-gjclb679',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2061898292',owner_user_name='tempest-TestShelveInstance-2061898292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:21:48Z,user_data=None,user_id='65af8bebc9f64e179fabdbd5fb64c177',uuid=d59bcbdc-07e2-4623-b40d-21387c81a517,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:22:27.130886 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converting VIF {"id": "3797d972-cb4e-41f3-990f-8342e3789814", "address": "fa:16:3e:59:7b:3a", "network": {"id": "ea59526c-6aaf-4062-9a17-1fe27cd79395", "bridge": "br-int", "label": "tempest-TestShelveInstance-856910833-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "440506966fc7496e9b8956b939ce8a2a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3797d972-cb", "ovs_interfaceid": "3797d972-cb4e-41f3-990f-8342e3789814", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:22:27.131331 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:22:27.131614 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:22:27.133411 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:27.134195 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3797d972-cb, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:27.137301 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:22:27.138962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:27.139220 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ff57659-56dc-4ba8-86cd-5b5bedc255d9) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:27.140911 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:27.142373 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:22:27.144178 np0000003830 nova-compute[98984]: INFO os_vif [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:7b:3a,bridge_name='br-int',has_traffic_filtering=True,id=3797d972-cb4e-41f3-990f-8342e3789814,network=Network(ea59526c-6aaf-4062-9a17-1fe27cd79395),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3797d972-cb')
Jun 27 04:22:27.145923 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:22:27.146309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:22:27.146465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] No waiting events found dispatching network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] Acquiring lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] No waiting events found dispatching network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:22:27.298800 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-45287310-6276-4e17-96d8-c67f92bf017b req-5e751e76-e369-4ae4-b788-9f19d3581554 service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-unplugged-3797d972-cb4e-41f3-990f-8342e3789814 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:22:27.857283 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Found WWN 330000000cb1945d5 for multipath device dm-6 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:22:27.857427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:22:27.857771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== connect_volume: return (4033ms) {'type': 'block', 'scsi_wwn': '330000000cb1945d5', 'path': '/dev/dm-6', 'multipath_id': '330000000cb1945d5'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:22:27.858001 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cb1945d5', 'path': '/dev/dm-6', 'multipath_id': '330000000cb1945d5'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:22:27.858375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.712s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:27.858904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b468b327-367a-4f62-ad68-e80f923c36d7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:22:27.859007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:27.888378 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7 (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c31777e-6477-49e6-81d6-2b909128917d', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:22:27.889024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '179')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:22:27.890420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7', '180')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:22:27.891672 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518774fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:22:27.891672 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:22:27.891926 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Flush multipath device 33000000028e06acb {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:22:27.950832 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:22:28.003821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:22:28.048820 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:22:28.048967 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:22:28.049988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:22:28.062427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:22:28.062690 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:22:28.074236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:28.105787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260]
Jun 27 04:22:28.105787 np0000003830 nova-compute[98984]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.40.100,3260] successful.
Jun 27 04:22:28.105787 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:28.128055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:28.143741 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:28.176579 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260]
Jun 27 04:22:28.176579 np0000003830 nova-compute[98984]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-b468b327-367a-4f62-ad68-e80f923c36d7, portal: 192.168.50.100,3260] successful.
Jun 27 04:22:28.176579 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:28.192968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:28.193270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:22:28.193401 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] <== disconnect_volume: return (1046ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:22:28.193543 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:22:28.193858 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Deleting instance files /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517_del
Jun 27 04:22:28.194376 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Deletion of /opt/stack/data/nova/instances/d59bcbdc-07e2-4623-b40d-21387c81a517_del complete
Jun 27 04:22:28.363975 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1849460374',display_name='tempest-TestVolumeBootPatternV346-server-1849460374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-1849460374',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIUOluM30KRMMqAWDf5VkCh7x6f9Tc0N5SlBWYNQ4MH9pQ19E0VzqHz8tBc9NcMFGuYj8tzxf7P5JRA1bsYHGDKUKMIF2OUq+QPp3TWcH3Ut/cS3pohyfZQD7g3Np9cyA==',key_name='tempest-keypair-591947429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-sss2dwfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=6d0722c2-911a-4f04-ba22-55af13b84ea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:22:28.364192 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:22:28.364659 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:22:28.365219 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d0722c2-911a-4f04-ba22-55af13b84ea5 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:22:28.700259 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Took 2.40 seconds to destroy the instance on the hypervisor.
Jun 27 04:22:28.700831 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:22:28.701148 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:22:28.701252 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:22:28.701478 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:28.764015 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <uuid>6d0722c2-911a-4f04-ba22-55af13b84ea5</uuid>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <name>instance-00000045</name>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1849460374</nova:name>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:22:23</nova:creationTime>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:user uuid="167cf43243714b078a04b4c192717bd3">tempest-TestVolumeBootPatternV346-1310252554-project-member</nova:user>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:project uuid="1b2c06b4d16f4ddc96d9a367ad400f1d">tempest-TestVolumeBootPatternV346-1310252554</nova:project>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         <nova:port uuid="83de74f9-c135-40af-a036-3caee6233adc">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <entry name="serial">6d0722c2-911a-4f04-ba22-55af13b84ea5</entry>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <entry name="uuid">6d0722c2-911a-4f04-ba22-55af13b84ea5</entry>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/disk.config"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <alias name="ua-090c2fae-a036-4767-860c-397ca192bd00"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-6"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <serial>090c2fae-a036-4767-860c-397ca192bd00</serial>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:8b:0a:da"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <target dev="tap83de74f9-c1"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/console.log" append="off"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:22:28.868754 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Preparing to wait for external event network-vif-plugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1849460374',display_name='tempest-TestVolumeBootPatternV346-server-1849460374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-1849460374',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIUOluM30KRMMqAWDf5VkCh7x6f9Tc0N5SlBWYNQ4MH9pQ19E0VzqHz8tBc9NcMFGuYj8tzxf7P5JRA1bsYHGDKUKMIF2OUq+QPp3TWcH3Ut/cS3pohyfZQD7g3Np9cyA==',key_name='tempest-keypair-591947429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-sss2dwfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=6d0722c2-911a-4f04-ba22-55af13b84ea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:22:28.870607 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:22:28.870902 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:22:28.871222 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.871471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:28.871737 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:22:28.873068 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.873068 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7176bb2b-6515-5bf2-989b-ffaa6e12728a', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:28.874007 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.874007 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:22:28.874558 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.877112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.877112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83de74f9-c1, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:28.877112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83de74f9-c1, col_values=(('qos', UUID('ca14cabf-adcd-4f74-99da-fd81a586a56b')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:28.877112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83de74f9-c1, col_values=(('external_ids', {'iface-id': '83de74f9-c135-40af-a036-3caee6233adc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:0a:da', 'vm-uuid': '6d0722c2-911a-4f04-ba22-55af13b84ea5'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:28.878822 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.878822 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:22:28.883693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:28.884071 np0000003830 nova-compute[98984]: INFO os_vif [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1')
Jun 27 04:22:29.015037 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8331e8c6-752f-41d9-a7eb-0ffee61b5200 req-2e0711bb-1711-4519-abfd-d5404f6c8e8a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Received event network-vif-deleted-3797d972-cb4e-41f3-990f-8342e3789814 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:29.015093 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-8331e8c6-752f-41d9-a7eb-0ffee61b5200 req-2e0711bb-1711-4519-abfd-d5404f6c8e8a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Neutron deleted interface 3797d972-cb4e-41f3-990f-8342e3789814; detaching it from the instance and deleting it from the info cache
Jun 27 04:22:29.016856 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-8331e8c6-752f-41d9-a7eb-0ffee61b5200 req-2e0711bb-1711-4519-abfd-d5404f6c8e8a service nova] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Detach interface failed, port_id=3797d972-cb4e-41f3-990f-8342e3789814, reason: Instance d59bcbdc-07e2-4623-b40d-21387c81a517 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:22:29.474416 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:29.740405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:29.976425 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Took 1.28 seconds to deallocate network for instance.
Jun 27 04:22:30.401673 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:22:30.401836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:22:30.402000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No VIF found with MAC fa:16:3e:8b:0a:da, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:22:30.402451 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Using config drive
Jun 27 04:22:30.521657 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Took 0.54 seconds to detach 1 volumes for instance.
Jun 27 04:22:30.523804 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Deleting volume: b468b327-367a-4f62-ad68-e80f923c36d7 {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:22:30.908145 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:31.020952 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Creating config drive at /opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/disk.config
Jun 27 04:22:31.025357 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp12h4zjdq {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:31.075867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:31.076162 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:31.092216 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp12h4zjdq" returned: 0 in 0.067s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:31.273635 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:22:31.274183 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:22:31.499826 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.522928 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.530812 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.620361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.663675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7c9ee0b3-9780-42b2-ba74-f66f96e1b4b1 req-ad1a6d9e-1d85-48f4-8c77-5c207a45e947 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-plugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:31.665196 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7c9ee0b3-9780-42b2-ba74-f66f96e1b4b1 req-ad1a6d9e-1d85-48f4-8c77-5c207a45e947 service nova] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:31.665572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7c9ee0b3-9780-42b2-ba74-f66f96e1b4b1 req-ad1a6d9e-1d85-48f4-8c77-5c207a45e947 service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:31.665572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7c9ee0b3-9780-42b2-ba74-f66f96e1b4b1 req-ad1a6d9e-1d85-48f4-8c77-5c207a45e947 service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:31.665651 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7c9ee0b3-9780-42b2-ba74-f66f96e1b4b1 req-ad1a6d9e-1d85-48f4-8c77-5c207a45e947 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Processing event network-vif-plugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:22:31.779191 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:22:31.847964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.848531 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.853798 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:31.868995 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:32.244940 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534152.2445605, 6d0722c2-911a-4f04-ba22-55af13b84ea5 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:32.245484 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] VM Started (Lifecycle Event)
Jun 27 04:22:32.246137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:22:32.249471 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:22:32.253156 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Instance spawned successfully.
Jun 27 04:22:32.253597 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:22:32.283015 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.207s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:32.330581 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Deleted allocations for instance d59bcbdc-07e2-4623-b40d-21387c81a517
Jun 27 04:22:32.748302 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:32.751568 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:22:32.763537 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:32.763673 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:32.764043 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:32.764288 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:32.764633 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:32.764901 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:22:33.253583 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:22:33.254103 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534153.2538092, 6d0722c2-911a-4f04-ba22-55af13b84ea5 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:33.254575 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] VM Paused (Lifecycle Event)
Jun 27 04:22:33.270258 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Took 9.47 seconds to spawn the instance on the hypervisor.
Jun 27 04:22:33.270640 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:33.338551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f0fcf75d-e377-4ebb-8c8e-f089a95e4ec8 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Lock "d59bcbdc-07e2-4623-b40d-21387c81a517" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.547s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:33.339559 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:33.339928 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:22:33.739089 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bc44474f-4ea1-402d-87bf-339740d65223 req-82be39c7-3bf8-41ed-bc63-83b5310d4034 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-plugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:33.739491 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bc44474f-4ea1-402d-87bf-339740d65223 req-82be39c7-3bf8-41ed-bc63-83b5310d4034 service nova] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:33.739655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bc44474f-4ea1-402d-87bf-339740d65223 req-82be39c7-3bf8-41ed-bc63-83b5310d4034 service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:33.739757 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-bc44474f-4ea1-402d-87bf-339740d65223 req-82be39c7-3bf8-41ed-bc63-83b5310d4034 service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:33.739916 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-bc44474f-4ea1-402d-87bf-339740d65223 req-82be39c7-3bf8-41ed-bc63-83b5310d4034 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] No waiting events found dispatching network-vif-plugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:22:33.740026 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-bc44474f-4ea1-402d-87bf-339740d65223 req-82be39c7-3bf8-41ed-bc63-83b5310d4034 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received unexpected event network-vif-plugged-83de74f9-c135-40af-a036-3caee6233adc for instance with vm_state active and task_state None.
Jun 27 04:22:33.756706 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:33.758827 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534153.7585912, 6d0722c2-911a-4f04-ba22-55af13b84ea5 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:33.758979 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] VM Resumed (Lifecycle Event)
Jun 27 04:22:33.780588 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Took 16.72 seconds to build instance.
Jun 27 04:22:33.831194 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:33.831367 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:22:33.878232 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:34.261183 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:34.263681 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:22:34.282221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.225s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:34.283622 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.786s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:34.753687 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:34.794615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:35.098969 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-changed-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:35.098969 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Refreshing instance network info cache due to event network-changed-83de74f9-c135-40af-a036-3caee6233adc. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:22:35.098969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] Acquiring lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:35.098969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] Acquired lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:35.098969 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Refreshing network info cache for port 83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:22:35.197046 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:35.602807 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:35.830203 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:35.918039 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:36.024331 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Updated VIF entry in instance network info cache for port 83de74f9-c135-40af-a036-3caee6233adc. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:22:36.024617 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Updating instance_info_cache with network_info: [{"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:36.337512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:36.337700 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:36.337871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:36.338007 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:22:36.526297 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e46598da-c70c-4034-aa05-97ab063da09a req-c0d82950-e583-4898-be6a-da61f7e9d9a6 service nova] Releasing lock "refresh_cache-6d0722c2-911a-4f04-ba22-55af13b84ea5" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:37.003765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:37.359525 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:22:37.361014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:22:37.362459 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:22:37.363286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:37.406795 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:37.407180 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51219MB free_disk=71.97227478027344GB free_vcpus=14 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:22:37.407336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:37.407582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:38.489245 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 67f683c0-a514-400c-a7f9-7e3aacb161b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:22:38.492348 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d0722c2-911a-4f04-ba22-55af13b84ea5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:22:38.492348 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:22:38.492348 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:22:37 up 45 min,  2 users,  load average: 3.35, 5.86, 5.77\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '1', 'io_workload': '0', 'num_proj_1b2c06b4d16f4ddc96d9a367ad400f1d': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:22:38.701887 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:22:38.703290 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:22:38.881697 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:39.206407 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:22:39.716750 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:22:39.717145 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.309s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:39.717293 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:22:39.761630 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:41.624291 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00039891599999464233 future=<Future at 0x7ec5382924b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:41.624909 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] Emitting event <LifecycleEvent: 1782534146.6237845, d59bcbdc-07e2-4623-b40d-21387c81a517 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:22:41.625370 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:22:41.625370 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] VM Stopped (Lifecycle Event)
Jun 27 04:22:42.129095 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-97aa8e39-5abd-49ca-bbb3-291c9f9650a5 tempest-TestShelveInstance-2061898292 tempest-TestShelveInstance-2061898292-project-member] [instance: d59bcbdc-07e2-4623-b40d-21387c81a517] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:22:42.192405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:43.717368 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:43.717803 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:43.717803 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:43.717968 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:43.718114 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:22:43.718277 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:22:43.828977 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:22:43.828977 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:22:43.882718 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:44.119260 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:44.759535 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:45.369992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:45.370561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:45.872661 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:22:46.442472 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:46.442718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:46.447036 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:22:46.447036 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Claim successful on node np0000003830
Jun 27 04:22:46.476238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:47.623473 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:22:47.623924 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:22:47.922273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:48.126337 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:22:48.632639 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.190s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:48.633154 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:22:48.884088 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:49.161581 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:22:49.161581 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:22:49.161581 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:22:49.161581 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:49.161581 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:49.230752 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:22:49.652089 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:22:49.760631 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:49.874903 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Successfully created port: 614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:22:50.146861 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Booting with volume snapshot 07cb246f-395c-4880-82ca-bded95541573 at /dev/vda
Jun 27 04:22:50.925276 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Successfully updated port: 614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:22:51.026358 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-changed-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:51.026945 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Refreshing instance network info cache due to event network-changed-614eee99-42b0-4279-be3f-42c3090c9ef6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:22:51.026945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] Acquiring lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:51.026945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] Acquired lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:51.026945 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Refreshing network info cache for port 614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:22:51.427355 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:51.528455 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:51.612627 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:22:51.773639 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:52.052388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:52.052856 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:52.275316 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ae71ce1e-5de5-4e1f-938f-ce17645223ed req-0f929e19-61e1-445f-907c-f88b40fadc89 service nova] Releasing lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:52.276739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:52.276739 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:22:52.555231 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:22:52.827934 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:22:52.957381 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:53.072187 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Updating instance_info_cache with network_info: [{"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:53.111375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:53.111375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:53.111375 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:22:53.111375 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Claim successful on node np0000003830
Jun 27 04:22:53.575512 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:53.575835 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Instance network_info: |[{"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:22:53.638195 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:22:53.649307 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:22:53.672193 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:53.720290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:22:53.720664 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:22:53.729027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:22:53.730032 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe81:668c', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce'] 
Jun 27 04:22:53.730194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:22:53.730310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:22:53.730615 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:22:53.730852 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Updating existing volume attachment record: e11a472f-5f24-4430-a82c-e1fbe5172b47 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:22:53.885425 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:54.316153 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:22:54.316549 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:22:54.761703 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:54.818798 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:22:55.324624 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.218s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:55.325017 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:22:55.830469 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:22:55.830674 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:22:55.831072 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:55.831376 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:55.842660 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:22:55.843782 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:22:55.844211 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Creating image(s)
Jun 27 04:22:55.844615 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:22:55.844778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Ensure instance console log exists: /opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:22:55.845091 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:55.845286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:55.845432 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:55.846053 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Start _get_guest_xml network_info=[{"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-06-27T04:22:40Z,direct_url=<?>,disk_format='raw',id=f64c1cba-4094-4cf9-bd7f-49372ffdeceb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-666208771',owner='b5f5e61c86084bb88ca7c2f090e48ba9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-06-27T04:22:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'e11a472f-5f24-4430-a82c-e1fbe5172b47', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0f4f4af1-f5c3-4037-b420-8a7b45c71f35', 'attached_at': '', 'detached_at': '', 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'serial': '47f073dc-f886-44e6-b947-6cfe2b98d10c'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:22:55.848666 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:22:55.850003 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289', uuid='0f4f4af1-f5c3-4037-b420-8a7b45c71f35'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='f64c1cba-4094-4cf9-bd7f-49372ffdeceb', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534175.8496304) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:22:55.851163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:22:55.851542 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:22:55.852506 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:22:55.852708 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:22:55.854358 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:22:55.854729 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-06-27T04:22:40Z,direct_url=<?>,disk_format='raw',id=f64c1cba-4094-4cf9-bd7f-49372ffdeceb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-666208771',owner='b5f5e61c86084bb88ca7c2f090e48ba9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-06-27T04:22:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:22:55.854916 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:22:55.855052 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:22:55.855212 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:22:55.855337 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:22:55.855468 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:22:55.855682 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:22:55.855816 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:22:55.855957 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:22:55.856107 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:22:55.856260 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:22:55.869175 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:22:55.869175 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:22:55.869357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:55.901663 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74c3cd4fd76e48508b391718ae88e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c311152ba8e648b29dec91d5696dfd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:22:56.274993 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Successfully created port: 6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:22:56.332179 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:22:56.783162 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Successfully updated port: 6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:22:56.833824 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-changed-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:22:56.834084 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Refreshing instance network info cache due to event network-changed-6dcddf71-b267-4169-9118-d46552dd9af3. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:22:56.834253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] Acquiring lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:56.834388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] Acquired lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:56.834573 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Refreshing network info cache for port 6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:22:56.838778 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:22:57.285720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:22:57.342857 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:57.400612 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:22:57.547592 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:57.848627 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:22:57.849330 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:22:57.849575 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Creating image(s)
Jun 27 04:22:57.849993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:57.850171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "/opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:57.850706 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "/opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:57.851193 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:22:57.853662 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:22:57.854630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:57.938461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.083s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:57.938884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:57.939366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:57.939820 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:22:57.942792 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:22:57.943170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:58.031590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:58.032122 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:58.051990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-980e0d72-9530-4b61-a054-941cd35a0a78 req-f35ca072-5304-451a-b3aa-767da2cc19ef service nova] Releasing lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:58.053327 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquired lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:22:58.053633 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:22:58.096800 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk 1073741824" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:58.096974 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:58.097298 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:58.189416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:58.189917 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:22:58.190218 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:22:58.287440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:22:58.287891 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Cannot resize image /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:22:58.288273 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:22:58.288468 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Ensure instance console log exists: /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:22:58.288769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:58.289038 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:58.289181 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:58.626647 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:22:58.627802 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.758s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:58.628082 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:22:58.639663 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:58.640381 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:22:58.640874 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:58.642011 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:22:58.642574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:22:58.642769 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:22:58.656315 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:22:58.656315 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:58.660916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:22:58.660916 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c] added
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:58.668609 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:58.668988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:22:58.669039 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:22:58.669224 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c] added
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:22:58.673927 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:58.674136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:22:58.674284 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:22:58.674394 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:22:58.802961 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:22:58.886570 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:58.926406 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updating instance_info_cache with network_info: [{"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:22:59.428569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Releasing lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:22:59.428886 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Instance network_info: |[{"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:22:59.431070 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Start _get_guest_xml network_info=[{"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:22:59.435796 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:22:59.437258 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-573483232', uuid='b5166ed7-2300-4f0f-a83e-f4e45e469dc8'), owner=OwnerMeta(userid='74c3cd4fd76e48508b391718ae88e54d', username='tempest-TestStampPattern-1922334425-project-member', projectid='c311152ba8e648b29dec91d5696dfd79', projectname='tempest-TestStampPattern-1922334425'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534179.436846) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:22:59.438394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:22:59.438755 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:22:59.439883 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:22:59.440068 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:22:59.441094 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:22:59.441483 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:22:59.441731 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:22:59.441842 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:22:59.441985 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:22:59.442069 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:22:59.442174 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:22:59.442340 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:22:59.442505 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:22:59.442682 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:22:59.442926 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:22:59.443048 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:22:59.453636 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:22:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-573483232',display_name='tempest-TestStampPattern-server-573483232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-teststamppattern-server-573483232',id=71,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLsoUgmnM2mA1lL8DuFlpBo3CGzhpyt70TjsmVnBWgRrZ44G0RqQTbgYpLN8RnahmdFTG0Tn8yOEFOq9BrQ94jOFvuhPTIu7dQN+DrSwkuMpN/Zy71uJXz+llJIwtndQ==',key_name='tempest-TestStampPattern-128729590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c311152ba8e648b29dec91d5696dfd79',ramdisk_id='',reservation_id='r-dmxnrg27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1922334425',owner_user_name='tempest-TestStampPattern-1922334425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:22:57Z,user_data=None,user_id='74c3cd4fd76e48508b391718ae88e54d',uuid=b5166ed7-2300-4f0f-a83e-f4e45e469dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:22:59.453850 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converting VIF {"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:22:59.454389 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:22:59.454887 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'pci_devices' on Instance uuid b5166ed7-2300-4f0f-a83e-f4e45e469dc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:22:59.669751 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:22:59.674742 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:22:59.681061 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:22:59.686979 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.695113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.699843 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.709194 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.709526 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.717785 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.718022 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:59.750743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.40.100,3260]
Jun 27 04:22:59.750743 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.40.100,3260] successful.
Jun 27 04:22:59.750743 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.757381 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.50.100,3260]
Jun 27 04:22:59.757381 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.50.100,3260] successful.
Jun 27 04:22:59.757381 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.762729 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.769986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:59.771524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.789103 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.789459 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.789919 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:22:59.790246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f4f430b-7644-47c5-89db-22ab52772bf4 (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:22:59.790372 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:22:59.790632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:22:59.790882 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:22:59.790990 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:22:59.793000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('12', '-', '-', 0) found on session 192 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:22:59.793131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:22:59.793450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('14', '-', '-', 0) found on session 193 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:22:59.793560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:22:59.814009 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 192 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:22:59.814009 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:22:59.814664 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 193 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:22:59.814817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <uuid>b5166ed7-2300-4f0f-a83e-f4e45e469dc8</uuid>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <name>instance-00000047</name>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestStampPattern-server-573483232</nova:name>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:22:59</nova:creationTime>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:user uuid="74c3cd4fd76e48508b391718ae88e54d">tempest-TestStampPattern-1922334425-project-member</nova:user>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:project uuid="c311152ba8e648b29dec91d5696dfd79">tempest-TestStampPattern-1922334425</nova:project>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         <nova:port uuid="6dcddf71-b267-4169-9118-d46552dd9af3">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <entry name="serial">b5166ed7-2300-4f0f-a83e-f4e45e469dc8</entry>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <entry name="uuid">b5166ed7-2300-4f0f-a83e-f4e45e469dc8</entry>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.config"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:85:06:77"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <target dev="tap6dcddf71-b2"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/console.log" append="off"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:22:59.958469 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:22:59.960477 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Preparing to wait for external event network-vif-plugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:22:59.960477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:22:59.960477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:22:59.960477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:22:59.960477 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:22:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-573483232',display_name='tempest-TestStampPattern-server-573483232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-teststamppattern-server-573483232',id=71,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLsoUgmnM2mA1lL8DuFlpBo3CGzhpyt70TjsmVnBWgRrZ44G0RqQTbgYpLN8RnahmdFTG0Tn8yOEFOq9BrQ94jOFvuhPTIu7dQN+DrSwkuMpN/Zy71uJXz+llJIwtndQ==',key_name='tempest-TestStampPattern-128729590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c311152ba8e648b29dec91d5696dfd79',ramdisk_id='',reservation_id='r-dmxnrg27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1922334425',owner_user_name='tempest-TestStampPattern-1922334425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:22:57Z,user_data=None,user_id='74c3cd4fd76e48508b391718ae88e54d',uuid=b5166ed7-2300-4f0f-a83e-f4e45e469dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:22:59.960477 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converting VIF {"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:59.962860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a99149fc-05c1-5e49-a083-39b5ff3ff148', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:59.967126 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:22:59.970471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:59.970706 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dcddf71-b2, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:59.971129 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6dcddf71-b2, col_values=(('qos', UUID('3a5cb117-efd6-467c-94db-52ad11e0b71c')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:59.971340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6dcddf71-b2, col_values=(('external_ids', {'iface-id': '6dcddf71-b267-4169-9118-d46552dd9af3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:06:77', 'vm-uuid': 'b5166ed7-2300-4f0f-a83e-f4e45e469dc8'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:22:59.973930 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:59.976289 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:22:59.979516 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:22:59.982476 np0000003830 nova-compute[98984]: INFO os_vif [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2')
Jun 27 04:23:00.641668 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:23:01.498710 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:01.499133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:01.499133 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No VIF found with MAC fa:16:3e:85:06:77, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:23:01.499466 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Using config drive
Jun 27 04:23:01.658101 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 330000000b4b587b8 for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:23:01.658348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:01.658571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (5788ms) {'type': 'block', 'scsi_wwn': '330000000b4b587b8', 'path': '/dev/dm-2', 'multipath_id': '330000000b4b587b8'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:01.658713 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b4b587b8', 'path': '/dev/dm-2', 'multipath_id': '330000000b4b587b8'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:23:02.005705 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:02.133080 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Creating config drive at /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.config
Jun 27 04:23:02.137353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0f7_qdbn {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:02.166013 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-image-snapshot-server-1626021289',id=70,image_ref='f64c1cba-4094-4cf9-bd7f-49372ffdeceb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7XO+pOmUPQGdlf94IDGUwadzSKQBAXQkrHYHxgS4odolddhwOd3zQT7I0I8heeMBNFM1Is2xoqoaxAFYFjezZI6JGh6XYTHg1FT6SkYiUF/krvEboBbwdg0dwwGeDcew==',key_name='tempest-keypair-603555041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-o15qi0ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1983529732',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=0f4f4af1-f5c3-4037-b420-8a7b45c71f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:23:02.166235 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:23:02.167626 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:23:02.168469 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:02.195821 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0f7_qdbn" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:02.582311 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.605116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.609325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <uuid>0f4f4af1-f5c3-4037-b420-8a7b45c71f35</uuid>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <name>instance-00000046</name>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1626021289</nova:name>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:22:55</nova:creationTime>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:diskFormat>raw</nova:diskFormat>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="img_bdm_v2">True</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid=""/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         <nova:port uuid="614eee99-42b0-4279-be3f-42c3090c9ef6">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <entry name="serial">0f4f4af1-f5c3-4037-b420-8a7b45c71f35</entry>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <entry name="uuid">0f4f4af1-f5c3-4037-b420-8a7b45c71f35</entry>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35/disk.config"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <alias name="ua-47f073dc-f886-44e6-b947-6cfe2b98d10c"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-2"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <serial>47f073dc-f886-44e6-b947-6cfe2b98d10c</serial>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:be:28:f7"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <target dev="tap614eee99-42"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35/console.log" append="off"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:23:02.673048 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:23:02.675197 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Preparing to wait for external event network-vif-plugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:23:02.675197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:02.675197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:02.675197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:02.675197 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-image-snapshot-server-1626021289',id=70,image_ref='f64c1cba-4094-4cf9-bd7f-49372ffdeceb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7XO+pOmUPQGdlf94IDGUwadzSKQBAXQkrHYHxgS4odolddhwOd3zQT7I0I8heeMBNFM1Is2xoqoaxAFYFjezZI6JGh6XYTHg1FT6SkYiUF/krvEboBbwdg0dwwGeDcew==',key_name='tempest-keypair-603555041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-o15qi0ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1983529732',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=0f4f4af1-f5c3-4037-b420-8a7b45c71f35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:23:02.675197 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:23:02.675488 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:23:02.675757 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:23:02.675996 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.677520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:02.677520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:23:02.677520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.677520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d32fc8e-c149-5517-92e8-f235e94c9ddc', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:02.680890 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:02.682849 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.682990 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap614eee99-42, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:02.683352 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap614eee99-42, col_values=(('qos', UUID('58e2a00b-b998-4564-b5ca-f31bd7c32d96')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:02.683549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap614eee99-42, col_values=(('external_ids', {'iface-id': '614eee99-42b0-4279-be3f-42c3090c9ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:28:f7', 'vm-uuid': '0f4f4af1-f5c3-4037-b420-8a7b45c71f35'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:02.685667 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:02.692820 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.693704 np0000003830 nova-compute[98984]: INFO os_vif [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42')
Jun 27 04:23:02.733759 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0e015a47-5990-41db-b481-3008d5b4c4ce req-0533e75a-5864-4e78-9a09-91f425a9e457 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-plugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:02.734099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0e015a47-5990-41db-b481-3008d5b4c4ce req-0533e75a-5864-4e78-9a09-91f425a9e457 service nova] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:02.734251 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0e015a47-5990-41db-b481-3008d5b4c4ce req-0533e75a-5864-4e78-9a09-91f425a9e457 service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:02.734374 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0e015a47-5990-41db-b481-3008d5b4c4ce req-0533e75a-5864-4e78-9a09-91f425a9e457 service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:02.734520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0e015a47-5990-41db-b481-3008d5b4c4ce req-0533e75a-5864-4e78-9a09-91f425a9e457 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Processing event network-vif-plugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:23:02.882230 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.888424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.890766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.916150 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:02.923461 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:03.280560 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534183.2801037, b5166ed7-2300-4f0f-a83e-f4e45e469dc8 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:03.280672 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] VM Started (Lifecycle Event)
Jun 27 04:23:03.281968 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:23:03.295938 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:23:03.298352 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Instance spawned successfully.
Jun 27 04:23:03.298636 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:23:03.783140 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:03.785196 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:23:03.803962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:03.804112 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:03.804333 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:03.804644 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:03.804964 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:03.805245 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:04.211619 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:04.211734 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:04.211834 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:be:28:f7, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:23:04.212249 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Using config drive
Jun 27 04:23:04.287826 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:23:04.288129 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534184.2879133, b5166ed7-2300-4f0f-a83e-f4e45e469dc8 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:04.288331 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] VM Paused (Lifecycle Event)
Jun 27 04:23:04.310093 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Took 6.46 seconds to spawn the instance on the hypervisor.
Jun 27 04:23:04.310265 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:04.718177 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:04.780611 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:04.791611 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:04.795463 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534184.7924476, b5166ed7-2300-4f0f-a83e-f4e45e469dc8 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:04.795463 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] VM Resumed (Lifecycle Event)
Jun 27 04:23:04.812518 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0247bb1-e4ce-4b7d-a786-47edcebfeabc req-a5e7b9f3-1d08-42ac-a5ec-eb37eac6483a service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-plugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:04.813018 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0247bb1-e4ce-4b7d-a786-47edcebfeabc req-a5e7b9f3-1d08-42ac-a5ec-eb37eac6483a service nova] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:04.813180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0247bb1-e4ce-4b7d-a786-47edcebfeabc req-a5e7b9f3-1d08-42ac-a5ec-eb37eac6483a service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:04.813298 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0247bb1-e4ce-4b7d-a786-47edcebfeabc req-a5e7b9f3-1d08-42ac-a5ec-eb37eac6483a service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:04.813418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0247bb1-e4ce-4b7d-a786-47edcebfeabc req-a5e7b9f3-1d08-42ac-a5ec-eb37eac6483a service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] No waiting events found dispatching network-vif-plugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:04.813553 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-c0247bb1-e4ce-4b7d-a786-47edcebfeabc req-a5e7b9f3-1d08-42ac-a5ec-eb37eac6483a service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received unexpected event network-vif-plugged-6dcddf71-b267-4169-9118-d46552dd9af3 for instance with vm_state active and task_state None.
Jun 27 04:23:04.819286 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Took 11.76 seconds to build instance.
Jun 27 04:23:04.844331 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Creating config drive at /opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35/disk.config
Jun 27 04:23:04.848287 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpanrmakqt {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:04.903474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpanrmakqt" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:05.292131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:05.297229 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:05.308265 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:05.309535 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:23:05.324771 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.272s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:05.395912 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:05.464733 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:05.466294 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:05.536467 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37824880-dde0-4c0f-a2fe-b063b5e1e8aa req-c4eae843-0bef-4448-afd1-d43a4a0915c8 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-plugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:05.536467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37824880-dde0-4c0f-a2fe-b063b5e1e8aa req-c4eae843-0bef-4448-afd1-d43a4a0915c8 service nova] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:05.536467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37824880-dde0-4c0f-a2fe-b063b5e1e8aa req-c4eae843-0bef-4448-afd1-d43a4a0915c8 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:05.536467 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-37824880-dde0-4c0f-a2fe-b063b5e1e8aa req-c4eae843-0bef-4448-afd1-d43a4a0915c8 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:05.536467 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-37824880-dde0-4c0f-a2fe-b063b5e1e8aa req-c4eae843-0bef-4448-afd1-d43a4a0915c8 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Processing event network-vif-plugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:23:05.749699 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:06.419909 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:23:06.420471 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534186.4200578, 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:06.420681 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] VM Started (Lifecycle Event)
Jun 27 04:23:06.425516 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:23:06.427735 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Instance spawned successfully.
Jun 27 04:23:06.428027 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:23:06.435161 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:06.435452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:06.923666 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:06.926722 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:23:06.939910 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Took 11.10 seconds to spawn the instance on the hypervisor.
Jun 27 04:23:06.940085 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:07.093566 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-changed-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:07.093566 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Refreshing instance network info cache due to event network-changed-6dcddf71-b267-4169-9118-d46552dd9af3. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:23:07.093566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] Acquiring lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:23:07.093566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] Acquired lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:23:07.093566 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Refreshing network info cache for port 6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:23:07.429395 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:23:07.429860 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534187.4294324, 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:07.429860 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] VM Paused (Lifecycle Event)
Jun 27 04:23:07.450640 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Took 21.07 seconds to build instance.
Jun 27 04:23:07.586925 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-252515da-5636-40b2-9b38-1049026c398a req-564ddacb-a58b-4478-a3d4-44c266c28dc0 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-plugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:07.587128 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-252515da-5636-40b2-9b38-1049026c398a req-564ddacb-a58b-4478-a3d4-44c266c28dc0 service nova] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:07.587296 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-252515da-5636-40b2-9b38-1049026c398a req-564ddacb-a58b-4478-a3d4-44c266c28dc0 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:07.587457 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-252515da-5636-40b2-9b38-1049026c398a req-564ddacb-a58b-4478-a3d4-44c266c28dc0 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:07.587630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-252515da-5636-40b2-9b38-1049026c398a req-564ddacb-a58b-4478-a3d4-44c266c28dc0 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] No waiting events found dispatching network-vif-plugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:07.587774 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-252515da-5636-40b2-9b38-1049026c398a req-564ddacb-a58b-4478-a3d4-44c266c28dc0 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received unexpected event network-vif-plugged-614eee99-42b0-4279-be3f-42c3090c9ef6 for instance with vm_state active and task_state None.
Jun 27 04:23:07.595813 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:07.690034 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:07.932171 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:07.934731 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534187.9343808, 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:07.934906 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] VM Resumed (Lifecycle Event)
Jun 27 04:23:07.952154 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5a23411e-f92d-4d14-9941-53ab86f5c514 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.582s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:08.092664 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:08.214055 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updated VIF entry in instance network info cache for port 6dcddf71-b267-4169-9118-d46552dd9af3. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:23:08.214347 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updating instance_info_cache with network_info: [{"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:08.437603 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:08.440695 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:23:08.716404 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a973aa3f-643e-4a3e-a4bc-0246f5bacb14 req-64cf8bef-d888-4b01-93c7-329501ab7210 service nova] Releasing lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:23:09.655398 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-changed-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:09.655858 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Refreshing instance network info cache due to event network-changed-614eee99-42b0-4279-be3f-42c3090c9ef6. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:23:09.655858 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] Acquiring lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:23:09.656005 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] Acquired lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:23:09.656537 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Refreshing network info cache for port 614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:23:09.793361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:10.158283 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:10.446201 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:10.572576 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Updated VIF entry in instance network info cache for port 614eee99-42b0-4279-be3f-42c3090c9ef6. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:23:10.572803 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Updating instance_info_cache with network_info: [{"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:11.074595 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-107f7eca-70af-4f56-bf1a-17f41923cddd req-2e5e7b92-04b2-44a3-b20a-5800f52373cb service nova] Releasing lock "refresh_cache-0f4f4af1-f5c3-4037-b420-8a7b45c71f35" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:23:12.690830 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:14.794427 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:17.692481 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:18.049106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:18.049365 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:18.551599 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:23:19.095653 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:19.095979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:19.098900 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:23:19.099060 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Claim successful on node np0000003830
Jun 27 04:23:19.795790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:20.339459 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:23:20.339855 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:23:20.842122 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:23:21.348479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.252s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:21.349463 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:23:21.854460 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:23:21.854663 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:23:21.854955 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:21.855221 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:21.922046 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '167cf43243714b078a04b4c192717bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c06b4d16f4ddc96d9a367ad400f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:23:22.333936 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Successfully created port: 505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:23:22.360526 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:23:22.694857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:22.864534 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:23:23.222427 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Successfully updated port: 505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:23:23.265434 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-changed-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:23.265583 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Refreshing instance network info cache due to event network-changed-505ad38a-a284-4f53-816d-b86d6972b7be. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:23:23.265735 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] Acquiring lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:23:23.265871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] Acquired lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:23:23.266018 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Refreshing network info cache for port 505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:23:23.368704 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Booting with volume 3e551815-5937-470d-ad6c-7cb099b4f987 at /dev/vda
Jun 27 04:23:23.406188 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:23.417943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:23:23.440785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:23.485337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:23:23.485654 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:23:23.494382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:23:23.496016 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe81:668c', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce', 'fe80::fc16:3eff:fe85:677', 'fe80::c8a3:5aff:fec0:b214', 'fe80::fc16:3eff:febe:28f7'] 
Jun 27 04:23:23.496176 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:23:23.496311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:23:23.496620 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:23.496893 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Updating existing volume attachment record: dc4e6fb8-4c1f-441a-8965-1f6f349c6c63 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:23:23.723911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:23:23.768229 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:23.843028 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:23:23.976214 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:24.478134 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2966cf28-c446-4a42-9f42-ec027cee28f8 req-aa4bb8c8-f172-43dc-8472-c70ce6a705b4 service nova] Releasing lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:23:24.478668 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquired lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:23:24.478668 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:23:24.812821 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:25.043683 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:23:25.175235 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:25.294774 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Updating instance_info_cache with network_info: [{"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:25.592989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:23:25.593990 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:23:25.594227 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Creating image(s)
Jun 27 04:23:25.594638 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:23:25.594812 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Ensure instance console log exists: /opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:23:25.595122 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:25.595311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:25.595482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:25.797003 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Releasing lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:23:25.797310 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Instance network_info: |[{"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:23:25.798149 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Start _get_guest_xml network_info=[{"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'dc4e6fb8-4c1f-441a-8965-1f6f349c6c63', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a', 'attached_at': '', 'detached_at': '', 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'serial': '3e551815-5937-470d-ad6c-7cb099b4f987'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:23:25.802767 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:23:25.803897 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-677594679', uuid='4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a'), owner=OwnerMeta(userid='167cf43243714b078a04b4c192717bd3', username='tempest-TestVolumeBootPatternV346-1310252554-project-member', projectid='1b2c06b4d16f4ddc96d9a367ad400f1d', projectname='tempest-TestVolumeBootPatternV346-1310252554'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534205.8035371) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:23:25.805138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:23:25.805461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:23:25.806485 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:23:25.806694 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:23:25.807563 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:23:25.807851 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:23:25.808025 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:23:25.808147 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:23:25.808294 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:23:25.808415 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:23:25.808573 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:23:25.808753 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:23:25.808911 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:23:25.809046 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:23:25.809179 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:23:25.809321 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:23:25.819311 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:23:25.819810 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:25.820010 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:25.820371 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:25.820678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:23:25.832319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:25.832866 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:25.833260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:25.833420 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:23:25.834124 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:25.834124 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:23:25.845979 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:23:25.845979 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:25.850936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:23:25.850936 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987] added
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:25.858514 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:25.858865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:23:25.858915 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:23:25.859068 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987] added
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:25.863563 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:25.863814 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:23:25.863878 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:23:25.864026 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:23:26.859515 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:23:26.864454 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:23:26.871286 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:23:26.878190 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.886245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.893512 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.904935 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.905260 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.910623 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.910855 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:26.949017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.40.100,3260]
Jun 27 04:23:26.949017 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.40.100,3260] successful.
Jun 27 04:23:26.949017 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.955522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.50.100,3260]
Jun 27 04:23:26.955522 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.50.100,3260] successful.
Jun 27 04:23:26.955522 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.962582 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.968704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.978320 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.978685 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:26.978858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:26.978995 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:23:26.980218 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] HCTL ('9', '-', '-', 0) found on session 196 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:23:26.980354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.986896 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:26.987140 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:26.987427 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:26.987556 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:23:26.988560 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] HCTL ('11', '-', '-', 0) found on session 197 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:23:26.988706 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:23:26.996596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 196 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:23:26.996596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:23:27.003744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 197 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:23:27.003744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:23:27.697141 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:27.834097 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:23:28.849841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Found WWN 33000000017a10cd0 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:23:28.850342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:28.850342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000017a10cd0', 'path': '/dev/dm-1', 'multipath_id': '33000000017a10cd0'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:28.850546 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000017a10cd0', 'path': '/dev/dm-1', 'multipath_id': '33000000017a10cd0'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:23:29.355892 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-677594679',display_name='tempest-TestVolumeBootPatternV346-server-677594679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-677594679',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCxDvIl5FXdSpeWwNaUVGzbIWccXeMYrHOAChox0IrprpqIigpzJdSTK3+QN23wBGG/Eq4Q0LFSHuAtMyCutA5ALrRkCEIxPd0PTk7mtvYvnva9jK8nDJJOHpaMkn8p0g==',key_name='tempest-keypair-1918201295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-vdiqj02q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:23:29.356200 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:23:29.356626 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:23:29.357149 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:29.804939 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:29.805413 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:29.814565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <uuid>4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a</uuid>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <name>instance-00000048</name>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPatternV346-server-677594679</nova:name>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:23:25</nova:creationTime>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:user uuid="167cf43243714b078a04b4c192717bd3">tempest-TestVolumeBootPatternV346-1310252554-project-member</nova:user>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:project uuid="1b2c06b4d16f4ddc96d9a367ad400f1d">tempest-TestVolumeBootPatternV346-1310252554</nova:project>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         <nova:port uuid="505ad38a-a284-4f53-816d-b86d6972b7be">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <entry name="serial">4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a</entry>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <entry name="uuid">4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a</entry>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a/disk.config"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <alias name="ua-3e551815-5937-470d-ad6c-7cb099b4f987"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <serial>3e551815-5937-470d-ad6c-7cb099b4f987</serial>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:c4:08:82"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <target dev="tap505ad38a-a2"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a/console.log" append="off"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:23:29.859980 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:23:29.862272 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Preparing to wait for external event network-vif-plugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:23:29.862272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:29.862272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:29.862272 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:29.862272 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-677594679',display_name='tempest-TestVolumeBootPatternV346-server-677594679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-677594679',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCxDvIl5FXdSpeWwNaUVGzbIWccXeMYrHOAChox0IrprpqIigpzJdSTK3+QN23wBGG/Eq4Q0LFSHuAtMyCutA5ALrRkCEIxPd0PTk7mtvYvnva9jK8nDJJOHpaMkn8p0g==',key_name='tempest-keypair-1918201295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-vdiqj02q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:23:29.862272 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:23:29.862644 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:23:29.862644 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:23:29.863065 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.863370 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:29.863727 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:23:29.864573 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.864770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c360a70-b811-5dc1-84b3-12b4194e24d8', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:29.865678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.866573 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:29.866778 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.869024 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.869619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap505ad38a-a2, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:29.870028 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap505ad38a-a2, col_values=(('qos', UUID('22da2a29-dc34-4cde-b3bb-29ea73a17e4b')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:29.870247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap505ad38a-a2, col_values=(('external_ids', {'iface-id': '505ad38a-a284-4f53-816d-b86d6972b7be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:08:82', 'vm-uuid': '4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:29.871208 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.872283 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:29.876506 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:29.877381 np0000003830 nova-compute[98984]: INFO os_vif [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2')
Jun 27 04:23:30.309137 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'flavor' on Instance uuid b5166ed7-2300-4f0f-a83e-f4e45e469dc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:31.313980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:31.393795 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:31.393955 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:31.394031 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No VIF found with MAC fa:16:3e:c4:08:82, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:23:31.394412 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Using config drive
Jun 27 04:23:31.899321 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:32.015650 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Creating config drive at /opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a/disk.config
Jun 27 04:23:32.019430 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbi8ce6sl {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:32.073099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbi8ce6sl" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:32.447825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:32.466961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:32.493571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:32.493571 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:32.493791 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Attaching volume 207bb0aa-1fd2-434f-8352-c74ad2dc5916 to /dev/vdb
Jun 27 04:23:32.534140 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:32.544459 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:32.546208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:23:32.568066 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:32.610358 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40570ac8-36eb-4623-95f9-b3aa757b9d47 req-0803512b-8020-4ab2-a473-ee15051e1806 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-plugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:32.611780 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:32.612816 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40570ac8-36eb-4623-95f9-b3aa757b9d47 req-0803512b-8020-4ab2-a473-ee15051e1806 service nova] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:32.613216 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:23:32.613641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40570ac8-36eb-4623-95f9-b3aa757b9d47 req-0803512b-8020-4ab2-a473-ee15051e1806 service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:32.613808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-40570ac8-36eb-4623-95f9-b3aa757b9d47 req-0803512b-8020-4ab2-a473-ee15051e1806 service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:32.613936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-40570ac8-36eb-4623-95f9-b3aa757b9d47 req-0803512b-8020-4ab2-a473-ee15051e1806 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Processing event network-vif-plugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:23:32.614262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:23:32.622904 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:23:32.624109 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe81:668c', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce', 'fe80::fc16:3eff:fe85:677', 'fe80::c8a3:5aff:fec0:b214', 'fe80::fc16:3eff:febe:28f7', 'fe80::fc16:3eff:fec4:882'] 
Jun 27 04:23:32.624109 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:23:32.624658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:23:32.624658 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:32.625278 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updating existing volume attachment record: fcf2aff1-b222-4c1f-8195-623985249e16 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:23:32.826442 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:32.826808 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:23:32.829923 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:32.830157 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:23:33.095250 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534213.0948608, 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:33.095893 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:23:33.096395 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] VM Started (Lifecycle Event)
Jun 27 04:23:33.098752 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:23:33.101748 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Instance spawned successfully.
Jun 27 04:23:33.102126 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:23:33.174865 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:23:33.175294 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:33.175458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:33.175927 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:33.176246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:23:33.186569 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:33.187213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:33.187684 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:33.187901 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:23:33.188445 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:33.188686 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:23:33.199667 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:23:33.199667 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:33.204093 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:23:33.204093 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916] added
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:33.211564 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:33.211858 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:23:33.212041 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:23:33.212041 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916] added
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:23:33.215491 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:33.215806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:23:33.215806 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:23:33.215877 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:23:33.600328 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:33.602392 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:23:33.608896 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:33.609016 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:33.609224 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:33.609423 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:33.609737 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:33.609952 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:23:34.106518 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:23:34.106740 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534214.106563, 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:34.106872 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] VM Paused (Lifecycle Event)
Jun 27 04:23:34.114959 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Took 8.52 seconds to spawn the instance on the hypervisor.
Jun 27 04:23:34.115134 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:34.212458 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:23:34.216212 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:23:34.224593 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:23:34.233003 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.240442 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.246117 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.260833 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.261100 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.265940 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.266131 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:34.306409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.40.100,3260]
Jun 27 04:23:34.306409 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.40.100,3260] successful.
Jun 27 04:23:34.306409 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.315849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.50.100,3260]
Jun 27 04:23:34.315849 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.50.100,3260] successful.
Jun 27 04:23:34.315849 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.320760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.329819 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.338825 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.339161 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:34.339351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:34.339351 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:23:34.340382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] HCTL ('15', '-', '-', 0) found on session 198 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:23:34.340522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.348613 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:34.348909 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:34.349137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:34.349201 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:23:34.350918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] HCTL ('16', '-', '-', 0) found on session 199 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:23:34.350918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:23:34.357509 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching for a device in session 198 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:23:34.357676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:23:34.362800 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching for a device in session 199 and hctl ['16', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:23:34.609265 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:34.611236 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534214.6110685, 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:23:34.611360 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] VM Resumed (Lifecycle Event)
Jun 27 04:23:34.624054 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Took 15.57 seconds to build instance.
Jun 27 04:23:34.674305 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b970cb82-7978-46c0-a971-13479d6e2534 req-4a3b11dc-3861-4c15-a15e-a304e725dc6b service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-plugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:34.675926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b970cb82-7978-46c0-a971-13479d6e2534 req-4a3b11dc-3861-4c15-a15e-a304e725dc6b service nova] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:34.675926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b970cb82-7978-46c0-a971-13479d6e2534 req-4a3b11dc-3861-4c15-a15e-a304e725dc6b service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:34.675926 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b970cb82-7978-46c0-a971-13479d6e2534 req-4a3b11dc-3861-4c15-a15e-a304e725dc6b service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:34.675926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b970cb82-7978-46c0-a971-13479d6e2534 req-4a3b11dc-3861-4c15-a15e-a304e725dc6b service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] No waiting events found dispatching network-vif-plugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:34.675926 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-b970cb82-7978-46c0-a971-13479d6e2534 req-4a3b11dc-3861-4c15-a15e-a304e725dc6b service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received unexpected event network-vif-plugged-505ad38a-a284-4f53-816d-b86d6972b7be for instance with vm_state active and task_state None.
Jun 27 04:23:34.815925 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:34.871328 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:35.113384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:35.115274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:23:35.125520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7bcca79c-8370-485d-8a93-7b53987f6979 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.076s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:35.364150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching for a device in session 199 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:23:35.364150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:23:35.492032 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-changed-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:35.492176 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Refreshing instance network info cache due to event network-changed-505ad38a-a284-4f53-816d-b86d6972b7be. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:23:35.492363 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] Acquiring lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:23:35.492479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] Acquired lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:23:35.492661 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Refreshing network info cache for port 505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:23:35.830213 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:35.830754 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:23:35.994902 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:36.204078 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Found WWN 33000000069deea7d for multipath device dm-12 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:23:36.204316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:36.204451 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000069deea7d', 'path': '/dev/dm-12', 'multipath_id': '33000000069deea7d'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:36.204598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069deea7d', 'path': '/dev/dm-12', 'multipath_id': '33000000069deea7d'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:23:36.207453 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'flavor' on Instance uuid b5166ed7-2300-4f0f-a83e-f4e45e469dc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:36.702938 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:36.710061 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Attempting to attach volume 207bb0aa-1fd2-434f-8352-c74ad2dc5916 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]:   <alias name="ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916"/>
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-12"/>
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]:   <serial>207bb0aa-1fd2-434f-8352-c74ad2dc5916</serial>
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:23:36.711643 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:23:36.829175 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Updated VIF entry in instance network info cache for port 505ad38a-a284-4f53-816d-b86d6972b7be. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:23:36.829415 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Updating instance_info_cache with network_info: [{"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:36.830580 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:37.331401 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef46b793-a08b-44b1-a479-d588b49ee7da req-cc13ea1d-c1f2-416d-a1b0-e8004982dac5 service nova] Releasing lock "refresh_cache-4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:23:37.339308 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:37.339549 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:37.339645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:37.339779 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:23:38.368144 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:23:38.370017 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:23:38.371984 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:23:38.373723 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:23:38.375637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:38.397262 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:38.397481 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:38.397650 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:23:38.397841 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No VIF found with MAC fa:16:3e:85:06:77, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:23:38.460896 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:38.461377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:38.547796 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:38.548352 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-12 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:23:38.554061 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:23:38.555722 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:38.608750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:38.609160 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50360MB free_disk=71.88923645019531GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:23:38.609333 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:38.609586 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 67f683c0-a514-400c-a7f9-7e3aacb161b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d0722c2-911a-4f04-ba22-55af13b84ea5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 5 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:23:39.669601 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1472MB phys_disk=95GB used_disk=1GB total_vcpus=16 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:23:38 up 46 min,  2 users,  load average: 3.65, 5.55, 5.67\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '2', 'io_workload': '0', 'num_proj_1b2c06b4d16f4ddc96d9a367ad400f1d': '2', 'num_proj_c311152ba8e648b29dec91d5696dfd79': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:23:39.817647 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:39.872987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:39.937933 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:23:39.937933 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:23:39.991794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-74e4a96a-8dc6-4580-8ded-c15147aa6a7c tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.498s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:40.440201 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:23:40.946966 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:23:40.946966 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.337s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:40.947862 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:23:43.625698 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:43.626204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:44.128206 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Detaching volume 207bb0aa-1fd2-434f-8352-c74ad2dc5916
Jun 27 04:23:44.165480 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Attempting to driver detach volume 207bb0aa-1fd2-434f-8352-c74ad2dc5916 from mountpoint /dev/vdb
Jun 27 04:23:44.172628 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Found disk vdb by alias ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:23:44.174091 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Found disk vdb by alias ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:23:44.174266 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Attempting to detach device vdb from instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:   <alias name="ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916"/>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-12"/>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:   <serial>207bb0aa-1fd2-434f-8352-c74ad2dc5916</serial>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:23:44.174569 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:23:44.180649 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully detached device vdb from instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 from the persistent domain config.
Jun 27 04:23:44.180823 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] (1/8): Attempting to detach device vdb with device alias ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916 from instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:   <alias name="ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916"/>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-12"/>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:   <serial>207bb0aa-1fd2-434f-8352-c74ad2dc5916</serial>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:23:44.181062 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:23:44.665149 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534224.6647706, b5166ed7-2300-4f0f-a83e-f4e45e469dc8 => ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:23:44.666034 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-207bb0aa-1fd2-434f-8352-c74ad2dc5916 for instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:23:44.668219 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully detached device vdb from instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 from the live domain config.
Jun 27 04:23:44.669249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:23:44.669553 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:44.669714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:44.670015 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:44.670316 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '207bb0aa-1fd2-434f-8352-c74ad2dc5916', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:23:44.670448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:44.698209 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916 (non-flash)
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', '199')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:23:44.698637 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', '198')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:23:44.699709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916', '199')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:23:44.700838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5182334c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'): ({'sdk'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:23:44.701105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Removing multipathed devices sdk, sdj {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:23:44.701414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Flush multipath device 33000000069deea7d {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:23:44.732826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:23:44.793161 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:23:44.819484 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:44.839026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:23:44.839196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:23:44.840417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:23:44.853165 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:23:44.853392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:23:44.864972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:44.873768 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:44.904511 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.40.100,3260]
Jun 27 04:23:44.904511 np0000003830 nova-compute[98984]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.40.100,3260] successful.
Jun 27 04:23:44.904511 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:44.922869 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:44.935339 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:44.971693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.50.100,3260]
Jun 27 04:23:44.971693 np0000003830 nova-compute[98984]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-207bb0aa-1fd2-434f-8352-c74ad2dc5916, portal: 192.168.50.100,3260] successful.
Jun 27 04:23:44.971693 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:44.992850 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:44.993052 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:44.993223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] <== disconnect_volume: return (323ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:44.993348 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:23:45.538174 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'flavor' on Instance uuid b5166ed7-2300-4f0f-a83e-f4e45e469dc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:45.947466 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:45.948189 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:45.948647 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:45.948647 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:45.948850 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:23:45.949051 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:23:45.950180 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.88 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:23:45.967982 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:45.968166 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:45.968402 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:45.968569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:45.968679 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:45.970643 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Terminating instance
Jun 27 04:23:46.473861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:23:46.492881 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.495410 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.517708 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.544878 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-648ac5fe-046f-4d88-a30d-6f16db5624b8 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.918s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:46.663608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.668087 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4f57b7cb-e7f6-4d6e-b4cb-a8b16272e0b0 req-5478a48a-12d1-4032-a5f3-450186a31f79 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-unplugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:46.668253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4f57b7cb-e7f6-4d6e-b4cb-a8b16272e0b0 req-5478a48a-12d1-4032-a5f3-450186a31f79 service nova] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:46.668398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4f57b7cb-e7f6-4d6e-b4cb-a8b16272e0b0 req-5478a48a-12d1-4032-a5f3-450186a31f79 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:46.668506 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4f57b7cb-e7f6-4d6e-b4cb-a8b16272e0b0 req-5478a48a-12d1-4032-a5f3-450186a31f79 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:46.669742 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4f57b7cb-e7f6-4d6e-b4cb-a8b16272e0b0 req-5478a48a-12d1-4032-a5f3-450186a31f79 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] No waiting events found dispatching network-vif-unplugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:46.670127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.670177 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4f57b7cb-e7f6-4d6e-b4cb-a8b16272e0b0 req-5478a48a-12d1-4032-a5f3-450186a31f79 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-unplugged-614eee99-42b0-4279-be3f-42c3090c9ef6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:23:46.771952 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.780352 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:46.801666 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99965170500036 future=<Future at 0x7ec51821d130 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:23:46.802268 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999030111000138 future=<Future at 0x7ec51821d130 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:23:46.802388 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998878374000014 future=<Future at 0x7ec51821d130 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:23:46.804824 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Instance destroyed successfully.
Jun 27 04:23:46.805342 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:47.016917 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:23:47.307667 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1626021289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-image-snapshot-server-1626021289',id=70,image_ref='f64c1cba-4094-4cf9-bd7f-49372ffdeceb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7XO+pOmUPQGdlf94IDGUwadzSKQBAXQkrHYHxgS4odolddhwOd3zQT7I0I8heeMBNFM1Is2xoqoaxAFYFjezZI6JGh6XYTHg1FT6SkYiUF/krvEboBbwdg0dwwGeDcew==',key_name='tempest-keypair-603555041',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:23:06Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-o15qi0ta',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1983529732',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=0f4f4af1-f5c3-4037-b420-8a7b45c71f35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:23:47.307889 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "614eee99-42b0-4279-be3f-42c3090c9ef6", "address": "fa:16:3e:be:28:f7", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap614eee99-42", "ovs_interfaceid": "614eee99-42b0-4279-be3f-42c3090c9ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:23:47.308578 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:23:47.308798 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:23:47.310018 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:47.310228 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap614eee99-42, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:47.312065 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:47.312750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:47.313234 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:47.313426 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58e2a00b-b998-4564-b5ca-f31bd7c32d96) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:47.314329 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:47.314689 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:47.316428 np0000003830 nova-compute[98984]: INFO os_vif [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=614eee99-42b0-4279-be3f-42c3090c9ef6,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap614eee99-42')
Jun 27 04:23:47.318285 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:23:47.318537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:47.318658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:47.318929 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:47.319285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f073dc-f886-44e6-b947-6cfe2b98d10c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:23:47.319402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:47.346120 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:47.346361 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:47.346565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:23:47.346565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', '192')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:23:47.347433 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c', '193')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:23:47.348317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53af956c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'): ({'sdi'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:23:47.348458 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdg, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:23:47.348685 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 330000000b4b587b8 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:23:47.411896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:23:47.456058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:23:47.512877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdg, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:23:47.513035 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdg, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:23:47.514093 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdg', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:23:47.524872 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdg', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:23:47.525012 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:23:47.537136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:47.570309 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.40.100,3260]
Jun 27 04:23:47.570309 np0000003830 nova-compute[98984]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.40.100,3260] successful.
Jun 27 04:23:47.570309 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:47.586739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:47.600036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:47.643691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.50.100,3260]
Jun 27 04:23:47.643691 np0000003830 nova-compute[98984]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-47f073dc-f886-44e6-b947-6cfe2b98d10c, portal: 192.168.50.100,3260] successful.
Jun 27 04:23:47.643691 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:47.659166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:47.659381 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:47.659510 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (340ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:47.659631 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:23:47.659978 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Deleting instance files /opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35_del
Jun 27 04:23:47.660544 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Deletion of /opt/stack/data/nova/instances/0f4f4af1-f5c3-4037-b420-8a7b45c71f35_del complete
Jun 27 04:23:48.167586 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Took 1.69 seconds to destroy the instance on the hypervisor.
Jun 27 04:23:48.168213 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:23:48.168547 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:23:48.168718 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:23:48.169019 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:48.228925 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:48.693809 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a1169853-0aa2-4d20-93a0-f4e6230be1b0 req-b2c92aea-3502-4479-bcfc-2f18cb730ee0 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-deleted-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:48.693940 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-a1169853-0aa2-4d20-93a0-f4e6230be1b0 req-b2c92aea-3502-4479-bcfc-2f18cb730ee0 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Neutron deleted interface 614eee99-42b0-4279-be3f-42c3090c9ef6; detaching it from the instance and deleting it from the info cache
Jun 27 04:23:48.695569 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a1169853-0aa2-4d20-93a0-f4e6230be1b0 req-b2c92aea-3502-4479-bcfc-2f18cb730ee0 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Detach interface failed, port_id=614eee99-42b0-4279-be3f-42c3090c9ef6, reason: Instance 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:23:48.724348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-753ef31e-b4f2-45c5-88a5-421c466c681b req-c9668b46-3ff1-4a37-b388-615e9aaaff73 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-unplugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:48.724348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-753ef31e-b4f2-45c5-88a5-421c466c681b req-c9668b46-3ff1-4a37-b388-615e9aaaff73 service nova] Acquiring lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:48.724348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-753ef31e-b4f2-45c5-88a5-421c466c681b req-c9668b46-3ff1-4a37-b388-615e9aaaff73 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:48.724348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-753ef31e-b4f2-45c5-88a5-421c466c681b req-c9668b46-3ff1-4a37-b388-615e9aaaff73 service nova] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:48.724348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-753ef31e-b4f2-45c5-88a5-421c466c681b req-c9668b46-3ff1-4a37-b388-615e9aaaff73 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] No waiting events found dispatching network-vif-unplugged-614eee99-42b0-4279-be3f-42c3090c9ef6 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:48.724348 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-753ef31e-b4f2-45c5-88a5-421c466c681b req-c9668b46-3ff1-4a37-b388-615e9aaaff73 service nova] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Received event network-vif-unplugged-614eee99-42b0-4279-be3f-42c3090c9ef6 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:23:49.008815 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:23:49.151697 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:49.514801 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] instance snapshotting
Jun 27 04:23:49.596892 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Beginning live snapshot process
Jun 27 04:23:49.653637 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Took 1.48 seconds to deallocate network for instance.
Jun 27 04:23:49.821122 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:50.218306 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Took 0.56 seconds to detach 1 volumes for instance.
Jun 27 04:23:50.220675 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Deleting volume: 47f073dc-f886-44e6-b947-6cfe2b98d10c {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:23:50.775554 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:50.776081 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:51.016360 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:23:51.016583 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:23:51.109184 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:51.204116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json -f qcow2" returned: 0 in 0.095s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:51.204606 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json -f qcow2 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:51.295470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json -f qcow2" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:51.296325 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:23:51.298868 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:23:51.299221 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:51.391449 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:51.392140 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpug9hdmk2/dc1059b6fb9e425b9f2dfa80287bdffd.delta 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:51.451336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpug9hdmk2/dc1059b6fb9e425b9f2dfa80287bdffd.delta 1073741824" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:51.452055 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Quiescing instance not available: QEMU guest agent is not enabled.
Jun 27 04:23:51.521682 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:23:51.674576 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:23:52.031632 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.255s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:52.111665 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 0f4f4af1-f5c3-4037-b420-8a7b45c71f35
Jun 27 04:23:52.177766 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] COPY block job progress, current cursor: 27787264 final cursor: 76742656 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:23:52.315973 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:52.686704 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98984) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
Jun 27 04:23:52.688191 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Skipping quiescing instance: QEMU guest agent is not enabled.
Jun 27 04:23:52.730804 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:23:52.731198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpug9hdmk2/dc1059b6fb9e425b9f2dfa80287bdffd.delta /opt/stack/data/nova/instances/snapshots/tmpug9hdmk2/dc1059b6fb9e425b9f2dfa80287bdffd {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:23:53.120489 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-17292255-fb71-42af-b7bf-77ee0dce5882 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "0f4f4af1-f5c3-4037-b420-8a7b45c71f35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:53.324032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpug9hdmk2/dc1059b6fb9e425b9f2dfa80287bdffd.delta /opt/stack/data/nova/instances/snapshots/tmpug9hdmk2/dc1059b6fb9e425b9f2dfa80287bdffd" returned: 0 in 0.593s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:23:53.331958 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Snapshot extracted, beginning image upload
Jun 27 04:23:54.823037 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:55.306288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:55.306630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:55.306933 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:55.307155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:55.307348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:55.309828 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Terminating instance
Jun 27 04:23:55.687146 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Snapshot image upload complete
Jun 27 04:23:55.687364 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-85385285-a606-4e5c-bf94-af65ff564326 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Took 6.17 seconds to snapshot the instance on the hypervisor.
Jun 27 04:23:55.814085 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:23:55.840873 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:55.842744 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:55.861515 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:55.862038 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:55.886110 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:55.996412 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19ccd6bb-4d02-4d6e-8bfc-9a8a6950bf3c req-577fcb1c-df6e-4cf4-a96e-fc1f16beca34 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-unplugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:55.996844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19ccd6bb-4d02-4d6e-8bfc-9a8a6950bf3c req-577fcb1c-df6e-4cf4-a96e-fc1f16beca34 service nova] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:55.997031 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19ccd6bb-4d02-4d6e-8bfc-9a8a6950bf3c req-577fcb1c-df6e-4cf4-a96e-fc1f16beca34 service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:55.997159 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-19ccd6bb-4d02-4d6e-8bfc-9a8a6950bf3c req-577fcb1c-df6e-4cf4-a96e-fc1f16beca34 service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:55.997318 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19ccd6bb-4d02-4d6e-8bfc-9a8a6950bf3c req-577fcb1c-df6e-4cf4-a96e-fc1f16beca34 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] No waiting events found dispatching network-vif-unplugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:55.997490 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-19ccd6bb-4d02-4d6e-8bfc-9a8a6950bf3c req-577fcb1c-df6e-4cf4-a96e-fc1f16beca34 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-unplugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:23:56.078959 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.155742 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999622762999934 future=<Future at 0x7ec53864a210 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:23:56.156966 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Instance destroyed successfully.
Jun 27 04:23:56.157571 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 67f683c0-a514-400c-a7f9-7e3aacb161b5 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:23:56.660089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-585326607',display_name='tempest-TestVolumeBootPattern-volume-backed-server-585326607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-volume-backed-server-585326607',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgUcz6o8j8bMiIDoqNdxT0Y7dYPeopck7BfQ3XDfe7+E3d22/a8t87K1HsbG+M00tviRjegSu19rML8YDBy+9RLk0TF/UmRvLWv21CgUl2eUnpn9o2krjNnDz6KeCCKdA==',key_name='tempest-keypair-852571463',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:22:00Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-99sj4shg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f26454c3434b0d86ba862b622c839f',uuid=67f683c0-a514-400c-a7f9-7e3aacb161b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:23:56.660356 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "address": "fa:16:3e:81:66:8c", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape16cba4a-16", "ovs_interfaceid": "e16cba4a-1649-4f55-9562-7ce92f5d9917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:23:56.661014 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:23:56.661221 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:23:56.662408 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.662561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape16cba4a-16, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:56.663550 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.664291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:56.664507 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.665103 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.665237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef296485-4e91-4b6e-9628-39e7835fbc62) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:23:56.665628 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.666043 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:23:56.666270 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:23:56.668365 np0000003830 nova-compute[98984]: INFO os_vif [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:66:8c,bridge_name='br-int',has_traffic_filtering=True,id=e16cba4a-1649-4f55-9562-7ce92f5d9917,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape16cba4a-16')
Jun 27 04:23:56.669901 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:23:56.670202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:23:56.670329 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:23:56.670725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:23:56.671021 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b480c122-2b0c-416e-99f5-9ec5964ada3e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:23:56.671167 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:56.695032 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]: tcp: [182] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e (non-flash)
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:23:56.695336 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:23:56.695574 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '181'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '182'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:23:56.695750 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '181')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:23:56.697642 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e', '182')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:23:56.698457 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec51870fba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:23:56.698748 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:23:56.698975 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 330000000557f562d {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:23:56.761054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:23:56.799094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:23:56.848895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:23:56.849244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:23:56.850290 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:23:56.861089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:23:56.861341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:23:56.872826 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:56.900374 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.40.100,3260]
Jun 27 04:23:56.900374 np0000003830 nova-compute[98984]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.40.100,3260] successful.
Jun 27 04:23:56.900374 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:56.914194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:56.924643 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:56.950174 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.50.100,3260]
Jun 27 04:23:56.950174 np0000003830 nova-compute[98984]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-b480c122-2b0c-416e-99f5-9ec5964ada3e, portal: 192.168.50.100,3260] successful.
Jun 27 04:23:56.950174 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:56.964976 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:23:56.965205 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:23:56.965371 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (294ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:23:56.965439 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:23:56.965733 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Deleting instance files /opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5_del
Jun 27 04:23:56.966188 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Deletion of /opt/stack/data/nova/instances/67f683c0-a514-400c-a7f9-7e3aacb161b5_del complete
Jun 27 04:23:57.473392 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Took 1.66 seconds to destroy the instance on the hypervisor.
Jun 27 04:23:57.474053 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:23:57.474502 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:23:57.474761 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:23:57.475094 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:57.585919 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:23:57.851942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:57.852470 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:58.050793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-unplugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:58.051686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] Acquiring lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:58.051686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:58.051686 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:23:58.051686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] No waiting events found dispatching network-vif-unplugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:23:58.051898 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-unplugged-e16cba4a-1649-4f55-9562-7ce92f5d9917 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:23:58.051898 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Received event network-vif-deleted-e16cba4a-1649-4f55-9562-7ce92f5d9917 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:23:58.051966 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Neutron deleted interface e16cba4a-1649-4f55-9562-7ce92f5d9917; detaching it from the instance and deleting it from the info cache
Jun 27 04:23:58.054165 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b4dfe9e8-35ca-4ffb-beec-49cb396d2902 req-4458ce39-249e-47ba-820b-c54405ffdd08 service nova] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Detach interface failed, port_id=e16cba4a-1649-4f55-9562-7ce92f5d9917, reason: Instance 67f683c0-a514-400c-a7f9-7e3aacb161b5 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:23:58.354123 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:23:58.422824 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:23:58.897438 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:23:58.897827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:23:58.900574 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:23:58.900731 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Claim successful on node np0000003830
Jun 27 04:23:58.924691 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:23:59.465451 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Took 0.54 seconds to detach 1 volumes for instance.
Jun 27 04:23:59.467285 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Deleting volume: b480c122-2b0c-416e-99f5-9ec5964ada3e {{(pid=98984) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
Jun 27 04:23:59.834447 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:00.006673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:00.149143 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:24:00.149365 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:24:00.651809 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:24:01.157464 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.260s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:01.158066 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.151s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:01.158232 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:24:01.430177 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:24:01.430435 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:24:01.666525 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:24:01.666643 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:24:01.666842 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:01.667031 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:01.668431 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:01.729233 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74c3cd4fd76e48508b391718ae88e54d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c311152ba8e648b29dec91d5696dfd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:24:01.801778 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.000451029999567254 future=<Future at 0x7ec51821d130 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:01.801905 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:01.801977 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.35331336399986 future=<Future at 0x7ec53864a210 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:01.802064 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.353227245999733 future=<Future at 0x7ec53864a210 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:01.802474 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Emitting event <LifecycleEvent: 1782534226.801203, 0f4f4af1-f5c3-4037-b420-8a7b45c71f35 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:01.802644 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] VM Stopped (Lifecycle Event)
Jun 27 04:24:01.932992 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:24:02.169361 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:24:02.221048 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Successfully created port: 7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:24:02.308218 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 0f4f4af1-f5c3-4037-b420-8a7b45c71f35] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:02.441161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.283s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:02.499373 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 67f683c0-a514-400c-a7f9-7e3aacb161b5
Jun 27 04:24:02.672342 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:24:02.679274 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Successfully updated port: 7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:24:02.737469 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-changed-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:02.737469 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Refreshing instance network info cache due to event network-changed-7b6b05d3-8866-4b54-bbd0-c30d37393f65. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:24:02.737469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] Acquiring lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:02.737469 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] Acquired lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:02.737469 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Refreshing network info cache for port 7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:24:03.182947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:03.239332 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:03.296339 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:24:03.419819 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:03.507119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7610f3b1-51a4-480c-8c18-4c3ee6a7f58c tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "67f683c0-a514-400c-a7f9-7e3aacb161b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.200s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:03.680601 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:24:03.681356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:24:03.681583 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Creating image(s)
Jun 27 04:24:03.681981 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "/opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:03.682115 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "/opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:03.682542 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "/opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:03.682756 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "da06e76fe3678a3662dd28598892f53851c03bdb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:03.683026 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "da06e76fe3678a3662dd28598892f53851c03bdb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:03.921549 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-80acb7af-db3e-4d78-ad6d-09de0e13fe4c req-5550b5a2-4853-43ef-8c49-2c3fb05a522d service nova] Releasing lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:03.921925 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquired lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:03.922068 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:24:04.488789 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:24:04.493305 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:24:04.493727 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.part --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:04.520060 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:24:04.594409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.part --force-share --output=json" returned: 0 in 0.100s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:04.595087 np0000003830 nova-compute[98984]: DEBUG nova.virt.images [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] 72c10e2c-1973-43da-ae40-944a835f6307 was qcow2, converting to raw {{(pid=98984) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
Jun 27 04:24:04.596089 np0000003830 nova-compute[98984]: DEBUG nova.privsep.utils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98984) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jun 27 04:24:04.596556 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.part /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.converted {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:04.740246 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:04.844309 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:04.863160 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updating instance_info_cache with network_info: [{"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:05.365565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Releasing lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:05.365783 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Instance network_info: |[{"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:24:05.569949 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.part /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.converted" returned: 0 in 0.973s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:05.581264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.converted --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:05.669202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb.converted --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:05.670766 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "da06e76fe3678a3662dd28598892f53851c03bdb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.988s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:05.671380 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:24:05.674231 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:24:05.675594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:05.764771 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:05.765394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "da06e76fe3678a3662dd28598892f53851c03bdb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:05.765909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "da06e76fe3678a3662dd28598892f53851c03bdb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:05.766409 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:24:05.769287 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:24:05.769685 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:05.853576 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb --force-share --output=json" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:05.854054 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb,backing_fmt=raw /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:05.918173 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb,backing_fmt=raw /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk 1073741824" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:05.918712 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "da06e76fe3678a3662dd28598892f53851c03bdb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:05.919077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:06.005542 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da06e76fe3678a3662dd28598892f53851c03bdb --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:06.006142 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:24:06.006358 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Ensure instance console log exists: /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:24:06.006637 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:06.006855 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:06.006993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:06.008633 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Start _get_guest_xml network_info=[{"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='f70045376e27cbd737e0faec5f8a0192',container_format='bare',created_at=2026-06-27T04:23:48Z,direct_url=<?>,disk_format='qcow2',id=72c10e2c-1973-43da-ae40-944a835f6307,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-916167755',owner='c311152ba8e648b29dec91d5696dfd79',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-06-27T04:23:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': '72c10e2c-1973-43da-ae40-944a835f6307'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:24:06.012901 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:24:06.028886 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1167358807', uuid='13999eeb-6cae-4304-8b86-e80759b578c4'), owner=OwnerMeta(userid='74c3cd4fd76e48508b391718ae88e54d', username='tempest-TestStampPattern-1922334425-project-member', projectid='c311152ba8e648b29dec91d5696dfd79', projectname='tempest-TestStampPattern-1922334425'), image=ImageMeta(id='72c10e2c-1973-43da-ae40-944a835f6307', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'c311152ba8e648b29dec91d5696dfd79'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534246.0139663) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:24:06.029778 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:24:06.030111 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:24:06.042846 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:24:06.043010 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:24:06.044136 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:24:06.044461 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f70045376e27cbd737e0faec5f8a0192',container_format='bare',created_at=2026-06-27T04:23:48Z,direct_url=<?>,disk_format='qcow2',id=72c10e2c-1973-43da-ae40-944a835f6307,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-916167755',owner='c311152ba8e648b29dec91d5696dfd79',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-06-27T04:23:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:24:06.044617 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:24:06.044710 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:24:06.044825 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:24:06.044907 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:24:06.045091 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:24:06.045246 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:24:06.045353 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:24:06.045457 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:24:06.045585 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:24:06.045692 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:24:06.056586 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1167358807',display_name='tempest-TestStampPattern-server-1167358807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-teststamppattern-server-1167358807',id=73,image_ref='72c10e2c-1973-43da-ae40-944a835f6307',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLsoUgmnM2mA1lL8DuFlpBo3CGzhpyt70TjsmVnBWgRrZ44G0RqQTbgYpLN8RnahmdFTG0Tn8yOEFOq9BrQ94jOFvuhPTIu7dQN+DrSwkuMpN/Zy71uJXz+llJIwtndQ==',key_name='tempest-TestStampPattern-128729590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c311152ba8e648b29dec91d5696dfd79',ramdisk_id='',reservation_id='r-o82cjbf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b5166ed7-2300-4f0f-a83e-f4e45e469dc8',image_min_disk='1',image_min_ram='0',image_owner_id='c311152ba8e648b29dec91d5696dfd79',image_owner_project_name='tempest-TestStampPattern-1922334425',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1922334425-project-member',image_user_id='74c3cd4fd76e48508b391718ae88e54d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1922334425',owner_user_name='tempest-TestStampPattern-1922334425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:24:03Z,user_data=None,user_id='74c3cd4fd76e48508b391718ae88e54d',uuid=13999eeb-6cae-4304-8b86-e80759b578c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:24:06.056775 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converting VIF {"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:06.057306 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:06.057844 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'pci_devices' on Instance uuid 13999eeb-6cae-4304-8b86-e80759b578c4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <uuid>13999eeb-6cae-4304-8b86-e80759b578c4</uuid>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <name>instance-00000049</name>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestStampPattern-server-1167358807</nova:name>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:24:06</nova:creationTime>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="hw_disk_bus">virtio</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="hw_machine_type">pc</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="hw_video_model">virtio</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="hw_vif_model">virtio</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:property name="img_owner_id">c311152ba8e648b29dec91d5696dfd79</nova:property>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:user uuid="74c3cd4fd76e48508b391718ae88e54d">tempest-TestStampPattern-1922334425-project-member</nova:user>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:project uuid="c311152ba8e648b29dec91d5696dfd79">tempest-TestStampPattern-1922334425</nova:project>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         <nova:port uuid="7b6b05d3-8866-4b54-bbd0-c30d37393f65">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <entry name="serial">13999eeb-6cae-4304-8b86-e80759b578c4</entry>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <entry name="uuid">13999eeb-6cae-4304-8b86-e80759b578c4</entry>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.config"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:86:26:57"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <target dev="tap7b6b05d3-88"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/console.log" append="off"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:24:06.560654 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Preparing to wait for external event network-vif-plugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1167358807',display_name='tempest-TestStampPattern-server-1167358807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-teststamppattern-server-1167358807',id=73,image_ref='72c10e2c-1973-43da-ae40-944a835f6307',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLsoUgmnM2mA1lL8DuFlpBo3CGzhpyt70TjsmVnBWgRrZ44G0RqQTbgYpLN8RnahmdFTG0Tn8yOEFOq9BrQ94jOFvuhPTIu7dQN+DrSwkuMpN/Zy71uJXz+llJIwtndQ==',key_name='tempest-TestStampPattern-128729590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c311152ba8e648b29dec91d5696dfd79',ramdisk_id='',reservation_id='r-o82cjbf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b5166ed7-2300-4f0f-a83e-f4e45e469dc8',image_min_disk='1',image_min_ram='0',image_owner_id='c311152ba8e648b29dec91d5696dfd79',image_owner_project_name='tempest-TestStampPattern-1922334425',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1922334425-project-member',image_user_id='74c3cd4fd76e48508b391718ae88e54d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1922334425',owner_user_name='tempest-TestStampPattern-1922334425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:24:03Z,user_data=None,user_id='74c3cd4fd76e48508b391718ae88e54d',uuid=13999eeb-6cae-4304-8b86-e80759b578c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converting VIF {"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:06.562794 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:24:06.563153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:06.563402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:06.563745 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:24:06.564345 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:06.564488 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05ca3536-be55-5e3e-bebb-9d759984d8be', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:06.565238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:06.566026 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:06.567704 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:06.567835 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b6b05d3-88, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:06.568164 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b6b05d3-88, col_values=(('qos', UUID('7c2169bc-6276-42fc-940d-49d9a124ee16')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:06.568340 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b6b05d3-88, col_values=(('external_ids', {'iface-id': '7b6b05d3-8866-4b54-bbd0-c30d37393f65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:26:57', 'vm-uuid': '13999eeb-6cae-4304-8b86-e80759b578c4'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:06.569011 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:06.571450 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:06.574419 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:06.575173 np0000003830 nova-compute[98984]: INFO os_vif [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88')
Jun 27 04:24:08.097458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:08.097886 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:08.097886 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No VIF found with MAC fa:16:3e:86:26:57, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:24:08.098238 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Using config drive
Jun 27 04:24:08.603668 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:08.723188 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Creating config drive at /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.config
Jun 27 04:24:08.726138 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcbx9apfk {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:08.780168 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcbx9apfk" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:09.192236 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.217224 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.220121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.300763 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.355106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.356310 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.361479 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-663cc2bf-deea-4fa3-8600-29538e4d632e req-0953a764-901e-43ef-8f95-4768b0a8ea49 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-plugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:09.361806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-663cc2bf-deea-4fa3-8600-29538e4d632e req-0953a764-901e-43ef-8f95-4768b0a8ea49 service nova] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:09.362348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-663cc2bf-deea-4fa3-8600-29538e4d632e req-0953a764-901e-43ef-8f95-4768b0a8ea49 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:09.362481 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-663cc2bf-deea-4fa3-8600-29538e4d632e req-0953a764-901e-43ef-8f95-4768b0a8ea49 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:09.362632 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-663cc2bf-deea-4fa3-8600-29538e4d632e req-0953a764-901e-43ef-8f95-4768b0a8ea49 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Processing event network-vif-plugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:24:09.845702 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:09.881000 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534249.8804836, 13999eeb-6cae-4304-8b86-e80759b578c4 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:09.882258 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:24:09.882405 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] VM Started (Lifecycle Event)
Jun 27 04:24:09.884309 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:24:09.886411 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Instance spawned successfully.
Jun 27 04:24:09.886659 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:24:09.890652 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:09.890937 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:09.976518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:09.976751 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:10.385674 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:10.387304 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:24:10.395993 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Took 6.72 seconds to spawn the instance on the hypervisor.
Jun 27 04:24:10.396191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:10.478541 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:24:10.889648 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:24:10.889943 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534250.8897336, 13999eeb-6cae-4304-8b86-e80759b578c4 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:10.890048 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] VM Paused (Lifecycle Event)
Jun 27 04:24:10.906329 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Took 12.05 seconds to build instance.
Jun 27 04:24:11.023486 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:11.023690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:11.026896 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:24:11.027011 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Claim successful on node np0000003830
Jun 27 04:24:11.155867 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00044763999994756887 future=<Future at 0x7ec53864a210 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:11.156356 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Emitting event <LifecycleEvent: 1782534236.1552184, 67f683c0-a514-400c-a7f9-7e3aacb161b5 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:11.156530 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:11.156694 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] VM Stopped (Lifecycle Event)
Jun 27 04:24:11.392453 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:11.394536 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534251.394266, 13999eeb-6cae-4304-8b86-e80759b578c4 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:11.394763 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] VM Resumed (Lifecycle Event)
Jun 27 04:24:11.407645 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-01cfd02a-d52c-445d-9441-2506ad80bd14 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.555s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:11.420992 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2be034d6-8020-4169-ae8b-707ca97b05e6 req-cd1c79e4-af1a-40f5-bcb9-91925183e4f6 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-plugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:11.422356 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2be034d6-8020-4169-ae8b-707ca97b05e6 req-cd1c79e4-af1a-40f5-bcb9-91925183e4f6 service nova] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:11.422786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2be034d6-8020-4169-ae8b-707ca97b05e6 req-cd1c79e4-af1a-40f5-bcb9-91925183e4f6 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:11.422908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2be034d6-8020-4169-ae8b-707ca97b05e6 req-cd1c79e4-af1a-40f5-bcb9-91925183e4f6 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:11.423034 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2be034d6-8020-4169-ae8b-707ca97b05e6 req-cd1c79e4-af1a-40f5-bcb9-91925183e4f6 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] No waiting events found dispatching network-vif-plugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:24:11.423174 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-2be034d6-8020-4169-ae8b-707ca97b05e6 req-cd1c79e4-af1a-40f5-bcb9-91925183e4f6 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received unexpected event network-vif-plugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 for instance with vm_state active and task_state None.
Jun 27 04:24:11.569888 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:11.659269 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 67f683c0-a514-400c-a7f9-7e3aacb161b5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:11.897137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:11.899041 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:24:12.341042 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:24:12.341236 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:24:12.553003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-changed-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:12.553361 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Refreshing instance network info cache due to event network-changed-7b6b05d3-8866-4b54-bbd0-c30d37393f65. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:24:12.553516 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] Acquiring lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:12.553654 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] Acquired lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:12.553816 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Refreshing network info cache for port 7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:24:12.843748 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:24:13.057586 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:13.349511 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.326s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:13.349822 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:24:13.389140 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:13.563270 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updated VIF entry in instance network info cache for port 7b6b05d3-8866-4b54-bbd0-c30d37393f65. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:24:13.564087 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updating instance_info_cache with network_info: [{"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:13.857964 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:24:13.857964 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:24:13.857964 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:13.857964 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:13.939534 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:24:14.067013 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-68779332-6602-49f3-a0d2-8f9b5c5f8208 req-577ef622-4a7b-41c8-a021-75651e9a1b7d service nova] Releasing lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:14.359686 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:24:14.402564 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Successfully created port: cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:24:14.847089 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:14.864001 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:24:14.939962 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Successfully updated port: cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:24:14.988132 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-changed-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:14.988296 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Refreshing instance network info cache due to event network-changed-cc6bc943-5749-4f56-903d-9d5c66d67c5d. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:24:14.988478 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] Acquiring lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:14.988630 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] Acquired lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:14.988779 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Refreshing network info cache for port cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:24:15.369863 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Booting with volume d9f6e1d4-3a31-458d-9f25-52978d296ff8 at /dev/vda
Jun 27 04:24:15.404095 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:15.416024 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:24:15.434672 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:15.453343 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:15.481077 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:24:15.481331 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:24:15.489673 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:24:15.490989 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce', 'fe80::fc16:3eff:fe85:677', 'fe80::c8a3:5aff:fec0:b214', 'fe80::fc16:3eff:fec4:882', 'fe80::fc16:3eff:fe86:2657'] 
Jun 27 04:24:15.491135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:24:15.491245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:24:15.492327 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:15.495219 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:15.495565 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Updating existing volume attachment record: ace744ff-0b43-4cc2-8dc8-4f63baa23193 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:24:15.567391 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:24:15.687248 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:16.189225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-fe8a20b0-f9c4-4481-b135-2d6b101892c7 req-f90ce48d-ce3a-4710-bbef-783ed982abbd service nova] Releasing lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:16.190001 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:16.190154 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:24:16.570583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:16.751647 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:24:16.891448 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:17.021862 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Updating instance_info_cache with network_info: [{"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:17.523701 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:17.524079 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Instance network_info: |[{"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:24:17.592706 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:24:17.593713 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:24:17.593927 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Creating image(s)
Jun 27 04:24:17.594185 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:24:17.594301 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Ensure instance console log exists: /opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:24:17.594524 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:17.594690 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:17.594807 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:17.595235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Start _get_guest_xml network_info=[{"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'ace744ff-0b43-4cc2-8dc8-4f63baa23193', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '153883e9-a3fc-4111-87b7-065b9807ed57', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'serial': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:24:17.599613 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:24:17.600592 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1923126758', uuid='153883e9-a3fc-4111-87b7-065b9807ed57'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534257.6002913) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:24:17.601680 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:24:17.601960 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:24:17.602954 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:24:17.603124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:24:17.603931 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:24:17.604196 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:24:17.604370 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:24:17.604465 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:24:17.604619 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:24:17.604738 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:24:17.604869 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:24:17.605060 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:24:17.605189 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:24:17.605321 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:24:17.605450 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:24:17.605609 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:24:17.615013 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:24:17.615322 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:17.615484 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:17.615832 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:17.616073 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:24:17.626488 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:17.627080 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:17.627533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:17.627965 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:17.628198 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:24:17.628423 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:24:17.639009 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:24:17.639009 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:17.643108 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:24:17.643108 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8] added
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:17.649738 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:17.650058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:24:17.650168 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:24:17.650267 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8] added
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:17.653124 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:17.653387 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:24:17.653387 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:24:17.653467 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:24:17.975513 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:17.975683 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:18.477345 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:24:18.651525 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:24:18.653944 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:24:18.664528 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:24:18.681856 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.687384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.688602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.695699 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.695699 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.695699 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.695699 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.695699 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:18.695980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.695980 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.695980 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.695980 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.695980 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:18.701337 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.701337 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.701337 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.701337 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.701337 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:18.701520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.701520 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.701520 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.701520 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.701520 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:18.737533 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260]
Jun 27 04:24:18.737533 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260] successful.
Jun 27 04:24:18.737533 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.740084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260]
Jun 27 04:24:18.740084 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260] successful.
Jun 27 04:24:18.740084 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.759823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.772255 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:24:18.773437 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('7', '-', '-', 0) found on session 200 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:24:18.773701 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:24:18.775208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:18.786749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 200 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:24:18.786749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.792147 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:18.792968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:24:18.793348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('8', '-', '-', 0) found on session 201 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:24:18.793348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:24:18.806476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 201 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:24:18.806476 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:24:19.024189 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:19.024392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:19.027550 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:24:19.027692 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Claim successful on node np0000003830
Jun 27 04:24:19.628177 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:24:19.863619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:20.305102 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:24:20.305284 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:24:20.646394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 33000000089b386f0 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:24:20.646655 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:20.646817 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '33000000089b386f0', 'path': '/dev/dm-0', 'multipath_id': '33000000089b386f0'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:20.646989 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089b386f0', 'path': '/dev/dm-0', 'multipath_id': '33000000089b386f0'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:24:20.808141 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:24:21.152039 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1923126758',display_name='tempest-TestVolumeBootPattern-server-1923126758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1923126758',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-yg6kwz9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:24:15Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=153883e9-a3fc-4111-87b7-065b9807ed57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:24:21.152570 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:21.152761 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:21.153278 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 153883e9-a3fc-4111-87b7-065b9807ed57 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:24:21.314180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.290s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:21.314437 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:24:21.571923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <uuid>153883e9-a3fc-4111-87b7-065b9807ed57</uuid>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <name>instance-0000004a</name>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-1923126758</nova:name>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:24:17</nova:creationTime>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         <nova:port uuid="cc6bc943-5749-4f56-903d-9d5c66d67c5d">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <entry name="serial">153883e9-a3fc-4111-87b7-065b9807ed57</entry>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <entry name="uuid">153883e9-a3fc-4111-87b7-065b9807ed57</entry>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57/disk.config"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <alias name="ua-d9f6e1d4-3a31-458d-9f25-52978d296ff8"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <serial>d9f6e1d4-3a31-458d-9f25-52978d296ff8</serial>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:e4:8b:a0"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <target dev="tapcc6bc943-57"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57/console.log" append="off"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:24:21.656184 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Preparing to wait for external event network-vif-plugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1923126758',display_name='tempest-TestVolumeBootPattern-server-1923126758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1923126758',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-yg6kwz9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:24:15Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=153883e9-a3fc-4111-87b7-065b9807ed57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.659412 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:21.660235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:24:21.660235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.660345 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c203256-621a-59d2-a1d8-9339f068b181', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:21.661062 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.661929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:21.662136 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.663962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.664100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc6bc943-57, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:21.664367 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc6bc943-57, col_values=(('qos', UUID('a577c05f-8c11-4234-be91-7e2aa74cda6f')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:21.664508 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc6bc943-57, col_values=(('external_ids', {'iface-id': 'cc6bc943-5749-4f56-903d-9d5c66d67c5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:8b:a0', 'vm-uuid': '153883e9-a3fc-4111-87b7-065b9807ed57'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:21.665320 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.666423 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:21.671092 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:21.672025 np0000003830 nova-compute[98984]: INFO os_vif [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57')
Jun 27 04:24:21.819013 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:24:21.819575 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:24:21.819830 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:21.820022 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:21.891144 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '167cf43243714b078a04b4c192717bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2c06b4d16f4ddc96d9a367ad400f1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:24:22.322268 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:24:22.355065 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Successfully created port: bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:24:22.826512 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Successfully updated port: bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:24:22.827596 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:24:22.867274 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-changed-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:22.867474 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Refreshing instance network info cache due to event network-changed-bfe58d64-ed38-4e04-a55f-b9c1b24db552. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:24:22.867696 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] Acquiring lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:22.867827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] Acquired lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:22.868713 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Refreshing network info cache for port bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:24:23.187520 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:23.187676 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:23.187788 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:e4:8b:a0, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:24:23.188121 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Using config drive
Jun 27 04:24:23.330890 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:23.334584 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Booting with volume 73a40cfa-a13e-48a8-b72e-6ee41270458d at /dev/vda
Jun 27 04:24:23.371165 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:23.374260 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:23.388279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:24:23.411404 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:23.440574 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:24:23.456277 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:24:23.456519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:24:23.465864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:24:23.466986 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce', 'fe80::fc16:3eff:fe85:677', 'fe80::c8a3:5aff:fec0:b214', 'fe80::fc16:3eff:fec4:882', 'fe80::fc16:3eff:fe86:2657'] 
Jun 27 04:24:23.467107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:24:23.467212 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:24:23.467456 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:23.467694 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Updating existing volume attachment record: 67008ff9-0c1d-43f2-a810-638164b5be0f {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:24:23.580961 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:23.693520 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:23.795438 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Creating config drive at /opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57/disk.config
Jun 27 04:24:23.798228 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbe7hnqyg {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:23.853248 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbe7hnqyg" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:24.084095 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-0330be63-21c8-4601-bb7c-245df211d84a req-a621cc77-59d8-4d20-8052-e9918d32cb60 service nova] Releasing lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:24.084723 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquired lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:24.084904 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:24:24.254469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.280312 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.283414 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.365929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.474559 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-244de024-8e56-4e25-b964-5c2ec653bca4 req-0d9f9b32-83fc-40a6-aadc-534f22b2d579 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-plugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:24.475529 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-244de024-8e56-4e25-b964-5c2ec653bca4 req-0d9f9b32-83fc-40a6-aadc-534f22b2d579 service nova] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:24.476460 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-244de024-8e56-4e25-b964-5c2ec653bca4 req-0d9f9b32-83fc-40a6-aadc-534f22b2d579 service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:24.476721 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-244de024-8e56-4e25-b964-5c2ec653bca4 req-0d9f9b32-83fc-40a6-aadc-534f22b2d579 service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:24.476855 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-244de024-8e56-4e25-b964-5c2ec653bca4 req-0d9f9b32-83fc-40a6-aadc-534f22b2d579 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Processing event network-vif-plugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:24:24.599675 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.603749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.623832 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.656876 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:24:24.803746 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:24.864560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:24.921380 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Updating instance_info_cache with network_info: [{"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:25.063962 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534265.063589, 153883e9-a3fc-4111-87b7-065b9807ed57 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:25.064147 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] VM Started (Lifecycle Event)
Jun 27 04:24:25.065693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:24:25.068642 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:24:25.071194 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Instance spawned successfully.
Jun 27 04:24:25.071512 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:24:25.423261 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Releasing lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:25.423715 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Instance network_info: |[{"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:24:25.566956 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:25.569466 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:24:25.577514 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:25.577706 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:25.577954 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:25.578135 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:25.578334 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:25.578560 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:25.635013 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:24:25.637907 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:24:25.638255 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Creating image(s)
Jun 27 04:24:25.639285 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:24:25.639285 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Ensure instance console log exists: /opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:24:25.639285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:25.639285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:25.639707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:25.639974 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Start _get_guest_xml network_info=[{"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '67008ff9-0c1d-43f2-a810-638164b5be0f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e000fc15-bce1-41d9-9ea9-6f62ed938d52', 'attached_at': '', 'detached_at': '', 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'serial': '73a40cfa-a13e-48a8-b72e-6ee41270458d'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:24:25.643925 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:24:25.645613 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1173750903', uuid='e000fc15-bce1-41d9-9ea9-6f62ed938d52'), owner=OwnerMeta(userid='167cf43243714b078a04b4c192717bd3', username='tempest-TestVolumeBootPatternV346-1310252554-project-member', projectid='1b2c06b4d16f4ddc96d9a367ad400f1d', projectname='tempest-TestVolumeBootPatternV346-1310252554'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534265.6452248) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:24:25.646917 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:24:25.647233 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:24:25.648272 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:24:25.648458 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:24:25.649324 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:24:25.649634 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:24:25.649794 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:24:25.649916 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:24:25.650062 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:24:25.650378 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:24:25.650527 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:24:25.650708 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:24:25.650842 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:24:25.650962 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:24:25.651090 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:24:25.651240 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:24:25.661361 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:24:25.661767 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:25.661944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:25.662340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:25.662632 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:24:25.675299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:25.675949 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:25.676467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:25.676759 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:24:25.677263 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:25.677532 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:24:25.690037 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:24:25.690037 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:25.696579 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:24:25.696579 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d] added
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:25.703600 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:25.703794 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:24:25.703953 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:24:25.704096 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d] added
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:25.707955 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:25.708196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:24:25.708284 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:24:25.708405 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:24:26.071789 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:24:26.072222 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534266.071986, 153883e9-a3fc-4111-87b7-065b9807ed57 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:26.072349 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] VM Paused (Lifecycle Event)
Jun 27 04:24:26.082901 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Took 8.49 seconds to spawn the instance on the hypervisor.
Jun 27 04:24:26.083115 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:26.523785 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e7b8c868-6a11-4491-912c-e0ed2360ec65 req-b358e75f-9c98-40d6-9a16-cee156e9eaae service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-plugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:26.524109 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e7b8c868-6a11-4491-912c-e0ed2360ec65 req-b358e75f-9c98-40d6-9a16-cee156e9eaae service nova] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:26.524204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e7b8c868-6a11-4491-912c-e0ed2360ec65 req-b358e75f-9c98-40d6-9a16-cee156e9eaae service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:26.524311 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-e7b8c868-6a11-4491-912c-e0ed2360ec65 req-b358e75f-9c98-40d6-9a16-cee156e9eaae service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:26.524425 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-e7b8c868-6a11-4491-912c-e0ed2360ec65 req-b358e75f-9c98-40d6-9a16-cee156e9eaae service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] No waiting events found dispatching network-vif-plugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:24:26.524578 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-e7b8c868-6a11-4491-912c-e0ed2360ec65 req-b358e75f-9c98-40d6-9a16-cee156e9eaae service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received unexpected event network-vif-plugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d for instance with vm_state active and task_state None.
Jun 27 04:24:26.574935 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:26.577206 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534266.5769706, 153883e9-a3fc-4111-87b7-065b9807ed57 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:26.577326 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] VM Resumed (Lifecycle Event)
Jun 27 04:24:26.590774 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Took 15.61 seconds to build instance.
Jun 27 04:24:26.665752 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:26.704519 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:24:26.708953 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:24:26.716529 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:24:26.721769 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.727712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.733647 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.741983 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.742196 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.750908 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.751107 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:26.778338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.50.100,3260]
Jun 27 04:24:26.778338 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.50.100,3260] successful.
Jun 27 04:24:26.778338 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.788577 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.793078 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.40.100,3260]
Jun 27 04:24:26.793078 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.40.100,3260] successful.
Jun 27 04:24:26.793078 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.803735 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:26.804338 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.804600 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:26.804928 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:26.805067 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:24:26.806285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] HCTL ('12', '-', '-', 0) found on session 202 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:24:26.806410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:24:26.821839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 202 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:24:26.822450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:24:26.822960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] HCTL ('14', '-', '-', 0) found on session 203 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:24:26.823063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:24:26.837539 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Searching for a device in session 203 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:24:26.837628 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:24:27.079403 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:27.081213 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:24:27.092051 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.115s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:27.678248 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:24:28.407226 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-changed-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:28.407537 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Refreshing instance network info cache due to event network-changed-cc6bc943-5749-4f56-903d-9d5c66d67c5d. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:24:28.407909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] Acquiring lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:28.408147 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] Acquired lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:28.408322 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Refreshing network info cache for port cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:24:28.693838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Found WWN 33000000026b2e17d for multipath device dm-4 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:24:28.694248 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:28.694248 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000026b2e17d', 'path': '/dev/dm-4', 'multipath_id': '33000000026b2e17d'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:28.694374 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000026b2e17d', 'path': '/dev/dm-4', 'multipath_id': '33000000026b2e17d'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:24:28.912525 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:29.199559 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1173750903',display_name='tempest-TestVolumeBootPatternV346-server-1173750903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-1173750903',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1Wz3AxKxLtsOokG2En1P0jcNeHAcFEj16xKr6r637/PtB1GLmPn7dXI4NKgSJs72pqRw3TopCyWDEXF0cRXi7hPsXJTwPBCWv3sFnEsxw7GH+lfWHNlu275jdWuhZJug==',key_name='tempest-keypair-185708344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-de0iwr91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=e000fc15-bce1-41d9-9ea9-6f62ed938d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:24:29.199798 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:29.203577 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:29.203577 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lazy-loading 'pci_devices' on Instance uuid e000fc15-bce1-41d9-9ea9-6f62ed938d52 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:24:29.230511 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:29.345328 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Updated VIF entry in instance network info cache for port cc6bc943-5749-4f56-903d-9d5c66d67c5d. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:24:29.345328 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Updating instance_info_cache with network_info: [{"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <uuid>e000fc15-bce1-41d9-9ea9-6f62ed938d52</uuid>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <name>instance-0000004b</name>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1173750903</nova:name>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:24:25</nova:creationTime>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:user uuid="167cf43243714b078a04b4c192717bd3">tempest-TestVolumeBootPatternV346-1310252554-project-member</nova:user>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:project uuid="1b2c06b4d16f4ddc96d9a367ad400f1d">tempest-TestVolumeBootPatternV346-1310252554</nova:project>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         <nova:port uuid="bfe58d64-ed38-4e04-a55f-b9c1b24db552">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <entry name="serial">e000fc15-bce1-41d9-9ea9-6f62ed938d52</entry>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <entry name="uuid">e000fc15-bce1-41d9-9ea9-6f62ed938d52</entry>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52/disk.config"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <alias name="ua-73a40cfa-a13e-48a8-b72e-6ee41270458d"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-4"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <serial>73a40cfa-a13e-48a8-b72e-6ee41270458d</serial>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:c6:8f:71"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <target dev="tapbfe58d64-ed"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52/console.log" append="off"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:24:29.705711 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Preparing to wait for external event network-vif-plugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1173750903',display_name='tempest-TestVolumeBootPatternV346-server-1173750903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-1173750903',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1Wz3AxKxLtsOokG2En1P0jcNeHAcFEj16xKr6r637/PtB1GLmPn7dXI4NKgSJs72pqRw3TopCyWDEXF0cRXi7hPsXJTwPBCWv3sFnEsxw7GH+lfWHNlu275jdWuhZJug==',key_name='tempest-keypair-185708344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-de0iwr91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=e000fc15-bce1-41d9-9ea9-6f62ed938d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:24:29.709142 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.709606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:29.709606 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:24:29.710134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.710282 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcbc8ec1-d15b-55b8-9db1-cf05bf2b20c9', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:29.711027 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.711638 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:29.712803 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.715145 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.715277 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe58d64-ed, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:29.715588 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfe58d64-ed, col_values=(('qos', UUID('019790b5-dfab-471d-baf6-436fe81dd288')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:29.715733 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfe58d64-ed, col_values=(('external_ids', {'iface-id': 'bfe58d64-ed38-4e04-a55f-b9c1b24db552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:8f:71', 'vm-uuid': 'e000fc15-bce1-41d9-9ea9-6f62ed938d52'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:29.716348 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.717360 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:29.722513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:29.723962 np0000003830 nova-compute[98984]: INFO os_vif [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed')
Jun 27 04:24:29.846565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c3cc7b1d-0698-4fc6-a769-3f985354d6e4 req-b0bf028c-2128-471b-8d99-9925e9620653 service nova] Releasing lock "refresh_cache-153883e9-a3fc-4111-87b7-065b9807ed57" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:29.865197 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:31.239475 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:31.239999 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:31.239999 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] No VIF found with MAC fa:16:3e:c6:8f:71, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:24:31.239999 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Using config drive
Jun 27 04:24:31.745098 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:31.852205 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Creating config drive at /opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52/disk.config
Jun 27 04:24:31.856285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplzoo60uv {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:31.910827 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplzoo60uv" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:32.296405 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:32.301121 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:32.321659 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:32.442240 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:32.476739 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4e6b557e-92d5-458d-a3c1-5d161821dbaf req-75b2952c-33b4-4514-89b9-3227f8da95e8 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-plugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:32.476739 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4e6b557e-92d5-458d-a3c1-5d161821dbaf req-75b2952c-33b4-4514-89b9-3227f8da95e8 service nova] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:32.476909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4e6b557e-92d5-458d-a3c1-5d161821dbaf req-75b2952c-33b4-4514-89b9-3227f8da95e8 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:32.477395 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4e6b557e-92d5-458d-a3c1-5d161821dbaf req-75b2952c-33b4-4514-89b9-3227f8da95e8 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:32.477395 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4e6b557e-92d5-458d-a3c1-5d161821dbaf req-75b2952c-33b4-4514-89b9-3227f8da95e8 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Processing event network-vif-plugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:24:32.479015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:33.033895 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534273.0334918, e000fc15-bce1-41d9-9ea9-6f62ed938d52 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:33.034303 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:24:33.034459 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] VM Started (Lifecycle Event)
Jun 27 04:24:33.039970 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:24:33.043153 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Instance spawned successfully.
Jun 27 04:24:33.043637 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:24:33.540110 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:33.542167 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:24:33.549047 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:33.549139 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:33.549394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:33.549604 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:33.549879 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:33.550127 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:24:33.832107 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:33.832707 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:24:34.044751 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:24:34.045098 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534274.0448458, e000fc15-bce1-41d9-9ea9-6f62ed938d52 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:34.045297 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] VM Paused (Lifecycle Event)
Jun 27 04:24:34.054843 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Took 8.42 seconds to spawn the instance on the hypervisor.
Jun 27 04:24:34.055011 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:34.534762 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa280d30-1cdb-41c1-bc17-94f88da02b6a req-ef7f94e9-e2a0-414f-8547-e6875cb35ff6 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-plugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:34.534762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa280d30-1cdb-41c1-bc17-94f88da02b6a req-ef7f94e9-e2a0-414f-8547-e6875cb35ff6 service nova] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:34.534762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa280d30-1cdb-41c1-bc17-94f88da02b6a req-ef7f94e9-e2a0-414f-8547-e6875cb35ff6 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:34.534762 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-aa280d30-1cdb-41c1-bc17-94f88da02b6a req-ef7f94e9-e2a0-414f-8547-e6875cb35ff6 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:34.534762 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-aa280d30-1cdb-41c1-bc17-94f88da02b6a req-ef7f94e9-e2a0-414f-8547-e6875cb35ff6 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] No waiting events found dispatching network-vif-plugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:24:34.534762 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-aa280d30-1cdb-41c1-bc17-94f88da02b6a req-ef7f94e9-e2a0-414f-8547-e6875cb35ff6 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received unexpected event network-vif-plugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 for instance with vm_state active and task_state None.
Jun 27 04:24:34.548574 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:34.550765 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534274.5505483, e000fc15-bce1-41d9-9ea9-6f62ed938d52 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:24:34.550882 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] VM Resumed (Lifecycle Event)
Jun 27 04:24:34.566080 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Took 15.58 seconds to build instance.
Jun 27 04:24:34.728775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:34.866481 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:35.053091 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:24:35.055137 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:24:35.067302 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-f6069737-6be7-4bed-8e2f-a6a4786bf3e1 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.091s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:35.830930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-changed-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:35.831369 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Refreshing instance network info cache due to event network-changed-bfe58d64-ed38-4e04-a55f-b9c1b24db552. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:24:35.831531 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] Acquiring lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:24:35.831636 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] Acquired lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:24:35.831756 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Refreshing network info cache for port bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:24:36.336949 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:36.662912 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:36.791819 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Updated VIF entry in instance network info cache for port bfe58d64-ed38-4e04-a55f-b9c1b24db552. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:24:36.792112 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Updating instance_info_cache with network_info: [{"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:37.294786 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6cd82dfb-0ad1-474c-84c1-526c7d70fee3 req-05f73569-dfd4-4664-a0c4-c1101391648d service nova] Releasing lock "refresh_cache-e000fc15-bce1-41d9-9ea9-6f62ed938d52" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:24:37.830345 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:37.830702 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:38.335270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:38.335865 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:38.335865 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:38.335865 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:24:39.363344 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:24:39.365099 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:24:39.366461 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:39.454396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:39.455069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:39.539745 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:39.544720 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:24:39.546338 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:39.638359 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:39.638923 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:39.726074 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:39.730878 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:24:39.731216 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:39.733566 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:24:39.734644 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:39.781817 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:24:39.782317 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50007MB free_disk=71.76292037963867GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:24:39.782565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:39.782852 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:39.875424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:40.841396 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d0722c2-911a-4f04-ba22-55af13b84ea5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:24:40.841898 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:24:40.841898 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:24:40.841898 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 13999eeb-6cae-4304-8b86-e80759b578c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:24:40.842094 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 153883e9-a3fc-4111-87b7-065b9807ed57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:24:40.842195 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance e000fc15-bce1-41d9-9ea9-6f62ed938d52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:24:40.842364 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 6 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:24:40.842518 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1664MB phys_disk=95GB used_disk=2GB total_vcpus=16 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:24:39 up 47 min,  2 users,  load average: 2.94, 4.95, 5.45\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '6', 'num_proj_1b2c06b4d16f4ddc96d9a367ad400f1d': '3', 'io_workload': '0', 'num_proj_c311152ba8e648b29dec91d5696dfd79': '2', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:24:41.137014 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:24:41.137343 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:24:41.639866 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:24:42.146463 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:24:42.146968 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.364s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:42.147134 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:24:44.733127 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:44.875660 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:47.146725 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:47.147188 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:47.147188 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:47.147433 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:47.147630 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:24:47.147776 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:24:47.147996 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.68 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:24:49.025942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:49.025942 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:49.528147 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'flavor' on Instance uuid 13999eeb-6cae-4304-8b86-e80759b578c4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:24:49.745369 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:49.877280 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:50.533416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:51.594535 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:51.594961 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:51.594961 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Attaching volume 9b29464c-69cf-46c6-b9df-cc682bcf9e83 to /dev/vdb
Jun 27 04:24:51.629475 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:51.640939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:24:51.660318 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:24:51.704744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:24:51.705031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:24:51.713034 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:24:51.714208 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce', 'fe80::fc16:3eff:fe85:677', 'fe80::c8a3:5aff:fec0:b214', 'fe80::fc16:3eff:fec4:882', 'fe80::fc16:3eff:fe86:2657', 'fe80::fc16:3eff:fee4:8ba0', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fec6:8f71'] 
Jun 27 04:24:51.714363 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:24:51.714433 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:24:51.714670 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:51.714923 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updating existing volume attachment record: 66492911-ba0d-435d-8db0-affc5796f78b {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:24:52.264085 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:24:52.264390 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:52.264571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:52.264930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:52.265135 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:24:52.277216 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:52.278653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:52.278653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:52.278653 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:24:52.279222 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:52.279619 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:24:52.290895 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:24:52.290895 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:52.296808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:24:52.296808 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83] added
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:52.302806 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:52.303088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:24:52.303088 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:24:52.303288 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83] added
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:24:52.307415 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:52.307841 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:24:52.307841 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:24:52.308041 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:24:53.303714 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:24:53.308433 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:24:53.316996 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:24:53.324489 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.333396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.338262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.350334 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.350709 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.356172 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.356460 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:53.394881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.40.100,3260]
Jun 27 04:24:53.394881 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.40.100,3260] successful.
Jun 27 04:24:53.394881 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.404634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.50.100,3260]
Jun 27 04:24:53.404634 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.50.100,3260] successful.
Jun 27 04:24:53.404634 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.409982 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.417713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.427272 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.427772 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:53.428134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:53.428134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:24:53.429105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] HCTL ('15', '-', '-', 0) found on session 204 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:24:53.429270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.437431 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:53.437972 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:53.438416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:24:53.439206 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] HCTL ('16', '-', '-', 0) found on session 205 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:24:53.439301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:24:53.448822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching for a device in session 204 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:24:53.449371 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:24:53.455567 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Searching for a device in session 205 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:24:53.455731 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:24:54.279103 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:24:54.746745 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:54.878651 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:55.294208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Found WWN 330000000e6920798 for multipath device dm-12 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:24:55.294487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:55.294674 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000e6920798', 'path': '/dev/dm-12', 'multipath_id': '330000000e6920798'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:55.294796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e6920798', 'path': '/dev/dm-12', 'multipath_id': '330000000e6920798'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:24:55.297912 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'flavor' on Instance uuid 13999eeb-6cae-4304-8b86-e80759b578c4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:24:55.801634 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Attempting to attach volume 9b29464c-69cf-46c6-b9df-cc682bcf9e83 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]:   <alias name="ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83"/>
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-12"/>
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]:   <serial>9b29464c-69cf-46c6-b9df-cc682bcf9e83</serial>
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:24:55.803072 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:24:56.399587 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:56.399760 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:56.399908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:56.400032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:56.400139 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:56.402297 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Terminating instance
Jun 27 04:24:56.905067 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:24:56.921711 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:56.924095 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:56.945085 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:56.958947 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:56.974781 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.113734 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-74998b82-525e-4247-ab49-25c3df943921 req-f6a68753-32d7-4fc7-9b2f-fa22d064d5cf service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-unplugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:57.114280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-74998b82-525e-4247-ab49-25c3df943921 req-f6a68753-32d7-4fc7-9b2f-fa22d064d5cf service nova] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:57.114443 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-74998b82-525e-4247-ab49-25c3df943921 req-f6a68753-32d7-4fc7-9b2f-fa22d064d5cf service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:57.114590 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-74998b82-525e-4247-ab49-25c3df943921 req-f6a68753-32d7-4fc7-9b2f-fa22d064d5cf service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:57.114698 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-74998b82-525e-4247-ab49-25c3df943921 req-f6a68753-32d7-4fc7-9b2f-fa22d064d5cf service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] No waiting events found dispatching network-vif-unplugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:24:57.114803 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-74998b82-525e-4247-ab49-25c3df943921 req-f6a68753-32d7-4fc7-9b2f-fa22d064d5cf service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-unplugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:24:57.223060 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999683483999888 future=<Future at 0x7ec5181dc740 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:57.223455 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999219817999801 future=<Future at 0x7ec5181dc740 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:57.223666 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99895507500014 future=<Future at 0x7ec5181dc740 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:24:57.225291 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Instance destroyed successfully.
Jun 27 04:24:57.225885 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 153883e9-a3fc-4111-87b7-065b9807ed57 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:24:57.480830 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:57.480982 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:57.481058 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:24:57.481206 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] No VIF found with MAC fa:16:3e:86:26:57, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:24:57.728549 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:24:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1923126758',display_name='tempest-TestVolumeBootPattern-server-1923126758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1923126758',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:24:26Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-yg6kwz9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:24:26Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=153883e9-a3fc-4111-87b7-065b9807ed57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:24:57.728822 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "address": "fa:16:3e:e4:8b:a0", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc6bc943-57", "ovs_interfaceid": "cc6bc943-5749-4f56-903d-9d5c66d67c5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:24:57.729512 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:24:57.729768 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:24:57.731152 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.731378 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc6bc943-57, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:57.732408 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.733263 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:57.733670 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.734583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.734770 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a577c05f-8c11-4234-be91-7e2aa74cda6f) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:24:57.735273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.735812 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:24:57.736202 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:57.738453 np0000003830 nova-compute[98984]: INFO os_vif [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:8b:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc6bc943-5749-4f56-903d-9d5c66d67c5d,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc6bc943-57')
Jun 27 04:24:57.740351 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:24:57.740734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:24:57.740921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:24:57.741317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:24:57.741741 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:24:57.742121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:57.769118 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [200] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', '205')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:24:57.769592 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '201')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:24:57.770593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '200')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:24:57.771380 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518777600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:24:57.771588 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:24:57.771783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 33000000089b386f0 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:24:57.825996 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:24:57.875018 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:24:57.914818 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:24:57.915178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:24:57.916061 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:24:57.927341 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:24:57.927633 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:24:57.938492 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:57.974417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260]
Jun 27 04:24:57.974417 np0000003830 nova-compute[98984]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260] successful.
Jun 27 04:24:57.974417 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:57.992760 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:58.003713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:58.038430 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260]
Jun 27 04:24:58.038430 np0000003830 nova-compute[98984]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260] successful.
Jun 27 04:24:58.038430 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:58.054815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:24:58.055036 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:24:58.055148 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (314ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:24:58.055259 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:24:58.055603 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Deleting instance files /opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57_del
Jun 27 04:24:58.056107 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Deletion of /opt/stack/data/nova/instances/153883e9-a3fc-4111-87b7-065b9807ed57_del complete
Jun 27 04:24:58.562078 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Took 1.66 seconds to destroy the instance on the hypervisor.
Jun 27 04:24:58.562634 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:24:58.562944 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:24:58.563056 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:24:58.563303 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:58.615998 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:24:59.022992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-664aef07-349c-4cc3-8fa9-58b5ebfe9e36 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.428s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:59.163329 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-unplugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:59.163478 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] Acquiring lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:24:59.163640 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:24:59.163773 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] Lock "153883e9-a3fc-4111-87b7-065b9807ed57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:24:59.163870 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] No waiting events found dispatching network-vif-unplugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:24:59.164168 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-unplugged-cc6bc943-5749-4f56-903d-9d5c66d67c5d for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:24:59.164422 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Received event network-vif-deleted-cc6bc943-5749-4f56-903d-9d5c66d67c5d {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:24:59.164560 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Neutron deleted interface cc6bc943-5749-4f56-903d-9d5c66d67c5d; detaching it from the instance and deleting it from the info cache
Jun 27 04:24:59.166204 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7662a6e7-8998-423f-8e0d-0478b00de485 req-39f39917-8797-4d85-a1a2-a64a9b37a8a6 service nova] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Detach interface failed, port_id=cc6bc943-5749-4f56-903d-9d5c66d67c5d, reason: Instance 153883e9-a3fc-4111-87b7-065b9807ed57 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:24:59.463507 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:24:59.880621 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:24:59.965377 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Took 1.40 seconds to deallocate network for instance.
Jun 27 04:25:00.510780 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Took 0.54 seconds to detach 1 volumes for instance.
Jun 27 04:25:01.015565 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:01.015749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:01.317280 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:01.317534 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:01.820079 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:01.915879 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:01.916062 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:02.326936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.311s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:02.370757 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 153883e9-a3fc-4111-87b7-065b9807ed57
Jun 27 04:25:02.418350 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Detaching volume 9b29464c-69cf-46c6-b9df-cc682bcf9e83
Jun 27 04:25:02.453787 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Attempting to driver detach volume 9b29464c-69cf-46c6-b9df-cc682bcf9e83 from mountpoint /dev/vdb
Jun 27 04:25:02.458570 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Found disk vdb by alias ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:25:02.459846 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Found disk vdb by alias ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:25:02.460011 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Attempting to detach device vdb from instance 13999eeb-6cae-4304-8b86-e80759b578c4 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:   <alias name="ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83"/>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-12"/>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:   <serial>9b29464c-69cf-46c6-b9df-cc682bcf9e83</serial>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:25:02.460323 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:25:02.467011 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully detached device vdb from instance 13999eeb-6cae-4304-8b86-e80759b578c4 from the persistent domain config.
Jun 27 04:25:02.467088 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] (1/8): Attempting to detach device vdb with device alias ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83 from instance 13999eeb-6cae-4304-8b86-e80759b578c4 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:   <alias name="ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83"/>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-12"/>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:   <serial>9b29464c-69cf-46c6-b9df-cc682bcf9e83</serial>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:25:02.467426 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:25:02.736900 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:02.939746 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534302.939372, 13999eeb-6cae-4304-8b86-e80759b578c4 => ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:25:02.940941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9b29464c-69cf-46c6-b9df-cc682bcf9e83 for instance 13999eeb-6cae-4304-8b86-e80759b578c4 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:25:02.942904 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully detached device vdb from instance 13999eeb-6cae-4304-8b86-e80759b578c4 from the live domain config.
Jun 27 04:25:02.944238 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:25:02.944515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:25:02.944639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:02.944937 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:02.945207 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9b29464c-69cf-46c6-b9df-cc682bcf9e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:25:02.945323 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:25:02.970211 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83 (non-flash)
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', '205')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:25:02.970586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', '204')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:02.971360 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83', '205')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:02.972079 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538412ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'): ({'sdk'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:25:02.972246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Removing multipathed devices sdk, sdj {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:25:02.972448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Flush multipath device 330000000e6920798 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:25:03.006055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:03.052900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:03.103023 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:25:03.103181 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:25:03.104221 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:25:03.114877 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:25:03.115049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:25:03.125992 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:03.172881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.40.100,3260]
Jun 27 04:25:03.172881 np0000003830 nova-compute[98984]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.40.100,3260] successful.
Jun 27 04:25:03.172881 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:03.189131 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:03.200456 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:03.228419 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.50.100,3260]
Jun 27 04:25:03.228419 np0000003830 nova-compute[98984]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-9b29464c-69cf-46c6-b9df-cc682bcf9e83, portal: 192.168.50.100,3260] successful.
Jun 27 04:25:03.228419 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:03.243885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:03.244075 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:03.244181 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] <== disconnect_volume: return (299ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:25:03.244285 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:25:03.377852 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-4d734e0c-5584-472f-af2d-ad9d8c41cdca tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "153883e9-a3fc-4111-87b7-065b9807ed57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.978s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:03.790955 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'flavor' on Instance uuid 13999eeb-6cae-4304-8b86-e80759b578c4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:04.796113 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-39cb48c6-12c7-49fb-9640-e3816aa04995 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.880s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:04.882371 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:04.909311 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-changed-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:04.909713 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Refreshing instance network info cache due to event network-changed-7b6b05d3-8866-4b54-bbd0-c30d37393f65. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:25:04.909908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] Acquiring lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:25:04.911180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] Acquired lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:25:04.911356 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Refreshing network info cache for port 7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:25:05.219975 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:05.220124 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:05.414735 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:05.445520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:05.445520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:05.445681 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:05.445744 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:05.445836 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:05.447666 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Terminating instance
Jun 27 04:25:05.695202 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:05.721451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:25:05.810868 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updated VIF entry in instance network info cache for port 7b6b05d3-8866-4b54-bbd0-c30d37393f65. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:25:05.811234 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updating instance_info_cache with network_info: [{"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:05.950433 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:25:05.971862 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:05.974421 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:05.992123 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.111780 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.117150 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.141831 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3561c0aa-587f-4c94-a5ff-7bb660555400 req-dcdff229-34f3-48f4-a0f6-65ef8b14f348 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-unplugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:06.142279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3561c0aa-587f-4c94-a5ff-7bb660555400 req-dcdff229-34f3-48f4-a0f6-65ef8b14f348 service nova] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:06.142464 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3561c0aa-587f-4c94-a5ff-7bb660555400 req-dcdff229-34f3-48f4-a0f6-65ef8b14f348 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:06.142778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3561c0aa-587f-4c94-a5ff-7bb660555400 req-dcdff229-34f3-48f4-a0f6-65ef8b14f348 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:06.142952 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3561c0aa-587f-4c94-a5ff-7bb660555400 req-dcdff229-34f3-48f4-a0f6-65ef8b14f348 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] No waiting events found dispatching network-vif-unplugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:06.143102 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3561c0aa-587f-4c94-a5ff-7bb660555400 req-dcdff229-34f3-48f4-a0f6-65ef8b14f348 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-unplugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:06.219037 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.273592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:06.274079 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:06.275068 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99974796000015 future=<Future at 0x7ec518767f50 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:06.277372 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:25:06.277512 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Claim successful on node np0000003830
Jun 27 04:25:06.280101 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Instance destroyed successfully.
Jun 27 04:25:06.280468 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'resources' on Instance uuid 13999eeb-6cae-4304-8b86-e80759b578c4 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:06.312871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d93c82d5-d731-44f8-b4e8-969e865b5ebe req-65fc0812-47ca-43dc-b599-0123cebe0e5e service nova] Releasing lock "refresh_cache-13999eeb-6cae-4304-8b86-e80759b578c4" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:25:06.784457 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1167358807',display_name='tempest-TestStampPattern-server-1167358807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-teststamppattern-server-1167358807',id=73,image_ref='72c10e2c-1973-43da-ae40-944a835f6307',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLsoUgmnM2mA1lL8DuFlpBo3CGzhpyt70TjsmVnBWgRrZ44G0RqQTbgYpLN8RnahmdFTG0Tn8yOEFOq9BrQ94jOFvuhPTIu7dQN+DrSwkuMpN/Zy71uJXz+llJIwtndQ==',key_name='tempest-TestStampPattern-128729590',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:24:10Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c311152ba8e648b29dec91d5696dfd79',ramdisk_id='',reservation_id='r-o82cjbf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b5166ed7-2300-4f0f-a83e-f4e45e469dc8',image_min_disk='1',image_min_ram='0',image_owner_id='c311152ba8e648b29dec91d5696dfd79',image_owner_project_name='tempest-TestStampPattern-1922334425',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1922334425-project-member',image_user_id='74c3cd4fd76e48508b391718ae88e54d',owner_project_name='tempest-TestStampPattern-1922334425',owner_user_name='tempest-TestStampPattern-1922334425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:24:10Z,user_data=None,user_id='74c3cd4fd76e48508b391718ae88e54d',uuid=13999eeb-6cae-4304-8b86-e80759b578c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:25:06.784784 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converting VIF {"id": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "address": "fa:16:3e:86:26:57", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b6b05d3-88", "ovs_interfaceid": "7b6b05d3-8866-4b54-bbd0-c30d37393f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:06.785406 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:06.785696 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:25:06.786967 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.787238 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b6b05d3-88, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:06.788191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.788982 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:06.789330 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.790489 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.790668 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c2169bc-6276-42fc-940d-49d9a124ee16) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:06.791860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.792446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:06.792634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:06.794316 np0000003830 nova-compute[98984]: INFO os_vif [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:26:57,bridge_name='br-int',has_traffic_filtering=True,id=7b6b05d3-8866-4b54-bbd0-c30d37393f65,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b6b05d3-88')
Jun 27 04:25:06.794575 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Deleting instance files /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4_del
Jun 27 04:25:06.795173 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Deletion of /opt/stack/data/nova/instances/13999eeb-6cae-4304-8b86-e80759b578c4_del complete
Jun 27 04:25:07.301519 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Took 1.35 seconds to destroy the instance on the hypervisor.
Jun 27 04:25:07.302040 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:25:07.302276 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:25:07.302390 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:25:07.302651 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:07.396726 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:07.560909 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:07.561735 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:07.719159 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7746ffe6-52f0-4136-8e87-f3a4d9308700 req-00a8287a-ee28-4958-beda-25601f1ee7d1 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-deleted-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:07.719294 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-7746ffe6-52f0-4136-8e87-f3a4d9308700 req-00a8287a-ee28-4958-beda-25601f1ee7d1 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Neutron deleted interface 7b6b05d3-8866-4b54-bbd0-c30d37393f65; detaching it from the instance and deleting it from the info cache
Jun 27 04:25:07.720949 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7746ffe6-52f0-4136-8e87-f3a4d9308700 req-00a8287a-ee28-4958-beda-25601f1ee7d1 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Detach interface failed, port_id=7b6b05d3-8866-4b54-bbd0-c30d37393f65, reason: Instance 13999eeb-6cae-4304-8b86-e80759b578c4 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:25:08.064095 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:08.167367 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:08.200249 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d57e52b-763d-4765-a0bf-f67de93c5f2e req-ea5ca0e3-be5e-4356-a87a-28d4930ddb36 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-unplugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:08.200443 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1d57e52b-763d-4765-a0bf-f67de93c5f2e req-ea5ca0e3-be5e-4356-a87a-28d4930ddb36 service nova] Acquiring lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:08.200659 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1d57e52b-763d-4765-a0bf-f67de93c5f2e req-ea5ca0e3-be5e-4356-a87a-28d4930ddb36 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:08.200799 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1d57e52b-763d-4765-a0bf-f67de93c5f2e req-ea5ca0e3-be5e-4356-a87a-28d4930ddb36 service nova] Lock "13999eeb-6cae-4304-8b86-e80759b578c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:08.201179 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d57e52b-763d-4765-a0bf-f67de93c5f2e req-ea5ca0e3-be5e-4356-a87a-28d4930ddb36 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] No waiting events found dispatching network-vif-unplugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:08.201332 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1d57e52b-763d-4765-a0bf-f67de93c5f2e req-ea5ca0e3-be5e-4356-a87a-28d4930ddb36 service nova] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Received event network-vif-unplugged-7b6b05d3-8866-4b54-bbd0-c30d37393f65 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:08.572388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.298s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:08.573024 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:25:08.669162 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Took 1.37 seconds to deallocate network for instance.
Jun 27 04:25:09.079148 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:25:09.079433 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:25:09.079729 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:09.080042 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:09.146242 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:25:09.174108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:09.174244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:09.467012 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:09.467189 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:09.580020 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:25:09.589942 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Successfully created port: d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:25:09.883341 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:09.969662 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:10.050057 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Successfully updated port: d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:25:10.088135 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:25:10.251283 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-changed-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:10.251618 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Refreshing instance network info cache due to event network-changed-d074e270-6342-4038-a479-ef2007286b73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:25:10.251810 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] Acquiring lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:25:10.251960 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] Acquired lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:25:10.252098 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Refreshing network info cache for port d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:25:10.476196 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.302s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:10.529362 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Deleted allocations for instance 13999eeb-6cae-4304-8b86-e80759b578c4
Jun 27 04:25:10.551683 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:25:10.586658 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Booting with volume d9f6e1d4-3a31-458d-9f25-52978d296ff8 at /dev/vda
Jun 27 04:25:10.624734 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:25:10.634902 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:25:10.654746 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:25:10.697884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:25:10.698132 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:25:10.706265 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:25:10.707311 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe8b:ada', 'fe80::8c1b:92ff:fefe:a8ce', 'fe80::fc16:3eff:fe85:677', 'fe80::c8a3:5aff:fec0:b214', 'fe80::fc16:3eff:fec4:882', 'fe80::fc16:3eff:fec6:8f71'] 
Jun 27 04:25:10.707426 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:25:10.707544 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:25:10.707773 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:25:10.707988 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updating existing volume attachment record: 26f85c0f-b2b9-4c23-9175-733ebffb1684 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:25:10.754483 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:10.815178 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:25:10.939682 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:11.442027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c5480a38-fbdc-45d0-8210-5b793920fd13 req-caa0f24a-5ccc-4ac7-b6c0-ebf7ca62c3c8 service nova] Releasing lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:25:11.442427 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:25:11.442616 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:25:11.537374 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d1b4d156-b7d8-4574-85d8-1661349ffca0 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "13999eeb-6cae-4304-8b86-e80759b578c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.092s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:11.804328 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:12.000260 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:25:12.140899 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:12.223650 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003936180000891909 future=<Future at 0x7ec5181dc740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:12.223763 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Emitting event <LifecycleEvent: 1782534297.2225492, 153883e9-a3fc-4111-87b7-065b9807ed57 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:12.224028 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:12.224266 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] VM Stopped (Lifecycle Event)
Jun 27 04:25:12.224422 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.050389433999953 future=<Future at 0x7ec518767f50 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:12.225129 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.049667609000153 future=<Future at 0x7ec518767f50 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:12.261316 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updating instance_info_cache with network_info: [{"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:12.497394 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:12.497718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:12.497990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:12.498167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:12.498329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:12.500660 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Terminating instance
Jun 27 04:25:12.727171 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-291b3175-108a-4e90-a2db-5c08acec2611 tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: 153883e9-a3fc-4111-87b7-065b9807ed57] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:12.763146 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:25:12.763370 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Instance network_info: |[{"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:25:12.857946 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:25:12.858975 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:25:12.859190 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Creating image(s)
Jun 27 04:25:12.859437 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:25:12.859576 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Ensure instance console log exists: /opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:25:12.859815 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:12.859968 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:12.860080 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:12.860491 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Start _get_guest_xml network_info=[{"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '26f85c0f-b2b9-4c23-9175-733ebffb1684', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ee509af0-f4aa-4d61-a722-f76bd060bd50', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'serial': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:25:12.862887 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:25:12.863792 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1586654133', uuid='ee509af0-f4aa-4d61-a722-f76bd060bd50'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534312.8634865) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:25:12.864805 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:25:12.865089 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:25:12.865997 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:25:12.866163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:25:12.866958 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:25:12.867192 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:25:12.867326 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:25:12.867415 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:25:12.867562 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:25:12.867651 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:25:12.867757 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:25:12.867901 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:25:12.867992 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:25:12.868093 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:25:12.868188 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:25:12.868301 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:25:12.876624 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:25:12.876860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:25:12.877004 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:12.877262 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:12.877446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:25:12.888620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:12.889247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:12.889714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:12.889900 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:25:12.890353 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:12.890591 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:25:12.903522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:25:12.903522 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:12.913885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:25:12.913885 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8] added
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:25:12.918265 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:12.918487 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:25:12.918646 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:25:12.918797 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8] added
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:25:12.924086 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:12.924259 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:25:12.924474 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:25:12.924656 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:25:13.004096 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:25:13.026406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.028246 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.045182 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.173950 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.179958 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.207215 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b94dbb73-a70f-4684-a5fb-1329f70ed72a req-1c876afc-4d6a-42a0-9967-2b0e724d4962 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-unplugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:13.207794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b94dbb73-a70f-4684-a5fb-1329f70ed72a req-1c876afc-4d6a-42a0-9967-2b0e724d4962 service nova] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:13.207794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b94dbb73-a70f-4684-a5fb-1329f70ed72a req-1c876afc-4d6a-42a0-9967-2b0e724d4962 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:13.207794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-b94dbb73-a70f-4684-a5fb-1329f70ed72a req-1c876afc-4d6a-42a0-9967-2b0e724d4962 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:13.207794 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b94dbb73-a70f-4684-a5fb-1329f70ed72a req-1c876afc-4d6a-42a0-9967-2b0e724d4962 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] No waiting events found dispatching network-vif-unplugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:13.207973 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-b94dbb73-a70f-4684-a5fb-1329f70ed72a req-1c876afc-4d6a-42a0-9967-2b0e724d4962 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-unplugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:13.302424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.308637 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.327824 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999650913000096 future=<Future at 0x7ec538309ac0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:13.329220 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Instance destroyed successfully.
Jun 27 04:25:13.329848 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lazy-loading 'resources' on Instance uuid e000fc15-bce1-41d9-9ea9-6f62ed938d52 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:13.832007 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1173750903',display_name='tempest-TestVolumeBootPatternV346-server-1173750903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-1173750903',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1Wz3AxKxLtsOokG2En1P0jcNeHAcFEj16xKr6r637/PtB1GLmPn7dXI4NKgSJs72pqRw3TopCyWDEXF0cRXi7hPsXJTwPBCWv3sFnEsxw7GH+lfWHNlu275jdWuhZJug==',key_name='tempest-keypair-185708344',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:24:34Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-de0iwr91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=e000fc15-bce1-41d9-9ea9-6f62ed938d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:25:13.832207 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "address": "fa:16:3e:c6:8f:71", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe58d64-ed", "ovs_interfaceid": "bfe58d64-ed38-4e04-a55f-b9c1b24db552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:13.832856 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:13.833090 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:25:13.834376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.834695 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe58d64-ed, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:13.835622 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.836346 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:13.837056 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.837190 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=019790b5-dfab-471d-baf6-436fe81dd288) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:13.837589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.838151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:13.838248 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:13.840350 np0000003830 nova-compute[98984]: INFO os_vif [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:8f:71,bridge_name='br-int',has_traffic_filtering=True,id=bfe58d64-ed38-4e04-a55f-b9c1b24db552,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe58d64-ed')
Jun 27 04:25:13.842048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:25:13.842335 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:25:13.842470 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:13.919248 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:25:13.925073 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:25:13.931897 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:25:13.937436 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:13.943830 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:13.950261 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.958096 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.958515 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.964166 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:13.964473 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:13.995658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260]
Jun 27 04:25:13.995658 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260] successful.
Jun 27 04:25:13.995658 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:14.000375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260]
Jun 27 04:25:14.000375 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260] successful.
Jun 27 04:25:14.000375 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:14.006705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:14.012125 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.021960 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:14.022270 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:14.022534 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:25:14.023250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('7', '-', '-', 0) found on session 206 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:25:14.023402 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.027909 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:14.028227 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:14.028431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:14.028506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:25:14.029611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('8', '-', '-', 0) found on session 207 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:25:14.029770 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:25:14.035420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 206 and hctl ['7', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:25:14.045593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 207 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:25:14.816539 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-changed-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:14.816699 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Refreshing instance network info cache due to event network-changed-6dcddf71-b267-4169-9118-d46552dd9af3. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:25:14.816892 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] Acquiring lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:25:14.817029 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] Acquired lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:25:14.817190 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Refreshing network info cache for port 6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:25:14.884246 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:15.036122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 206 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:25:15.036449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:25:15.043650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 207 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:25:15.043799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:25:15.258450 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7b5e8361-1845-4ba4-83eb-93f5ec95ca15 req-2e2ef9e6-f937-4871-86c7-ff5b774bc4d6 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-unplugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:15.258666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7b5e8361-1845-4ba4-83eb-93f5ec95ca15 req-2e2ef9e6-f937-4871-86c7-ff5b774bc4d6 service nova] Acquiring lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:15.258806 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7b5e8361-1845-4ba4-83eb-93f5ec95ca15 req-2e2ef9e6-f937-4871-86c7-ff5b774bc4d6 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:15.258911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7b5e8361-1845-4ba4-83eb-93f5ec95ca15 req-2e2ef9e6-f937-4871-86c7-ff5b774bc4d6 service nova] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:15.259049 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7b5e8361-1845-4ba4-83eb-93f5ec95ca15 req-2e2ef9e6-f937-4871-86c7-ff5b774bc4d6 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] No waiting events found dispatching network-vif-unplugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:15.259191 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7b5e8361-1845-4ba4-83eb-93f5ec95ca15 req-2e2ef9e6-f937-4871-86c7-ff5b774bc4d6 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-unplugged-bfe58d64-ed38-4e04-a55f-b9c1b24db552 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:15.307971 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:15.308186 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:15.308398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:15.308591 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:15.308731 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:15.310769 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Terminating instance
Jun 27 04:25:15.319319 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:15.569804 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:15.683931 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updated VIF entry in instance network info cache for port 6dcddf71-b267-4169-9118-d46552dd9af3. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:25:15.684165 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updating instance_info_cache with network_info: [{"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:15.813586 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:25:15.828294 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:15.829863 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:15.844345 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:15.845690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:15.863788 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:15.890911 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:25:16.133809 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999732392999704 future=<Future at 0x7ec5384a8650 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:16.135028 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Instance destroyed successfully.
Jun 27 04:25:16.135584 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lazy-loading 'resources' on Instance uuid b5166ed7-2300-4f0f-a83e-f4e45e469dc8 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:16.186028 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef47d7af-7800-47d0-94b3-c9706605ef5a req-f45944e9-f19f-4f08-86a8-9720a4560891 service nova] Releasing lock "refresh_cache-b5166ed7-2300-4f0f-a83e-f4e45e469dc8" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:25:16.637899 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:22:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-573483232',display_name='tempest-TestStampPattern-server-573483232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-teststamppattern-server-573483232',id=71,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuLsoUgmnM2mA1lL8DuFlpBo3CGzhpyt70TjsmVnBWgRrZ44G0RqQTbgYpLN8RnahmdFTG0Tn8yOEFOq9BrQ94jOFvuhPTIu7dQN+DrSwkuMpN/Zy71uJXz+llJIwtndQ==',key_name='tempest-TestStampPattern-128729590',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:23:04Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c311152ba8e648b29dec91d5696dfd79',ramdisk_id='',reservation_id='r-dmxnrg27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1922334425',owner_user_name='tempest-TestStampPattern-1922334425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:23:56Z,user_data=None,user_id='74c3cd4fd76e48508b391718ae88e54d',uuid=b5166ed7-2300-4f0f-a83e-f4e45e469dc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:25:16.638122 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converting VIF {"id": "6dcddf71-b267-4169-9118-d46552dd9af3", "address": "fa:16:3e:85:06:77", "network": {"id": "540d2985-7ae0-450d-8d1b-f2761609a121", "bridge": "br-int", "label": "tempest-TestStampPattern-28961375-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c311152ba8e648b29dec91d5696dfd79", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcddf71-b2", "ovs_interfaceid": "6dcddf71-b267-4169-9118-d46552dd9af3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:16.638585 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:16.638814 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:25:16.639795 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:16.640034 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dcddf71-b2, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:16.640936 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:16.641795 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:16.642416 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:16.642569 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a5cb117-efd6-467c-94db-52ad11e0b71c) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:16.643185 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:16.643351 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:16.643731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:16.645125 np0000003830 nova-compute[98984]: INFO os_vif [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:06:77,bridge_name='br-int',has_traffic_filtering=True,id=6dcddf71-b267-4169-9118-d46552dd9af3,network=Network(540d2985-7ae0-450d-8d1b-f2761609a121),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcddf71-b2')
Jun 27 04:25:16.645403 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Deleting instance files /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8_del
Jun 27 04:25:16.646150 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Deletion of /opt/stack/data/nova/instances/b5166ed7-2300-4f0f-a83e-f4e45e469dc8_del complete
Jun 27 04:25:16.866053 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-unplugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:16.866231 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:16.867235 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:16.867475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:16.867475 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] No waiting events found dispatching network-vif-unplugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:16.867628 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-unplugged-6dcddf71-b267-4169-9118-d46552dd9af3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:16.867702 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-unplugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:16.867808 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] Acquiring lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:16.867939 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:16.868004 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:16.868102 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] No waiting events found dispatching network-vif-unplugged-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:16.868190 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0bc0573-5336-4eb7-83db-45f9618613f9 req-ba3ee69c-d8a8-4e14-b664-26cb104cb4b6 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-unplugged-6dcddf71-b267-4169-9118-d46552dd9af3 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:16.905092 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 33000000089b386f0 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:25:16.905324 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:16.905451 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '33000000089b386f0', 'path': '/dev/dm-0', 'multipath_id': '33000000089b386f0'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:25:16.905599 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089b386f0', 'path': '/dev/dm-0', 'multipath_id': '33000000089b386f0'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:25:16.905958 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.063s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:16.906326 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '73a40cfa-a13e-48a8-b72e-6ee41270458d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:25:16.906449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:16.932409 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:25:16.932842 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '203')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:16.933755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d', '202')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:16.934538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec54da85b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'): ({'sdg'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:25:16.934769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Removing multipathed devices sdg, sdi {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:25:16.934978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flush multipath device 33000000026b2e17d {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:25:16.989129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:17.036789 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:17.082720 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Checking to see if SCSI volumes sdg, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:25:17.082857 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] SCSI volumes sdg, sdi have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:25:17.083940 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Checking to see if device paths {'sdg', 'sdi'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:25:17.094424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Device paths {'sdg', 'sdi'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:25:17.094630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:25:17.104890 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:17.139299 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.40.100,3260]
Jun 27 04:25:17.139299 np0000003830 nova-compute[98984]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.40.100,3260] successful.
Jun 27 04:25:17.139299 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:17.151418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Took 1.34 seconds to destroy the instance on the hypervisor.
Jun 27 04:25:17.151991 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:25:17.152176 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:25:17.152270 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:25:17.152547 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:17.154385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:17.164370 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:17.203416 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.50.100,3260]
Jun 27 04:25:17.203416 np0000003830 nova-compute[98984]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-73a40cfa-a13e-48a8-b72e-6ee41270458d, portal: 192.168.50.100,3260] successful.
Jun 27 04:25:17.203416 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:17.218545 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:17.218658 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:17.218751 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== disconnect_volume: return (3376ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:25:17.218856 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:25:17.219091 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Deleting instance files /opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52_del
Jun 27 04:25:17.219574 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Deletion of /opt/stack/data/nova/instances/e000fc15-bce1-41d9-9ea9-6f62ed938d52_del complete
Jun 27 04:25:17.247647 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:17.414185 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1586654133',display_name='tempest-TestVolumeBootPattern-server-1586654133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1586654133',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-i2gmbdbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:25:10Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=ee509af0-f4aa-4d61-a722-f76bd060bd50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:25:17.414185 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:17.414185 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:17.414185 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid ee509af0-f4aa-4d61-a722-f76bd060bd50 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:17.479884 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7c6f68-2898-49ee-8998-4beb01956877 req-73bc8147-8789-420a-94ae-796cc229bcc2 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Received event network-vif-deleted-6dcddf71-b267-4169-9118-d46552dd9af3 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:17.481010 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-ff7c6f68-2898-49ee-8998-4beb01956877 req-73bc8147-8789-420a-94ae-796cc229bcc2 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Neutron deleted interface 6dcddf71-b267-4169-9118-d46552dd9af3; detaching it from the instance and deleting it from the info cache
Jun 27 04:25:17.482738 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ff7c6f68-2898-49ee-8998-4beb01956877 req-73bc8147-8789-420a-94ae-796cc229bcc2 service nova] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Detach interface failed, port_id=6dcddf71-b267-4169-9118-d46552dd9af3, reason: Instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:25:17.725081 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Took 4.72 seconds to destroy the instance on the hypervisor.
Jun 27 04:25:17.726087 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:25:17.726501 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:25:17.726637 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:25:17.726867 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:17.815442 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <uuid>ee509af0-f4aa-4d61-a722-f76bd060bd50</uuid>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <name>instance-0000004c</name>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-1586654133</nova:name>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:25:12</nova:creationTime>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         <nova:port uuid="d074e270-6342-4038-a479-ef2007286b73">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <entry name="serial">ee509af0-f4aa-4d61-a722-f76bd060bd50</entry>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <entry name="uuid">ee509af0-f4aa-4d61-a722-f76bd060bd50</entry>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50/disk.config"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <alias name="ua-d9f6e1d4-3a31-458d-9f25-52978d296ff8"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <serial>d9f6e1d4-3a31-458d-9f25-52978d296ff8</serial>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:fc:68:70"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <target dev="tapd074e270-63"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50/console.log" append="off"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:25:17.915312 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Preparing to wait for external event network-vif-plugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1586654133',display_name='tempest-TestVolumeBootPattern-server-1586654133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1586654133',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-i2gmbdbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:25:10Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=ee509af0-f4aa-4d61-a722-f76bd060bd50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.917979 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:17.918490 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:25:17.918582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.918729 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec928d00-7982-55bf-a438-30a3b88b741a', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:17.919406 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.920023 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:17.920248 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.921885 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.922013 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd074e270-63, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:17.922297 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd074e270-63, col_values=(('qos', UUID('e79e1710-dd12-4df2-97f2-c6867b1b8034')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:17.922872 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd074e270-63, col_values=(('external_ids', {'iface-id': 'd074e270-6342-4038-a479-ef2007286b73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:68:70', 'vm-uuid': 'ee509af0-f4aa-4d61-a722-f76bd060bd50'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:17.923070 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.924048 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:17.928214 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:17.928956 np0000003830 nova-compute[98984]: INFO os_vif [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63')
Jun 27 04:25:17.940527 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:18.442078 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Took 1.29 seconds to deallocate network for instance.
Jun 27 04:25:18.653949 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:18.913957 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-95edbf70-37f6-4947-90eb-9ff0e8cd5717 req-6f5a782d-602f-43f0-b2ca-452cb4a17975 service nova] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Received event network-vif-deleted-bfe58d64-ed38-4e04-a55f-b9c1b24db552 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:18.946838 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:18.947155 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:19.156056 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Took 1.43 seconds to deallocate network for instance.
Jun 27 04:25:19.184217 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:19.184446 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:19.443835 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:25:19.444235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:25:19.444235 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:fc:68:70, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:25:19.444355 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Using config drive
Jun 27 04:25:19.686952 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:19.711853 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Took 0.56 seconds to detach 1 volumes for instance.
Jun 27 04:25:19.949516 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:20.060853 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Creating config drive at /opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50/disk.config
Jun 27 04:25:20.063717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplftjhd8t {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:25:20.117304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplftjhd8t" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:25:20.195454 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.248s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:20.217970 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:20.218179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:20.305038 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Deleted allocations for instance b5166ed7-2300-4f0f-a83e-f4e45e469dc8
Jun 27 04:25:20.433425 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:20.433698 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:20.559786 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.580860 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.584648 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.670955 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.882180 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.884115 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.885564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.900064 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:20.936670 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:20.969630 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-plugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:20.970027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:20.970149 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:20.970263 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:20.970491 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Processing event network-vif-plugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:25:20.970551 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-plugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:20.970663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:20.970770 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:20.970871 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:20.970999 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] No waiting events found dispatching network-vif-plugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:20.971101 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-faf957bc-0726-4bde-897a-2a7960381707 req-8bffbdef-aaf0-46b4-8596-e4ee7fc56426 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received unexpected event network-vif-plugged-d074e270-6342-4038-a479-ef2007286b73 for instance with vm_state building and task_state spawning.
Jun 27 04:25:21.275245 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004110549998586066 future=<Future at 0x7ec518767f50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:21.275374 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:21.276301 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=7.051950921000298 future=<Future at 0x7ec538309ac0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:21.276623 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782534306.2747407, 13999eeb-6cae-4304-8b86-e80759b578c4 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:21.276766 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=7.0506674510002085 future=<Future at 0x7ec538309ac0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:21.276883 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] VM Stopped (Lifecycle Event)
Jun 27 04:25:21.317118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9c955058-eccd-4d56-8d28-ceafe66442ac tempest-TestStampPattern-1922334425 tempest-TestStampPattern-1922334425-project-member] Lock "b5166ed7-2300-4f0f-a83e-f4e45e469dc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.009s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:21.359511 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534321.3591335, ee509af0-f4aa-4d61-a722-f76bd060bd50 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:21.360024 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:25:21.360214 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] VM Started (Lifecycle Event)
Jun 27 04:25:21.362684 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:25:21.365776 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Instance spawned successfully.
Jun 27 04:25:21.366241 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:25:21.443033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.225s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:21.527255 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Deleted allocations for instance e000fc15-bce1-41d9-9ea9-6f62ed938d52
Jun 27 04:25:21.779561 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 13999eeb-6cae-4304-8b86-e80759b578c4] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:21.862819 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:21.865152 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:25:21.871941 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:25:21.872085 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:25:21.872394 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:25:21.872677 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:25:21.872947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:25:21.873172 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:25:22.367462 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:25:22.367726 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534322.3675702, ee509af0-f4aa-4d61-a722-f76bd060bd50 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:22.367822 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] VM Paused (Lifecycle Event)
Jun 27 04:25:22.377430 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Took 9.52 seconds to spawn the instance on the hypervisor.
Jun 27 04:25:22.377614 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:22.534854 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07b63ed7-81e4-4708-b2a4-d3cdaaadf037 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "e000fc15-bce1-41d9-9ea9-6f62ed938d52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.037s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:22.869954 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:22.876803 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534322.8765788, ee509af0-f4aa-4d61-a722-f76bd060bd50 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:22.876994 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] VM Resumed (Lifecycle Event)
Jun 27 04:25:22.885937 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Took 16.66 seconds to build instance.
Jun 27 04:25:22.925585 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:23.379556 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:23.381402 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:25:23.387314 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fe678345-a7f3-401e-9553-5314c43ade11 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.167s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:24.886047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:25.246333 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-changed-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:25.246480 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Refreshing instance network info cache due to event network-changed-d074e270-6342-4038-a479-ef2007286b73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:25:25.246742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] Acquiring lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:25:25.246888 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] Acquired lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:25:25.247082 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Refreshing network info cache for port d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:25:25.417788 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:25.750241 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:26.036583 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:26.182533 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updated VIF entry in instance network info cache for port d074e270-6342-4038-a479-ef2007286b73. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:25:26.182836 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updating instance_info_cache with network_info: [{"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:26.395970 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:26.396198 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:26.396393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:26.396574 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:26.396725 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:26.398808 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Terminating instance
Jun 27 04:25:26.684750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f27eb8b-f982-4a97-bf84-262790e76144 req-e6a6b2da-6ed6-422e-b3de-ab8943df583a service nova] Releasing lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:25:26.902249 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:25:26.923712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:26.927306 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:26.943675 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.112519 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.115396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.117843 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.129572 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef1bdfa5-e8f9-4e94-a6fc-a446e0b68a09 req-b1935e94-45d1-4520-a941-e47b8cccae09 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-unplugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:27.129572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef1bdfa5-e8f9-4e94-a6fc-a446e0b68a09 req-b1935e94-45d1-4520-a941-e47b8cccae09 service nova] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:27.129881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef1bdfa5-e8f9-4e94-a6fc-a446e0b68a09 req-b1935e94-45d1-4520-a941-e47b8cccae09 service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:27.129881 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ef1bdfa5-e8f9-4e94-a6fc-a446e0b68a09 req-b1935e94-45d1-4520-a941-e47b8cccae09 service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:27.129881 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef1bdfa5-e8f9-4e94-a6fc-a446e0b68a09 req-b1935e94-45d1-4520-a941-e47b8cccae09 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] No waiting events found dispatching network-vif-unplugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:27.130146 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ef1bdfa5-e8f9-4e94-a6fc-a446e0b68a09 req-b1935e94-45d1-4520-a941-e47b8cccae09 service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-unplugged-505ad38a-a284-4f53-816d-b86d6972b7be for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:27.220151 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.224920 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.243205 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999751746999664 future=<Future at 0x7ec518772750 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:27.245345 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Instance destroyed successfully.
Jun 27 04:25:27.245947 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lazy-loading 'resources' on Instance uuid 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:27.750154 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:23:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-677594679',display_name='tempest-TestVolumeBootPatternV346-server-677594679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-677594679',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCxDvIl5FXdSpeWwNaUVGzbIWccXeMYrHOAChox0IrprpqIigpzJdSTK3+QN23wBGG/Eq4Q0LFSHuAtMyCutA5ALrRkCEIxPd0PTk7mtvYvnva9jK8nDJJOHpaMkn8p0g==',key_name='tempest-keypair-1918201295',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:23:34Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-vdiqj02q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:23:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:25:27.750392 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "505ad38a-a284-4f53-816d-b86d6972b7be", "address": "fa:16:3e:c4:08:82", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap505ad38a-a2", "ovs_interfaceid": "505ad38a-a284-4f53-816d-b86d6972b7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:27.750946 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:27.751195 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:25:27.752510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.752749 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap505ad38a-a2, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:27.755510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.756993 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:27.757642 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.757904 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22da2a29-dc34-4cde-b3bb-29ea73a17e4b) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:27.758558 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:27.759838 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:27.761941 np0000003830 nova-compute[98984]: INFO os_vif [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:08:82,bridge_name='br-int',has_traffic_filtering=True,id=505ad38a-a284-4f53-816d-b86d6972b7be,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap505ad38a-a2')
Jun 27 04:25:27.763547 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:25:27.763860 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:25:27.763992 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:27.764330 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:27.764639 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3e551815-5937-470d-ad6c-7cb099b4f987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:25:27.764778 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:27.790516 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987 (non-flash)
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:25:27.790900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '196')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:27.791765 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987', '197')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:27.792616 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec538419c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'): ({'sdf'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:25:27.792799 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Removing multipathed devices sdf, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:25:27.793019 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flush multipath device 33000000017a10cd0 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:25:27.849124 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:27.902050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:27.955920 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Checking to see if SCSI volumes sdf, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:25:27.956129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] SCSI volumes sdf, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:25:27.957187 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Checking to see if device paths {'sdf', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:25:27.969695 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Device paths {'sdf', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:25:27.969910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:25:27.982273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:28.010452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.40.100,3260]
Jun 27 04:25:28.010452 np0000003830 nova-compute[98984]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.40.100,3260] successful.
Jun 27 04:25:28.010452 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:28.028273 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:28.038409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:28.088829 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.50.100,3260]
Jun 27 04:25:28.088829 np0000003830 nova-compute[98984]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-3e551815-5937-470d-ad6c-7cb099b4f987, portal: 192.168.50.100,3260] successful.
Jun 27 04:25:28.088829 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:28.103611 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:28.104300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:28.104300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== disconnect_volume: return (340ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:25:28.104300 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:25:28.104429 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Deleting instance files /opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a_del
Jun 27 04:25:28.105291 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Deletion of /opt/stack/data/nova/instances/4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a_del complete
Jun 27 04:25:28.327891 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00036981099992772215 future=<Future at 0x7ec538309ac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:28.328290 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] Emitting event <LifecycleEvent: 1782534313.3273714, e000fc15-bce1-41d9-9ea9-6f62ed938d52 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:28.328380 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:28.328551 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] VM Stopped (Lifecycle Event)
Jun 27 04:25:28.329527 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.804013982000015 future=<Future at 0x7ec5384a8650 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:28.329626 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.8038842649998514 future=<Future at 0x7ec5384a8650 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:28.611433 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Took 1.71 seconds to destroy the instance on the hypervisor.
Jun 27 04:25:28.612241 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:25:28.612449 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:25:28.612562 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:25:28.612803 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:28.688837 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:28.832418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-6e73073c-7c95-4545-88ca-92aa9e0762b4 tempest-AttachVolumeNegativeTest-981489683 tempest-AttachVolumeNegativeTest-981489683-project-member] [instance: e000fc15-bce1-41d9-9ea9-6f62ed938d52] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:29.147848 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9f708fdd-d8a5-457d-ae46-28d084d5096f req-d8e693f1-0c06-46bd-816c-c6b81adc0dff service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-deleted-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:29.148519 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-9f708fdd-d8a5-457d-ae46-28d084d5096f req-d8e693f1-0c06-46bd-816c-c6b81adc0dff service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Neutron deleted interface 505ad38a-a284-4f53-816d-b86d6972b7be; detaching it from the instance and deleting it from the info cache
Jun 27 04:25:29.150838 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9f708fdd-d8a5-457d-ae46-28d084d5096f req-d8e693f1-0c06-46bd-816c-c6b81adc0dff service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Detach interface failed, port_id=505ad38a-a284-4f53-816d-b86d6972b7be, reason: Instance 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:25:29.214484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4a4fa4d7-93b8-4ffd-b525-6e150cdbda89 req-d7ec8fb5-c8a7-4b81-b6e9-fecdaf94cfba service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-unplugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:29.214484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4a4fa4d7-93b8-4ffd-b525-6e150cdbda89 req-d7ec8fb5-c8a7-4b81-b6e9-fecdaf94cfba service nova] Acquiring lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:29.214484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4a4fa4d7-93b8-4ffd-b525-6e150cdbda89 req-d7ec8fb5-c8a7-4b81-b6e9-fecdaf94cfba service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:29.214484 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-4a4fa4d7-93b8-4ffd-b525-6e150cdbda89 req-d7ec8fb5-c8a7-4b81-b6e9-fecdaf94cfba service nova] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:29.214484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4a4fa4d7-93b8-4ffd-b525-6e150cdbda89 req-d7ec8fb5-c8a7-4b81-b6e9-fecdaf94cfba service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] No waiting events found dispatching network-vif-unplugged-505ad38a-a284-4f53-816d-b86d6972b7be {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:29.214484 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-4a4fa4d7-93b8-4ffd-b525-6e150cdbda89 req-d7ec8fb5-c8a7-4b81-b6e9-fecdaf94cfba service nova] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Received event network-vif-unplugged-505ad38a-a284-4f53-816d-b86d6972b7be for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:29.605183 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:29.887093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:30.107526 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Took 1.49 seconds to deallocate network for instance.
Jun 27 04:25:30.660068 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Took 0.55 seconds to detach 1 volumes for instance.
Jun 27 04:25:30.730181 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:31.136866 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0033027340000444383 future=<Future at 0x7ec5384a8650 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:31.137232 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782534316.1334634, b5166ed7-2300-4f0f-a83e-f4e45e469dc8 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:31.137399 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:31.137482 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] VM Stopped (Lifecycle Event)
Jun 27 04:25:31.138446 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.104493548999926 future=<Future at 0x7ec518772750 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:31.138547 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.1043718359997 future=<Future at 0x7ec518772750 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:31.162785 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:31.162980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:31.346788 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:31.347208 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:31.639818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: b5166ed7-2300-4f0f-a83e-f4e45e469dc8] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:31.850397 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:32.122735 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:32.358480 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.195s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:32.408072 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Deleted allocations for instance 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a
Jun 27 04:25:32.758511 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:32.827513 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:32.827747 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:25:33.415476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-616ac681-92b4-4153-a389-eb16a504dd2f tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.019s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:34.580194 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:34.830090 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:34.830381 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:25:34.900573 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:36.441109 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:37.438734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:37.438734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:37.438934 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:37.439032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:37.439135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:37.441402 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Terminating instance
Jun 27 04:25:37.760391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:37.830238 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:37.830411 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:37.945110 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:25:37.962100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:37.963871 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:37.977321 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.001859 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.016662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.260660 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999705644000187 future=<Future at 0x7ec5181af350 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:38.262788 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Instance destroyed successfully.
Jun 27 04:25:38.263288 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lazy-loading 'resources' on Instance uuid 6d0722c2-911a-4f04-ba22-55af13b84ea5 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:25:38.334717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:38.335200 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:38.335399 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:38.335575 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:25:38.765562 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1849460374',display_name='tempest-TestVolumeBootPatternV346-server-1849460374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpatternv346-server-1849460374',id=69,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIUOluM30KRMMqAWDf5VkCh7x6f9Tc0N5SlBWYNQ4MH9pQ19E0VzqHz8tBc9NcMFGuYj8tzxf7P5JRA1bsYHGDKUKMIF2OUq+QPp3TWcH3Ut/cS3pohyfZQD7g3Np9cyA==',key_name='tempest-keypair-591947429',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:22:33Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b2c06b4d16f4ddc96d9a367ad400f1d',ramdisk_id='',reservation_id='r-sss2dwfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1310252554',owner_user_name='tempest-TestVolumeBootPatternV346-1310252554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:22:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='167cf43243714b078a04b4c192717bd3',uuid=6d0722c2-911a-4f04-ba22-55af13b84ea5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:25:38.766105 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converting VIF {"id": "83de74f9-c135-40af-a036-3caee6233adc", "address": "fa:16:3e:8b:0a:da", "network": {"id": "4e7efd73-61c7-4204-9991-ed0c4b5fe26f", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-58981190-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1b2c06b4d16f4ddc96d9a367ad400f1d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83de74f9-c1", "ovs_interfaceid": "83de74f9-c135-40af-a036-3caee6233adc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:25:38.766193 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:25:38.766391 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:25:38.767375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.767636 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83de74f9-c1, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:38.768602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.769427 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:38.769987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.770732 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.770732 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca14cabf-adcd-4f74-99da-fd81a586a56b) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:25:38.771413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.771413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:25:38.771562 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:38.773084 np0000003830 nova-compute[98984]: INFO os_vif [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=83de74f9-c135-40af-a036-3caee6233adc,network=Network(4e7efd73-61c7-4204-9991-ed0c4b5fe26f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83de74f9-c1')
Jun 27 04:25:38.774828 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:25:38.775118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:25:38.775266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:25:38.775638 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:25:38.775963 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '090c2fae-a036-4767-860c-397ca192bd00', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:25:38.776086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:25:38.797820 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:38.797820 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:38.797820 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:38.797820 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:38.797820 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsi session list stdout=tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]: tcp: [187] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00 (non-flash)
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:25:38.798122 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '186')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:38.798963 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00', '187')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:25:38.799728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec53841a5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:25:38.799898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Removing multipathed devices sdh, sde {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:25:38.800125 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Flush multipath device 330000000cb1945d5 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:25:38.852485 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:38.903090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:25:38.944936 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Checking to see if SCSI volumes sdh, sde have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:25:38.945123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] SCSI volumes sdh, sde have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:25:38.946054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Checking to see if device paths {'sdh', 'sde'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:25:38.956916 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Device paths {'sdh', 'sde'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:25:38.957072 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:25:38.967282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:38.998479 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.40.100,3260]
Jun 27 04:25:38.998479 np0000003830 nova-compute[98984]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.40.100,3260] successful.
Jun 27 04:25:38.998479 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:39.013603 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:39.024960 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:39.051522 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.50.100,3260]
Jun 27 04:25:39.051522 np0000003830 nova-compute[98984]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-090c2fae-a036-4767-860c-397ca192bd00, portal: 192.168.50.100,3260] successful.
Jun 27 04:25:39.051522 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:39.063340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:25:39.063545 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:25:39.063618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] <== disconnect_volume: return (287ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:25:39.063758 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:25:39.063986 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Deleting instance files /opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5_del
Jun 27 04:25:39.064429 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Deletion of /opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5_del complete
Jun 27 04:25:39.356020 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:25:39.374715 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Periodic task is updating the host stat, it is trying to get disk instance-00000045, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/6d0722c2-911a-4f04-ba22-55af13b84ea5/disk.config'
Jun 27 04:25:39.394953 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:25:39.395758 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:25:39.416119 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-560e17b6-412d-41be-97c8-4d598c40642b req-6fe7f94e-a050-42d7-9ddf-8fe674066895 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-unplugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:39.416900 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-560e17b6-412d-41be-97c8-4d598c40642b req-6fe7f94e-a050-42d7-9ddf-8fe674066895 service nova] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:39.417203 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-560e17b6-412d-41be-97c8-4d598c40642b req-6fe7f94e-a050-42d7-9ddf-8fe674066895 service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:39.417396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-560e17b6-412d-41be-97c8-4d598c40642b req-6fe7f94e-a050-42d7-9ddf-8fe674066895 service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:39.417616 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-560e17b6-412d-41be-97c8-4d598c40642b req-6fe7f94e-a050-42d7-9ddf-8fe674066895 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] No waiting events found dispatching network-vif-unplugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:39.417795 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-560e17b6-412d-41be-97c8-4d598c40642b req-6fe7f94e-a050-42d7-9ddf-8fe674066895 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-unplugged-83de74f9-c135-40af-a036-3caee6233adc for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:39.441183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:25:39.441692 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51564MB free_disk=71.81909561157227GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:25:39.441880 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:39.442135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:39.581222 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Took 1.64 seconds to destroy the instance on the hypervisor.
Jun 27 04:25:39.581951 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:25:39.588214 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:25:39.588214 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:25:39.588214 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:39.642157 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:25:39.901505 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:40.073377 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a6886b40-7fb8-4674-b9b9-9a4e359805ac req-cac4ae67-6d22-45ba-a651-011923a03548 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-deleted-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:40.073377 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-a6886b40-7fb8-4674-b9b9-9a4e359805ac req-cac4ae67-6d22-45ba-a651-011923a03548 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Neutron deleted interface 83de74f9-c135-40af-a036-3caee6233adc; detaching it from the instance and deleting it from the info cache
Jun 27 04:25:40.074466 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a6886b40-7fb8-4674-b9b9-9a4e359805ac req-cac4ae67-6d22-45ba-a651-011923a03548 service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Detach interface failed, port_id=83de74f9-c135-40af-a036-3caee6233adc, reason: Instance 6d0722c2-911a-4f04-ba22-55af13b84ea5 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:25:40.496483 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6d0722c2-911a-4f04-ba22-55af13b84ea5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:25:40.496596 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance ee509af0-f4aa-4d61-a722-f76bd060bd50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:25:40.496775 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:25:40.496912 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:25:39 up 48 min,  2 users,  load average: 3.47, 4.68, 5.32\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '2', 'num_proj_1b2c06b4d16f4ddc96d9a367ad400f1d': '1', 'io_workload': '0', 'num_task_None': '1', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:25:40.531848 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:25:40.615317 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:40.615660 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:41.034369 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Took 1.45 seconds to deallocate network for instance.
Jun 27 04:25:41.118524 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:41.448851 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-182c7c92-3743-4d39-9c78-3b2476688dfc req-c934f451-57c2-4a58-9ca4-0ddc94d1ae8f service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-unplugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:25:41.449261 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-182c7c92-3743-4d39-9c78-3b2476688dfc req-c934f451-57c2-4a58-9ca4-0ddc94d1ae8f service nova] Acquiring lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:41.449409 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-182c7c92-3743-4d39-9c78-3b2476688dfc req-c934f451-57c2-4a58-9ca4-0ddc94d1ae8f service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:41.449532 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-182c7c92-3743-4d39-9c78-3b2476688dfc req-c934f451-57c2-4a58-9ca4-0ddc94d1ae8f service nova] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:41.449645 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-182c7c92-3743-4d39-9c78-3b2476688dfc req-c934f451-57c2-4a58-9ca4-0ddc94d1ae8f service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] No waiting events found dispatching network-vif-unplugged-83de74f9-c135-40af-a036-3caee6233adc {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:25:41.449766 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-182c7c92-3743-4d39-9c78-3b2476688dfc req-c934f451-57c2-4a58-9ca4-0ddc94d1ae8f service nova] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Received event network-vif-unplugged-83de74f9-c135-40af-a036-3caee6233adc for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:25:41.598836 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Took 0.56 seconds to detach 1 volumes for instance.
Jun 27 04:25:41.624451 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:25:41.624639 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.182s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:41.624982 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:25:42.103897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:25:42.105566 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:25:42.243453 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:25:42.244183 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.001208706999932474 future=<Future at 0x7ec518772750 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:42.244388 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:25:42.245693 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] Emitting event <LifecycleEvent: 1782534327.2428641, 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:42.246304 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:42.246304 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] VM Stopped (Lifecycle Event)
Jun 27 04:25:42.247967 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.012779357999989 future=<Future at 0x7ec5181af350 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:42.247967 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=11.012530311000319 future=<Future at 0x7ec5181af350 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:42.748923 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:25:42.752984 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-8269ca8b-4411-4c67-984f-360b33a5af6b tempest-TestServerVolumeAttachmentScenario-747119314 tempest-TestServerVolumeAttachmentScenario-747119314-project-member] [instance: 4fdcd1d6-3f33-45c0-a6ae-8c67eede5c4a] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:43.256669 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:43.335356 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Deleted allocations for instance 6d0722c2-911a-4f04-ba22-55af13b84ea5
Jun 27 04:25:43.772634 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:44.342908 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a69dbbaf-ef25-422c-89ea-6813ea96a41e tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Lock "6d0722c2-911a-4f04-ba22-55af13b84ea5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.904s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:25:44.902849 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:46.624637 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:46.625030 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:46.625086 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:46.625267 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:46.625450 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:25:46.625604 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:25:46.625824 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.20 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:25:47.019522 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:25:47.179188 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:48.774330 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:49.068520 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:49.904552 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:52.747186 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:53.260661 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003505390000100306 future=<Future at 0x7ec5181af350 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:53.260768 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:25:53.261076 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] Emitting event <LifecycleEvent: 1782534338.2602181, 6d0722c2-911a-4f04-ba22-55af13b84ea5 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:25:53.261246 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] VM Stopped (Lifecycle Event)
Jun 27 04:25:53.763686 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-398cab1f-aa36-4009-899f-9ada5bdb5417 tempest-TestVolumeBootPatternV346-1310252554 tempest-TestVolumeBootPatternV346-1310252554-project-member] [instance: 6d0722c2-911a-4f04-ba22-55af13b84ea5] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:25:53.775056 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:54.906731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:55.114744 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:58.786166 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:25:59.913358 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:03.787013 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:04.926788 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:05.600142 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:05.600363 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:06.102678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:26:06.658956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:06.659129 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:06.662602 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:26:06.662731 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Claim successful on node np0000003830
Jun 27 04:26:07.801249 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:26:07.801755 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:26:08.303978 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:26:08.796988 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:08.811748 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.152s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:08.812217 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:26:09.318368 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:26:09.318540 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:26:09.318815 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:09.319026 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:09.402379 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f26454c3434b0d86ba862b622c839f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f5e61c86084bb88ca7c2f090e48ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:26:09.751100 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:09.821548 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:26:09.928345 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:09.998211 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Successfully created port: 6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:26:10.323593 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:26:10.511911 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Successfully updated port: 6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:26:10.557816 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-changed-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:10.557971 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Refreshing instance network info cache due to event network-changed-6e72dd5b-b536-4398-a718-af4dca920f30. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:10.558092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] Acquiring lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:10.558207 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] Acquired lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:10.558638 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Refreshing network info cache for port 6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:10.827866 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Booting with volume 281f1ae5-0fc7-43eb-96e5-2aca3a990845 at /dev/vda
Jun 27 04:26:10.863968 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:26:10.874096 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:26:10.895014 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:26:10.944713 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:26:10.945037 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:26:10.952676 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:26:10.953799 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefc:6870', 'fe80::a810:fdff:fe5d:dd65'] 
Jun 27 04:26:10.953951 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:26:10.954058 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:26:10.954331 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:26:10.954609 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updating existing volume attachment record: 30d69845-cb46-4dbc-acbe-9f223f9d573a {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:26:11.015090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:11.060275 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:11.116202 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:26:11.237022 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:11.739331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c0ee87f5-e700-43d2-bba7-4f9923ce8683 req-6d51d902-de3f-440f-86e2-4fc64790f2e7 service nova] Releasing lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:11.739910 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquired lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:11.740171 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:26:12.297193 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:26:12.446183 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:12.563110 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updating instance_info_cache with network_info: [{"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:13.065911 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Releasing lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:13.066192 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Instance network_info: |[{"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Creating image(s)
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Ensure instance console log exists: /opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:13.111974 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:13.115508 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Start _get_guest_xml network_info=[{"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '30d69845-cb46-4dbc-acbe-9f223f9d573a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6a817056-577a-4a52-bbcc-e6f2e16a9889', 'attached_at': '', 'detached_at': '', 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'serial': '281f1ae5-0fc7-43eb-96e5-2aca3a990845'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:26:13.119412 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:26:13.120419 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1999692114', uuid='6a817056-577a-4a52-bbcc-e6f2e16a9889'), owner=OwnerMeta(userid='d8f26454c3434b0d86ba862b622c839f', username='tempest-TestVolumeBootPattern-1983529732-project-member', projectid='b5f5e61c86084bb88ca7c2f090e48ba9', projectname='tempest-TestVolumeBootPattern-1983529732'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534373.1201115) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:26:13.123428 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:26:13.123428 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:26:13.124167 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:26:13.124341 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:26:13.125112 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:26:13.125363 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:26:13.125530 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:26:13.125624 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:26:13.125736 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:26:13.125811 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:26:13.125898 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:26:13.126046 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:26:13.126136 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:26:13.126235 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:26:13.126361 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:26:13.126461 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:26:13.135029 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:26:13.135332 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:26:13.135452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:26:13.135783 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:26:13.135977 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:26:13.147071 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:26:13.147537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:26:13.147881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:26:13.148072 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:26:13.148667 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:26:13.148667 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:26:13.160345 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:26:13.160345 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:13.164520 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:26:13.164520 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845] added
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:13.171939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:26:13.172309 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:26:13.172436 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845] added
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:13.175901 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:13.176077 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:26:13.176187 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:26:13.176372 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:26:13.798582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:14.172873 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:26:14.176971 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:26:14.185086 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:26:14.191323 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.198359 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.203779 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.213714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.213714 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.213714 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.213714 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:14.213908 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.213908 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.213908 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.213908 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:14.219073 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.219073 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.219073 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.219073 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:14.219212 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.219212 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.219212 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.219212 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:14.248791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.50.100,3260]
Jun 27 04:26:14.248791 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.50.100,3260] successful.
Jun 27 04:26:14.248791 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.257168 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.40.100,3260]
Jun 27 04:26:14.257168 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.40.100,3260] successful.
Jun 27 04:26:14.257168 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.259182 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.271815 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:14.275998 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.275998 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.275998 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.275998 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.275998 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.275998 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:14.276205 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.276205 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.276205 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.276205 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.276205 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.276205 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:14.276378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:26:14.276472 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:26:14.277154 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('10', '-', '-', 0) found on session 211 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:26:14.277258 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:26:14.285106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.285106 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.285106 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.285106 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.285106 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.285106 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:14.285319 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.285319 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:14.285319 np0000003830 nova-compute[98984]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:14.285319 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.285319 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:14.285319 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:14.285466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:26:14.285602 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:26:14.286196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] HCTL ('11', '-', '-', 0) found on session 212 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:26:14.286298 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:26:14.291753 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 211 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:26:14.291945 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:26:14.300525 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Searching for a device in session 212 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:26:14.300594 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:26:15.120695 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:15.121106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:15.148554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:26:15.622941 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:26:16.165813 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:16.166246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Found WWN 330000000cdc4618e for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:26:16.166561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:16.166700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:26:16.166859 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000cdc4618e', 'path': '/dev/dm-1', 'multipath_id': '330000000cdc4618e'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:26:16.166972 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cdc4618e', 'path': '/dev/dm-1', 'multipath_id': '330000000cdc4618e'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:26:16.169815 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:26:16.169966 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Claim successful on node np0000003830
Jun 27 04:26:16.675873 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1999692114',display_name='tempest-TestVolumeBootPattern-server-1999692114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1999692114',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-l1m2nnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:26:10Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=6a817056-577a-4a52-bbcc-e6f2e16a9889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:26:16.676203 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:26:16.677084 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:26:16.678133 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a817056-577a-4a52-bbcc-e6f2e16a9889 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <uuid>6a817056-577a-4a52-bbcc-e6f2e16a9889</uuid>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <name>instance-0000004d</name>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBootPattern-server-1999692114</nova:name>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:26:13</nova:creationTime>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:user uuid="d8f26454c3434b0d86ba862b622c839f">tempest-TestVolumeBootPattern-1983529732-project-member</nova:user>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:project uuid="b5f5e61c86084bb88ca7c2f090e48ba9">tempest-TestVolumeBootPattern-1983529732</nova:project>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         <nova:port uuid="6e72dd5b-b536-4398-a718-af4dca920f30">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <entry name="serial">6a817056-577a-4a52-bbcc-e6f2e16a9889</entry>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <entry name="uuid">6a817056-577a-4a52-bbcc-e6f2e16a9889</entry>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889/disk.config"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <alias name="ua-281f1ae5-0fc7-43eb-96e5-2aca3a990845"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-1"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <serial>281f1ae5-0fc7-43eb-96e5-2aca3a990845</serial>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:c8:d3:7f"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <target dev="tap6e72dd5b-b5"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889/console.log" append="off"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:26:17.181859 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Preparing to wait for external event network-vif-plugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1999692114',display_name='tempest-TestVolumeBootPattern-server-1999692114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1999692114',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-l1m2nnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:26:10Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=6a817056-577a-4a52-bbcc-e6f2e16a9889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:26:17.184126 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:26:17.184488 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.184666 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:17.184971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:26:17.185536 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.185701 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7dbd2ff-9f42-5453-b5cd-cccf8e8c3d5c', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:17.186404 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.187040 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:26:17.187380 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.189449 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.189659 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e72dd5b-b5, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:17.190007 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e72dd5b-b5, col_values=(('qos', UUID('7eef605b-2791-4807-b9c4-4c50ebe6557a')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:17.190200 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e72dd5b-b5, col_values=(('external_ids', {'iface-id': '6e72dd5b-b536-4398-a718-af4dca920f30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:d3:7f', 'vm-uuid': '6a817056-577a-4a52-bbcc-e6f2e16a9889'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:17.190964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.192039 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:26:17.196116 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:17.196981 np0000003830 nova-compute[98984]: INFO os_vif [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5')
Jun 27 04:26:17.349800 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:26:17.349991 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:26:17.852658 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:26:18.359085 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.193s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:18.359568 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:26:18.712076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:26:18.712220 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:26:18.712282 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] No VIF found with MAC fa:16:3e:c8:d3:7f, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:26:18.712653 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Using config drive
Jun 27 04:26:18.865213 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:26:18.865510 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:26:18.865772 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:18.866002 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:18.934359 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '612b95e36fbf45b89d71692f2d2b07fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b45911f3ec540eeaccc5f67ba824c82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:26:19.217178 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:19.341656 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Creating config drive at /opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889/disk.config
Jun 27 04:26:19.344641 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmsz1boi0 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:26:19.370520 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:26:19.400127 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmsz1boi0" returned: 0 in 0.055s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:26:19.413238 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Successfully created port: f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:26:19.797825 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:19.815068 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:19.877059 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:26:19.886932 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Successfully updated port: f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:26:19.903830 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:19.939167 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:19.939734 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing instance network info cache due to event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:19.939976 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] Acquiring lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:19.940083 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] Acquired lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:19.940256 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:19.961397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:19.961937 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:20.381735 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Booting with volume bdc4caf0-3341-4999-86f6-cdc182f1f391 at /dev/vda
Jun 27 04:26:20.389348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:20.418136 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:26:20.429350 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:26:20.443169 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:20.450365 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:26:20.496435 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:26:20.496671 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:26:20.505409 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:26:20.506203 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fefc:6870', 'fe80::a810:fdff:fe5d:dd65', 'fe80::fc16:3eff:fec8:d37f'] 
Jun 27 04:26:20.506306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:26:20.506407 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:26:20.506730 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:26:20.506923 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating existing volume attachment record: 3d0345b1-1bda-41be-8af9-3a52cf69cbb9 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:26:20.519094 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:26:20.533059 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534380.5326717, 6a817056-577a-4a52-bbcc-e6f2e16a9889 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:26:20.533220 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] VM Started (Lifecycle Event)
Jun 27 04:26:20.658423 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:21.036020 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:21.038356 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534381.0381556, 6a817056-577a-4a52-bbcc-e6f2e16a9889 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:26:21.038512 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] VM Paused (Lifecycle Event)
Jun 27 04:26:21.160398 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-087b6dc7-fef2-4ecd-a682-4a9cc0e91398 req-d555ed4a-7fa0-4517-9b3e-b544bdf69622 service nova] Releasing lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:21.161131 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquired lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:21.161535 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:26:21.540894 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:21.543757 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:26:21.722028 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:26:21.874874 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:21.997730 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:21.999964 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-plugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:22.000069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:22.000256 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:22.000406 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:22.000987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Processing event network-vif-plugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:26:22.000987 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-plugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:22.000987 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:22.001078 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:22.001161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:22.001284 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] No waiting events found dispatching network-vif-plugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:26:22.001716 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9c24fe59-2c68-41b1-b0fd-70e2be5aeb03 req-b2eff4e0-b05f-462c-aa4d-958f0f7c904f service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received unexpected event network-vif-plugged-6e72dd5b-b536-4398-a718-af4dca920f30 for instance with vm_state building and task_state spawning.
Jun 27 04:26:22.002472 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:26:22.005750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:26:22.011646 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Instance spawned successfully.
Jun 27 04:26:22.011928 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:26:22.049333 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:26:22.049747 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534382.0494277, 6a817056-577a-4a52-bbcc-e6f2e16a9889 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:26:22.050370 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] VM Resumed (Lifecycle Event)
Jun 27 04:26:22.191768 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:22.504205 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Releasing lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:22.504597 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Instance network_info: |[{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:26:22.519204 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:22.519352 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:22.519623 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:22.519886 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:22.520184 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:22.520465 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:22.556345 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:22.558862 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:26:22.610967 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:26:22.612025 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:26:22.612302 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Creating image(s)
Jun 27 04:26:22.612567 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Did not create local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}}
Jun 27 04:26:22.612697 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Ensure instance console log exists: /opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:26:22.613280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:22.613466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:22.613621 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:22.614072 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Start _get_guest_xml network_info=[{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '3d0345b1-1bda-41be-8af9-3a52cf69cbb9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ac1e225d-153e-4b05-a270-029fa5f68dab', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'serial': 'bdc4caf0-3341-4999-86f6-cdc182f1f391'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:26:22.623520 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:26:22.623520 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-2109434309', uuid='ac1e225d-153e-4b05-a270-029fa5f68dab'), owner=OwnerMeta(userid='612b95e36fbf45b89d71692f2d2b07fe', username='tempest-TestVolumeBackupRestore-470869986-project-member', projectid='4b45911f3ec540eeaccc5f67ba824c82', projectname='tempest-TestVolumeBackupRestore-470869986'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534382.621112) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:26:22.623520 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:26:22.623520 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:26:22.624350 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:26:22.624582 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:26:22.625502 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:26:22.625811 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:26:22.625952 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:26:22.626047 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:26:22.626212 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:26:22.626315 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:26:22.626394 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:26:22.626555 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:26:22.626652 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:26:22.626774 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:26:22.626877 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:26:22.626987 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:26:22.636962 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:26:22.637313 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:26:22.637453 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:26:22.637828 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:26:22.638026 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:26:22.653292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:26:22.653845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:26:22.654217 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:26:22.654426 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:26:22.654743 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:26:22.654937 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:26:22.668816 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:26:22.668816 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:22.679235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:26:22.679235 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391] added
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:22.684333 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:22.684595 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:26:22.684711 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:26:22.684889 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391] added
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:26:22.690365 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:22.690633 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:26:22.690707 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:26:22.690954 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:26:23.026095 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Took 9.92 seconds to spawn the instance on the hypervisor.
Jun 27 04:26:23.026095 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:23.064305 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:26:23.536486 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Took 16.93 seconds to build instance.
Jun 27 04:26:23.687519 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:26:23.692647 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:26:23.702732 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:26:23.717106 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.719521 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.735368 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.747844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.747844 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.747844 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.747844 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.747844 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.747844 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:23.748043 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.748043 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.748043 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.748043 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.748043 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.748043 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:23.757943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.757943 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.757943 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.757943 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.757943 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.757943 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:23.758278 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.758278 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.758278 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.758278 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.758278 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.758278 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:23.788188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.40.100,3260]
Jun 27 04:26:23.788188 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.40.100,3260] successful.
Jun 27 04:26:23.788188 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.803306 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.817885 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.50.100,3260]
Jun 27 04:26:23.817885 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.50.100,3260] successful.
Jun 27 04:26:23.817885 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.823693 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.823906 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:23.824203 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:26:23.824336 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:26:23.825239 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] HCTL ('12', '-', '-', 0) found on session 214 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:26:23.825372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:26:23.833162 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:26:23.849308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Searching for a device in session 214 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:26:23.849308 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.853751 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1de65d57-405d-4cfc-8dca-a5aec82d0692 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:26:23.854013 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:26:23.854384 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:26:23.854536 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:26:23.855568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] HCTL ('13', '-', '-', 0) found on session 215 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:26:23.855651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:26:23.870196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Searching for a device in session 215 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:26:23.870196 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:26:24.037992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-5296d1f7-1524-4959-96a6-7e485bc22084 tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.437s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:24.656361 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:26:24.939061 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:25.358546 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-changed-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:25.359003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Refreshing instance network info cache due to event network-changed-6e72dd5b-b536-4398-a718-af4dca920f30. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:25.359214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] Acquiring lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:25.359353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] Acquired lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:25.359459 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Refreshing network info cache for port 6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:25.672572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Found WWN 330000000a00e3966 for multipath device dm-6 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:26:25.672855 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:26:25.673050 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000a00e3966', 'path': '/dev/dm-6', 'multipath_id': '330000000a00e3966'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:26:25.673185 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a00e3966', 'path': '/dev/dm-6', 'multipath_id': '330000000a00e3966'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:26:25.861920 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:26.180746 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-2109434309',display_name='tempest-TestVolumeBackupRestore-server-2109434309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebackuprestore-server-2109434309',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRBHN3nyFxWI36qbnrh5BG8VKQyRl8pefCDq8rZYMsJAe7feMuh9Y6UwXdCoLj1mLgXwq90LMZ9vMwBoPe49Gn7yuNcP1zWe+VTmstMHhrACKh6hZ0AAmLdssqxBkzgmg==',key_name='tempest-TestVolumeBackupRestore-235569983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b45911f3ec540eeaccc5f67ba824c82',ramdisk_id='',reservation_id='r-erogvrj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-470869986',owner_user_name='tempest-TestVolumeBackupRestore-470869986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:26:20Z,user_data=None,user_id='612b95e36fbf45b89d71692f2d2b07fe',uuid=ac1e225d-153e-4b05-a270-029fa5f68dab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:26:26.181280 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Converting VIF {"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:26:26.181664 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:26:26.182559 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lazy-loading 'pci_devices' on Instance uuid ac1e225d-153e-4b05-a270-029fa5f68dab {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:26:26.201156 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:26.333263 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updated VIF entry in instance network info cache for port 6e72dd5b-b536-4398-a718-af4dca920f30. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:26:26.333653 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updating instance_info_cache with network_info: [{"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <uuid>ac1e225d-153e-4b05-a270-029fa5f68dab</uuid>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <name>instance-0000004e</name>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:name>tempest-TestVolumeBackupRestore-server-2109434309</nova:name>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:26:22</nova:creationTime>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:image uuid="">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:user uuid="612b95e36fbf45b89d71692f2d2b07fe">tempest-TestVolumeBackupRestore-470869986-project-member</nova:user>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:project uuid="4b45911f3ec540eeaccc5f67ba824c82">tempest-TestVolumeBackupRestore-470869986</nova:project>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:root type="volume" uuid=""/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         <nova:port uuid="f66e95b9-5f83-4c5b-8c09-006e98b444ba">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <entry name="serial">ac1e225d-153e-4b05-a270-029fa5f68dab</entry>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <entry name="uuid">ac1e225d-153e-4b05-a270-029fa5f68dab</entry>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab/disk.config"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <alias name="ua-bdc4caf0-3341-4999-86f6-cdc182f1f391"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-6"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <serial>bdc4caf0-3341-4999-86f6-cdc182f1f391</serial>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:9f:f4:0c"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <target dev="tapf66e95b9-5f"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab/console.log" append="off"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:26:26.685416 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:26:26.687397 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Preparing to wait for external event network-vif-plugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:26:26.687397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:26.687397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:26.687397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:26.687397 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-2109434309',display_name='tempest-TestVolumeBackupRestore-server-2109434309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebackuprestore-server-2109434309',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRBHN3nyFxWI36qbnrh5BG8VKQyRl8pefCDq8rZYMsJAe7feMuh9Y6UwXdCoLj1mLgXwq90LMZ9vMwBoPe49Gn7yuNcP1zWe+VTmstMHhrACKh6hZ0AAmLdssqxBkzgmg==',key_name='tempest-TestVolumeBackupRestore-235569983',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b45911f3ec540eeaccc5f67ba824c82',ramdisk_id='',reservation_id='r-erogvrj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-470869986',owner_user_name='tempest-TestVolumeBackupRestore-470869986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:26:20Z,user_data=None,user_id='612b95e36fbf45b89d71692f2d2b07fe',uuid=ac1e225d-153e-4b05-a270-029fa5f68dab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:26:26.687397 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Converting VIF {"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:26:26.687670 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:26:26.687932 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:26:26.688318 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.688599 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:26.688858 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:26:26.689490 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.689672 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e44a53a-f9da-5859-95d9-8c48849e2dbc', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:26.690471 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.691112 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:26:26.691346 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.693851 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.694054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf66e95b9-5f, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:26.694392 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf66e95b9-5f, col_values=(('qos', UUID('4518b11a-9fbe-492a-997c-c7a5f1d177f4')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:26.694590 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf66e95b9-5f, col_values=(('external_ids', {'iface-id': 'f66e95b9-5f83-4c5b-8c09-006e98b444ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:f4:0c', 'vm-uuid': 'ac1e225d-153e-4b05-a270-029fa5f68dab'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:26:26.695332 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.696646 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:26:26.700955 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:26.702025 np0000003830 nova-compute[98984]: INFO os_vif [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f')
Jun 27 04:26:26.835749 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-07722265-1a18-4075-bbb7-60211bb288ac req-21f91c29-270e-4b07-8d55-5955dbc82009 service nova] Releasing lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:28.222833 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:26:28.223317 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:26:28.223317 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] No VIF found with MAC fa:16:3e:9f:f4:0c, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:26:28.223559 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Using config drive
Jun 27 04:26:28.728347 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:28.848838 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Creating config drive at /opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab/disk.config
Jun 27 04:26:28.852380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjkm7kkeq {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:26:28.908677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjkm7kkeq" returned: 0 in 0.056s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:26:29.316933 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.338528 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.340693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.438593 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.536721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3384fdfd-18df-4448-a5d9-26fbe6422a53 req-d8393064-f795-42c4-b0ee-3b40e9f46230 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-plugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:29.536918 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3384fdfd-18df-4448-a5d9-26fbe6422a53 req-d8393064-f795-42c4-b0ee-3b40e9f46230 service nova] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:29.537246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3384fdfd-18df-4448-a5d9-26fbe6422a53 req-d8393064-f795-42c4-b0ee-3b40e9f46230 service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:29.537440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3384fdfd-18df-4448-a5d9-26fbe6422a53 req-d8393064-f795-42c4-b0ee-3b40e9f46230 service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:29.537697 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3384fdfd-18df-4448-a5d9-26fbe6422a53 req-d8393064-f795-42c4-b0ee-3b40e9f46230 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Processing event network-vif-plugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:26:29.692958 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.696173 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.704641 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.714295 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.728492 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:29.939836 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:30.126212 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534390.1258016, ac1e225d-153e-4b05-a270-029fa5f68dab => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:26:30.126333 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] VM Started (Lifecycle Event)
Jun 27 04:26:30.127959 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:26:30.131823 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:26:30.134688 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Instance spawned successfully.
Jun 27 04:26:30.136256 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:26:30.629218 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:30.631936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:26:30.644774 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:30.644912 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:30.645228 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:30.645469 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:30.645750 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:30.646016 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:26:31.134388 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:26:31.134682 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534391.1344821, ac1e225d-153e-4b05-a270-029fa5f68dab => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:26:31.134811 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] VM Paused (Lifecycle Event)
Jun 27 04:26:31.153545 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Took 8.54 seconds to spawn the instance on the hypervisor.
Jun 27 04:26:31.153545 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:31.593835 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-83df3b6d-62d7-4944-9ff9-b240da83c24e req-fa073dea-65a6-400d-aec5-6ebf077ef6fe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-plugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:31.594058 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83df3b6d-62d7-4944-9ff9-b240da83c24e req-fa073dea-65a6-400d-aec5-6ebf077ef6fe service nova] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:31.594441 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83df3b6d-62d7-4944-9ff9-b240da83c24e req-fa073dea-65a6-400d-aec5-6ebf077ef6fe service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:31.594615 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-83df3b6d-62d7-4944-9ff9-b240da83c24e req-fa073dea-65a6-400d-aec5-6ebf077ef6fe service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:31.594779 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-83df3b6d-62d7-4944-9ff9-b240da83c24e req-fa073dea-65a6-400d-aec5-6ebf077ef6fe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] No waiting events found dispatching network-vif-plugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:26:31.595003 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-83df3b6d-62d7-4944-9ff9-b240da83c24e req-fa073dea-65a6-400d-aec5-6ebf077ef6fe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received unexpected event network-vif-plugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba for instance with vm_state active and task_state None.
Jun 27 04:26:31.637676 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:31.640425 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534391.6400418, ac1e225d-153e-4b05-a270-029fa5f68dab => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:26:31.640665 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] VM Resumed (Lifecycle Event)
Jun 27 04:26:31.663484 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Took 15.54 seconds to build instance.
Jun 27 04:26:31.696281 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:32.143094 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:26:32.145045 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:26:32.165384 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.044s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:33.528923 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:33.529458 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing instance network info cache due to event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:33.529683 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] Acquiring lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:33.529819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] Acquired lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:33.529990 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:34.032478 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:34.117529 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:34.117843 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing instance network info cache due to event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:34.117979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] Acquiring lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:34.351490 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:34.470094 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updated VIF entry in instance network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:26:34.470330 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:34.830464 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:34.830930 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:34.830930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=98984) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 27 04:26:34.941867 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:34.972082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d1fd1741-9bf3-4b31-93f5-b9c71727fe4a req-017f6dbe-80fb-4f19-a6c0-89ddd8400e0b service nova] Releasing lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:34.972407 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] Acquired lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:34.972561 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:35.332825 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:35.474959 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:35.787638 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:35.942841 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updated VIF entry in instance network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:26:35.943253 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:36.170352 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:36.170615 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing instance network info cache due to event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:36.170750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] Acquiring lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:36.445072 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2e573abc-e6a6-48ea-b10b-3cc45a7290d6 req-8dd7eae1-49aa-4640-ac5c-6576dfa210e1 service nova] Releasing lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:36.445463 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] Acquired lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:36.445668 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:36.698216 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:36.947919 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:37.245261 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:37.373559 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updated VIF entry in instance network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:26:37.373866 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:26:37.876021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-c444e0a8-39c5-4737-9754-f49e876b3954 req-d0686d60-0cbf-43d8-b268-96913419a9b8 service nova] Releasing lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:26:38.332364 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:38.836892 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:38.837050 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:38.837110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:38.837261 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:26:39.860009 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:26:39.862881 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:26:39.865293 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:26:39.867341 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:26:39.869629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:26:39.921877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:26:39.922252 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=50646MB free_disk=71.78656005859375GB free_vcpus=13 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:26:39.922383 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:39.922664 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:39.946643 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:40.981973 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance ee509af0-f4aa-4d61-a722-f76bd060bd50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:26:40.982344 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 6a817056-577a-4a52-bbcc-e6f2e16a9889 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:26:40.982344 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance ac1e225d-153e-4b05-a270-029fa5f68dab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:26:40.982344 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 3 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:26:40.982446 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=1088MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:26:39 up 49 min,  2 users,  load average: 2.93, 4.30, 5.15\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_b5f5e61c86084bb88ca7c2f090e48ba9': '2', 'io_workload': '0', 'num_proj_4b45911f3ec540eeaccc5f67ba824c82': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:26:41.138693 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:26:41.138940 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:26:41.641901 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:26:41.699743 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:42.149381 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:26:42.149840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.227s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:42.150008 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:42.647788 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:42.648137 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.18 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:42.830192 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:42.830600 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:44.945923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:45.830682 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:45.831010 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:46.700929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:46.826697 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:46.827146 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:46.830026 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:46.830415 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:46.830415 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:26:46.830686 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:49.948818 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:51.701740 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:51.830582 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:26:52.332236 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 14.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:26:54.951216 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:56.704266 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:59.207520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:26:59.207520 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing instance network info cache due to event network-changed-f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:26:59.207520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] Acquiring lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:26:59.207520 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] Acquired lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:26:59.207520 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Refreshing network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:26:59.705175 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:26:59.766399 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:59.766399 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:59.766618 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:26:59.766671 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:26:59.766803 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:26:59.768624 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Terminating instance
Jun 27 04:26:59.951838 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:26:59.976901 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:00.111275 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updated VIF entry in instance network info cache for port f66e95b9-5f83-4c5b-8c09-006e98b444ba. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:27:00.111595 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [{"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:00.271863 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:27:00.291091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:00.295304 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:00.313194 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:00.314590 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:00.332850 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:00.426292 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca8e5423-fee4-4e36-a839-18123066eb34 req-0d17bfe8-8e4c-4e8f-94f4-a2eceed1236b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-unplugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:00.426509 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca8e5423-fee4-4e36-a839-18123066eb34 req-0d17bfe8-8e4c-4e8f-94f4-a2eceed1236b service nova] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:00.426778 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca8e5423-fee4-4e36-a839-18123066eb34 req-0d17bfe8-8e4c-4e8f-94f4-a2eceed1236b service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:00.426927 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ca8e5423-fee4-4e36-a839-18123066eb34 req-0d17bfe8-8e4c-4e8f-94f4-a2eceed1236b service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:00.427116 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca8e5423-fee4-4e36-a839-18123066eb34 req-0d17bfe8-8e4c-4e8f-94f4-a2eceed1236b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] No waiting events found dispatching network-vif-unplugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:00.427567 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ca8e5423-fee4-4e36-a839-18123066eb34 req-0d17bfe8-8e4c-4e8f-94f4-a2eceed1236b service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-unplugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:27:00.601331 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999707482999838 future=<Future at 0x7ec5382c0b90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:00.601967 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999054781999803 future=<Future at 0x7ec5382c0b90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:00.602206 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998778697000034 future=<Future at 0x7ec5382c0b90 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:00.603125 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Instance destroyed successfully.
Jun 27 04:27:00.603624 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lazy-loading 'resources' on Instance uuid ac1e225d-153e-4b05-a270-029fa5f68dab {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:27:00.613558 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6bd64c34-d19e-4e4e-97dc-d66a0a675269 req-54ddc13c-4795-4cf8-81e0-3518a4df137e service nova] Releasing lock "refresh_cache-ac1e225d-153e-4b05-a270-029fa5f68dab" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:27:01.105950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-2109434309',display_name='tempest-TestVolumeBackupRestore-server-2109434309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebackuprestore-server-2109434309',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRBHN3nyFxWI36qbnrh5BG8VKQyRl8pefCDq8rZYMsJAe7feMuh9Y6UwXdCoLj1mLgXwq90LMZ9vMwBoPe49Gn7yuNcP1zWe+VTmstMHhrACKh6hZ0AAmLdssqxBkzgmg==',key_name='tempest-TestVolumeBackupRestore-235569983',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:26:31Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b45911f3ec540eeaccc5f67ba824c82',ramdisk_id='',reservation_id='r-erogvrj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-470869986',owner_user_name='tempest-TestVolumeBackupRestore-470869986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:26:31Z,user_data=None,user_id='612b95e36fbf45b89d71692f2d2b07fe',uuid=ac1e225d-153e-4b05-a270-029fa5f68dab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:27:01.106200 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Converting VIF {"id": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "address": "fa:16:3e:9f:f4:0c", "network": {"id": "0241910c-30b6-4d4b-ad8b-353ce1283e91", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-310983917-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b45911f3ec540eeaccc5f67ba824c82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf66e95b9-5f", "ovs_interfaceid": "f66e95b9-5f83-4c5b-8c09-006e98b444ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:27:01.106752 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:27:01.106964 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:27:01.108809 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:01.109104 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf66e95b9-5f, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:01.110270 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:01.111087 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:01.111889 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:01.112044 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4518b11a-9fbe-492a-997c-c7a5f1d177f4) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:01.112561 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:01.112987 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:01.113032 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:01.114533 np0000003830 nova-compute[98984]: INFO os_vif [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:f4:0c,bridge_name='br-int',has_traffic_filtering=True,id=f66e95b9-5f83-4c5b-8c09-006e98b444ba,network=Network(0241910c-30b6-4d4b-ad8b-353ce1283e91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf66e95b9-5f')
Jun 27 04:27:01.116260 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:27:01.116609 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:27:01.116749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:27:01.117063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:27:01.117377 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bdc4caf0-3341-4999-86f6-cdc182f1f391', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:27:01.117586 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:27:01.145164 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391 (non-flash)
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', '214'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', '215')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', '214')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391', '215')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518774680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'): ({'sdh'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Removing multipathed devices sdh, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:27:01.153237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Flush multipath device 330000000a00e3966 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:27:01.200849 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:27:01.258980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:27:01.305894 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:27:01.306257 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:27:01.307237 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:27:01.318649 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:27:01.318844 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:27:01.329382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:01.367557 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.40.100,3260]
Jun 27 04:27:01.367557 np0000003830 nova-compute[98984]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.40.100,3260] successful.
Jun 27 04:27:01.367557 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:01.382491 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:01.394188 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:01.425343 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.50.100,3260]
Jun 27 04:27:01.425343 np0000003830 nova-compute[98984]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-bdc4caf0-3341-4999-86f6-cdc182f1f391, portal: 192.168.50.100,3260] successful.
Jun 27 04:27:01.425343 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:01.438475 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:01.438711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:27:01.438833 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] <== disconnect_volume: return (322ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:27:01.438936 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:27:01.439206 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Deleting instance files /opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab_del
Jun 27 04:27:01.439675 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Deletion of /opt/stack/data/nova/instances/ac1e225d-153e-4b05-a270-029fa5f68dab_del complete
Jun 27 04:27:01.946713 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Took 1.67 seconds to destroy the instance on the hypervisor.
Jun 27 04:27:01.947417 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:27:01.947721 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:27:01.947851 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:27:01.948082 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:01.984591 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-changed-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:01.985159 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Refreshing instance network info cache due to event network-changed-6e72dd5b-b536-4398-a718-af4dca920f30. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:27:01.985225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] Acquiring lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:27:01.985366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] Acquired lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:27:01.985480 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Refreshing network info cache for port 6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:27:02.065970 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:02.479617 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-unplugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:02.479962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] Acquiring lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:02.479962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:02.480082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:02.480108 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] No waiting events found dispatching network-vif-unplugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:02.480207 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-unplugged-f66e95b9-5f83-4c5b-8c09-006e98b444ba for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:27:02.480301 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Received event network-vif-deleted-f66e95b9-5f83-4c5b-8c09-006e98b444ba {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:02.480408 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Neutron deleted interface f66e95b9-5f83-4c5b-8c09-006e98b444ba; detaching it from the instance and deleting it from the info cache
Jun 27 04:27:02.482127 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-852b1fd4-53ed-43f5-aa61-db3dade15e1e req-0ed53026-4469-4e1d-b267-f1b82528ecbe service nova] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Detach interface failed, port_id=f66e95b9-5f83-4c5b-8c09-006e98b444ba, reason: Instance ac1e225d-153e-4b05-a270-029fa5f68dab could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:27:02.487747 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:02.515345 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:02.516107 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:02.517451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:02.517451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:02.517451 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:02.518358 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Terminating instance
Jun 27 04:27:02.786387 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:02.795211 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:02.983910 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updated VIF entry in instance network info cache for port 6e72dd5b-b536-4398-a718-af4dca920f30. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:27:02.984258 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updating instance_info_cache with network_info: [{"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:03.021459 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:27:03.036191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.038644 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.054799 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.165613 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-58038cea-f1cf-4c42-8dc9-4ea548ec6e57 req-f10c48dc-5093-41a5-8797-fad309bd7291 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-unplugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:03.166279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-58038cea-f1cf-4c42-8dc9-4ea548ec6e57 req-f10c48dc-5093-41a5-8797-fad309bd7291 service nova] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:03.166279 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-58038cea-f1cf-4c42-8dc9-4ea548ec6e57 req-f10c48dc-5093-41a5-8797-fad309bd7291 service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:03.166442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-58038cea-f1cf-4c42-8dc9-4ea548ec6e57 req-f10c48dc-5093-41a5-8797-fad309bd7291 service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:03.166597 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-58038cea-f1cf-4c42-8dc9-4ea548ec6e57 req-f10c48dc-5093-41a5-8797-fad309bd7291 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] No waiting events found dispatching network-vif-unplugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:03.166729 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-58038cea-f1cf-4c42-8dc9-4ea548ec6e57 req-f10c48dc-5093-41a5-8797-fad309bd7291 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-unplugged-6e72dd5b-b536-4398-a718-af4dca920f30 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:27:03.196469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.201661 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.297182 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Took 1.35 seconds to deallocate network for instance.
Jun 27 04:27:03.337084 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999728211999809 future=<Future at 0x7ec51820f500 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:03.338580 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Instance destroyed successfully.
Jun 27 04:27:03.338920 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid 6a817056-577a-4a52-bbcc-e6f2e16a9889 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:27:03.486257 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cfb053e7-8b38-41a9-8dbf-8505d868495b req-30001045-2acb-4cd1-9640-38d7675ba816 service nova] Releasing lock "refresh_cache-6a817056-577a-4a52-bbcc-e6f2e16a9889" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:27:03.841332 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:26:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1999692114',display_name='tempest-TestVolumeBootPattern-server-1999692114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1999692114',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:26:23Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-l1m2nnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:26:23Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=6a817056-577a-4a52-bbcc-e6f2e16a9889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:27:03.842218 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "6e72dd5b-b536-4398-a718-af4dca920f30", "address": "fa:16:3e:c8:d3:7f", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e72dd5b-b5", "ovs_interfaceid": "6e72dd5b-b536-4398-a718-af4dca920f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:27:03.843083 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Took 0.55 seconds to detach 1 volumes for instance.
Jun 27 04:27:03.844115 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:27:03.844345 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:27:03.847391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.847601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e72dd5b-b5, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:03.848475 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.849640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:03.849736 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.850453 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.850649 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eef605b-2791-4807-b9c4-4c50ebe6557a) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:03.851298 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.851927 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:03.852023 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:03.853434 np0000003830 nova-compute[98984]: INFO os_vif [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:d3:7f,bridge_name='br-int',has_traffic_filtering=True,id=6e72dd5b-b536-4398-a718-af4dca920f30,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e72dd5b-b5')
Jun 27 04:27:03.855044 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:27:03.855291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:27:03.855420 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:27:03.886046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.031s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:27:03.886422 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '281f1ae5-0fc7-43eb-96e5-2aca3a990845', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:27:03.886664 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:27:03.908553 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:03.908553 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:03.908553 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:03.908553 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:03.908553 np0000003830 nova-compute[98984]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f889057-7896-43a5-bb89-059ae6e422dd (non-flash)
Jun 27 04:27:03.908553 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:03.908769 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:03.908769 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:03.908769 np0000003830 nova-compute[98984]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:03.908769 np0000003830 nova-compute[98984]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845 (non-flash)
Jun 27 04:27:03.908769 np0000003830 nova-compute[98984]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f889057-7896-43a5-bb89-059ae6e422dd (non-flash)
Jun 27 04:27:03.908769 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:03.908900 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f889057-7896-43a5-bb89-059ae6e422dd', '218')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:27:03.908959 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', '212')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:27:03.909745 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845', '211')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:27:03.910375 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5381dcf40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:27:03.910581 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sde, sdf {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:27:03.910780 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 330000000cdc4618e {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:27:03.980792 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:27:04.024898 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:27:04.072816 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:27:04.072987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:27:04.073988 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:27:04.085421 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:27:04.085687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:27:04.096481 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:04.130593 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.40.100,3260]
Jun 27 04:27:04.130593 np0000003830 nova-compute[98984]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.40.100,3260] successful.
Jun 27 04:27:04.130593 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:04.144017 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:04.156651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:04.185515 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.50.100,3260]
Jun 27 04:27:04.185515 np0000003830 nova-compute[98984]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-281f1ae5-0fc7-43eb-96e5-2aca3a990845, portal: 192.168.50.100,3260] successful.
Jun 27 04:27:04.185515 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:04.198086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:04.198355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:27:04.198572 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (342ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:27:04.198759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:27:04.199064 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Deleting instance files /opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889_del
Jun 27 04:27:04.199689 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Deletion of /opt/stack/data/nova/instances/6a817056-577a-4a52-bbcc-e6f2e16a9889_del complete
Jun 27 04:27:04.349404 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:04.349597 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:04.638942 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:27:04.639420 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:27:04.706907 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Took 1.69 seconds to destroy the instance on the hypervisor.
Jun 27 04:27:04.708232 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:27:04.708574 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:27:04.708671 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:27:04.708870 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:04.765694 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:04.952343 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:05.022037 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-30701b49-d699-44c4-94c4-f86247a4179d req-1138f960-b06b-4b9f-bad0-b21f7fe759d0 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-deleted-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:05.022450 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-30701b49-d699-44c4-94c4-f86247a4179d req-1138f960-b06b-4b9f-bad0-b21f7fe759d0 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Neutron deleted interface 6e72dd5b-b536-4398-a718-af4dca920f30; detaching it from the instance and deleting it from the info cache
Jun 27 04:27:05.024091 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-30701b49-d699-44c4-94c4-f86247a4179d req-1138f960-b06b-4b9f-bad0-b21f7fe759d0 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Detach interface failed, port_id=6e72dd5b-b536-4398-a718-af4dca920f30, reason: Instance 6a817056-577a-4a52-bbcc-e6f2e16a9889 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:27:05.142195 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:27:05.218313 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6dbed55d-f0e7-420d-bee9-a6fd25ab3af5 req-6c644182-63cc-4422-92b0-890e9b7a7905 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-unplugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:05.218458 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6dbed55d-f0e7-420d-bee9-a6fd25ab3af5 req-6c644182-63cc-4422-92b0-890e9b7a7905 service nova] Acquiring lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:05.221203 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6dbed55d-f0e7-420d-bee9-a6fd25ab3af5 req-6c644182-63cc-4422-92b0-890e9b7a7905 service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:05.221329 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6dbed55d-f0e7-420d-bee9-a6fd25ab3af5 req-6c644182-63cc-4422-92b0-890e9b7a7905 service nova] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:05.221458 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6dbed55d-f0e7-420d-bee9-a6fd25ab3af5 req-6c644182-63cc-4422-92b0-890e9b7a7905 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] No waiting events found dispatching network-vif-unplugged-6e72dd5b-b536-4398-a718-af4dca920f30 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:05.221591 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6dbed55d-f0e7-420d-bee9-a6fd25ab3af5 req-6c644182-63cc-4422-92b0-890e9b7a7905 service nova] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Received event network-vif-unplugged-6e72dd5b-b536-4398-a718-af4dca920f30 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:27:05.476031 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:05.648347 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.299s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:05.694070 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Deleted allocations for instance ac1e225d-153e-4b05-a270-029fa5f68dab
Jun 27 04:27:05.978086 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Took 1.27 seconds to deallocate network for instance.
Jun 27 04:27:06.332122 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:06.332233 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 27 04:27:06.530878 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Took 0.55 seconds to detach 1 volumes for instance.
Jun 27 04:27:06.702183 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7a0f516b-8268-4a9f-a231-fa6d2499d904 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Lock "ac1e225d-153e-4b05-a270-029fa5f68dab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.936s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:06.834040 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] There are 0 instances to clean {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 27 04:27:06.834300 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 28.49 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:07.036207 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:07.036385 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:07.154711 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:27:07.154951 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:27:07.658783 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:27:08.165412 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.129s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:08.216162 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance 6a817056-577a-4a52-bbcc-e6f2e16a9889
Jun 27 04:27:08.858290 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:09.224830 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3c4cb745-d049-4a06-ad3b-5f6c93a8192d tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "6a817056-577a-4a52-bbcc-e6f2e16a9889" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.709s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:10.511805 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:11.179156 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:11.633424 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-changed-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:11.633928 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Refreshing instance network info cache due to event network-changed-d074e270-6342-4038-a479-ef2007286b73. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:27:11.633928 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] Acquiring lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:27:11.633928 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] Acquired lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:27:11.634141 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Refreshing network info cache for port d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:27:12.137663 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:12.168610 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:12.168791 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:12.168979 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:12.169137 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:12.169266 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:12.171341 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Terminating instance
Jun 27 04:27:12.334349 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.450460 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:12.571013 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updated VIF entry in instance network info cache for port d074e270-6342-4038-a479-ef2007286b73. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:27:12.571231 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updating instance_info_cache with network_info: [{"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:12.674540 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:27:12.692559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.695166 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.709323 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.720025 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.740750 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.974073 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:12.981091 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:13.000023 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999696603000302 future=<Future at 0x7ec538180200 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:13.002213 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Instance destroyed successfully.
Jun 27 04:27:13.002728 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lazy-loading 'resources' on Instance uuid ee509af0-f4aa-4d61-a722-f76bd060bd50 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:27:13.073098 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-24605b1d-274c-4086-8db6-9d7842572903 req-fcbcdd9c-3f97-4ba9-95ae-f7857d81dc80 service nova] Releasing lock "refresh_cache-ee509af0-f4aa-4d61-a722-f76bd060bd50" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:27:13.505076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1586654133',display_name='tempest-TestVolumeBootPattern-server-1586654133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-testvolumebootpattern-server-1586654133',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAk6jGnu2YDCN4ZKCWuTuP50lYVFL9E3Ox/YalgGYTJqIE0e7lHMgZ2dZlqhECPt4KD4Il0ADouz8Tq+oSGf8Q9VvYF9+1uIIAMjDEhfXbse2k/PmyH5TGYNYLoB/hCfA==',key_name='tempest-TestVolumeBootPattern-954079244',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:25:22Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f5e61c86084bb88ca7c2f090e48ba9',ramdisk_id='',reservation_id='r-i2gmbdbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1983529732',owner_user_name='tempest-TestVolumeBootPattern-1983529732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:25:22Z,user_data=None,user_id='d8f26454c3434b0d86ba862b622c839f',uuid=ee509af0-f4aa-4d61-a722-f76bd060bd50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:27:13.505281 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converting VIF {"id": "d074e270-6342-4038-a479-ef2007286b73", "address": "fa:16:3e:fc:68:70", "network": {"id": "b85b762a-1594-457d-8ce7-11fd814cc993", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1157359585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b5f5e61c86084bb88ca7c2f090e48ba9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd074e270-63", "ovs_interfaceid": "d074e270-6342-4038-a479-ef2007286b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:27:13.505847 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:27:13.506067 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:27:13.506964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:13.507209 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd074e270-63, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:13.508134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:13.509159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:13.509688 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:13.509843 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e79e1710-dd12-4df2-97f2-c6867b1b8034) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:13.510539 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:13.510863 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:13.512797 np0000003830 nova-compute[98984]: INFO os_vif [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:68:70,bridge_name='br-int',has_traffic_filtering=True,id=d074e270-6342-4038-a479-ef2007286b73,network=Network(b85b762a-1594-457d-8ce7-11fd814cc993),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd074e270-63')
Jun 27 04:27:13.514440 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:27:13.514711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:27:13.514818 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:27:13.515278 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:27:13.515400 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd9f6e1d4-3a31-458d-9f25-52978d296ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:27:13.515531 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:27:13.537457 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:13.537457 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:13.537457 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:13.537630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsi session list stdout=tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:13.537630 np0000003830 nova-compute[98984]: tcp: [207] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8 (non-flash)
Jun 27 04:27:13.537630 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:13.537714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:27:13.537809 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '206')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:27:13.538524 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8', '207')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:27:13.539158 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181939c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:27:13.539304 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:27:13.539504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Flush multipath device 33000000089b386f0 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:27:13.614746 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:27:13.658084 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:27:13.690626 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-unplugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:13.691442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:13.691667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:13.691823 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:13.691989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] No waiting events found dispatching network-vif-unplugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:13.692112 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-unplugged-d074e270-6342-4038-a479-ef2007286b73 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:27:13.692214 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-unplugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:13.692324 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] Acquiring lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:13.692440 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:13.692580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:13.692682 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] No waiting events found dispatching network-vif-unplugged-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:13.692857 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a237921f-a752-4e1c-be23-69171734bdec req-f093419d-ecc9-4bd2-bcaa-309d4301d571 service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-unplugged-d074e270-6342-4038-a479-ef2007286b73 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:27:13.709864 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:27:13.710051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:27:13.710630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:27:13.721215 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:27:13.721414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:27:13.732792 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:13.762606 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260]
Jun 27 04:27:13.762606 np0000003830 nova-compute[98984]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.40.100,3260] successful.
Jun 27 04:27:13.762606 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:13.773134 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:13.783172 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:13.813558 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260]
Jun 27 04:27:13.813558 np0000003830 nova-compute[98984]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-d9f6e1d4-3a31-458d-9f25-52978d296ff8, portal: 192.168.50.100,3260] successful.
Jun 27 04:27:13.813558 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:13.824474 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:13.824691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:27:13.824813 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] <== disconnect_volume: return (310ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:27:13.824926 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:27:13.825176 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Deleting instance files /opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50_del
Jun 27 04:27:13.825640 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Deletion of /opt/stack/data/nova/instances/ee509af0-f4aa-4d61-a722-f76bd060bd50_del complete
Jun 27 04:27:14.331175 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Took 1.66 seconds to destroy the instance on the hypervisor.
Jun 27 04:27:14.331665 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:27:14.331926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:27:14.332036 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:27:14.332241 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:14.432551 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:15.181664 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:15.601371 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00036437500011743396 future=<Future at 0x7ec5382c0b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:15.601806 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782534420.6008923, ac1e225d-153e-4b05-a270-029fa5f68dab => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:27:15.601965 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:15.602269 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] VM Stopped (Lifecycle Event)
Jun 27 04:27:15.602390 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.7343779560001167 future=<Future at 0x7ec51820f500 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:15.603385 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=2.7333972520000316 future=<Future at 0x7ec51820f500 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:15.683894 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Took 1.35 seconds to deallocate network for instance.
Jun 27 04:27:15.747917 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-65802b5e-50d4-4d02-b777-4ae54766b12c req-2674a376-83aa-42ba-bae8-1e7c9fcbd8eb service nova] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Received event network-vif-deleted-d074e270-6342-4038-a479-ef2007286b73 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:16.104886 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ac1e225d-153e-4b05-a270-029fa5f68dab] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:16.229691 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Took 0.55 seconds to detach 1 volumes for instance.
Jun 27 04:27:16.734400 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:16.734578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:16.818996 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:27:16.819253 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:27:17.321628 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:27:17.828108 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.094s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:17.871784 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Deleted allocations for instance ee509af0-f4aa-4d61-a722-f76bd060bd50
Jun 27 04:27:18.337098 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003092450001531688 future=<Future at 0x7ec51820f500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:18.337405 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] Emitting event <LifecycleEvent: 1782534423.33671, 6a817056-577a-4a52-bbcc-e6f2e16a9889 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:27:18.337559 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:18.337710 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] VM Stopped (Lifecycle Event)
Jun 27 04:27:18.338653 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.661043208000137 future=<Future at 0x7ec538180200 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:18.338782 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=9.660902308999994 future=<Future at 0x7ec538180200 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:18.514201 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:18.514353 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:18.514397 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:27:18.514469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:27:18.517413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:18.517587 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:27:18.840030 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-04bf595b-5e7c-4b97-a250-6177b6fc8b44 tempest-TestVolumeBackupRestore-470869986 tempest-TestVolumeBackupRestore-470869986-project-member] [instance: 6a817056-577a-4a52-bbcc-e6f2e16a9889] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:18.879172 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-e796b7e4-eff0-4acb-b8ef-a19ea84d780f tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Lock "ee509af0-f4aa-4d61-a722-f76bd060bd50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.710s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:21.563167 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:23.341141 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:23.518524 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:28.000511 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0007628769999428187 future=<Future at 0x7ec538180200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:28.000961 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:27:28.000961 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] Emitting event <LifecycleEvent: 1782534432.9996293, ee509af0-f4aa-4d61-a722-f76bd060bd50 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:27:28.001130 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] VM Stopped (Lifecycle Event)
Jun 27 04:27:28.503629 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-9aeb11fe-b683-4a62-aae2-8300c3b94e8a tempest-TestVolumeBootPattern-1983529732 tempest-TestVolumeBootPattern-1983529732-project-member] [instance: ee509af0-f4aa-4d61-a722-f76bd060bd50] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:28.518849 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:28.519076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:28.519161 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:27:28.519225 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:27:28.530962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:28.531197 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:27:33.532710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:35.328527 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:35.329027 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:36.830155 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:36.830647 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:38.534103 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:38.830685 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:38.830685 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:39.054088 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:39.054280 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:39.334714 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:39.334874 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:39.335027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:39.335142 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:27:39.347999 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:27:39.348797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:39.397983 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:39.398361 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51516MB free_disk=71.74229049682617GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:27:39.398536 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:39.398791 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:39.556268 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:27:40.104305 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:40.948310 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 30aaefa4-e573-4318-8133-0d457cbf5357 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
Jun 27 04:27:40.948768 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:27:40.948768 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:27:39 up 50 min,  2 users,  load average: 3.31, 4.19, 5.06\n'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:27:41.000124 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Refreshing inventories for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 27 04:27:41.058925 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Updating ProviderTree inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 27 04:27:41.058925 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:27:41.101448 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Refreshing aggregate associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, aggregates: None {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 27 04:27:41.149178 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Refreshing trait associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, traits: HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_PPC64LE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NODE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 27 04:27:41.236598 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:27:41.236857 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:27:41.739469 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:27:42.247183 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:27:42.247666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.849s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:42.247666 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.144s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:42.247916 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:42.251784 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:27:42.251930 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Claim successful on node np0000003830
Jun 27 04:27:43.355836 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:27:43.356373 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:27:43.535382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:43.858484 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:27:44.364246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.117s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:44.364820 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:27:44.869959 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:27:44.870661 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:27:44.870661 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:44.870906 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:44.936340 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33faf65a5a584bc1acf8dee992884339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71c3cf0211646de852da0847561d67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:27:45.349716 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Successfully created port: b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:27:45.373402 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:27:45.776699 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Successfully updated port: b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:27:45.820556 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-changed-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:45.820980 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Refreshing instance network info cache due to event network-changed-b8ecf269-e68d-437e-a645-5392d429a39f. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:27:45.821197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] Acquiring lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:27:45.821330 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] Acquired lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:27:45.821510 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Refreshing network info cache for port b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:27:46.247662 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:46.247878 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:46.248117 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.58 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:46.278629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:27:46.323469 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:46.379384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:27:46.385382 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:27:46.507668 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:46.883256 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Booting with volume f3172ea7-d271-4476-a69a-b1c86457041e at /dev/vdb
Jun 27 04:27:46.916796 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:27:46.929124 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:27:46.948268 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:46.991270 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:27:46.991634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:27:46.999433 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:27:47.000459 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f'] 
Jun 27 04:27:47.000605 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:27:47.000755 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:27:47.001048 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:27:47.001324 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Updating existing volume attachment record: 3b7db226-2782-4f34-978f-f873076c8353 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:27:47.009575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-87c911fd-ac24-4375-8d30-d1577d13fefc req-bd53459c-30e3-4724-8351-42af70b0419b service nova] Releasing lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:27:47.010285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquired lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:27:47.010437 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:27:47.021659 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:47.568705 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:27:47.702625 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:47.825973 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Updating instance_info_cache with network_info: [{"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:27:47.827101 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:47.827400 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:47.829843 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:47.830089 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:48.328366 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Releasing lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:27:48.328653 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Instance network_info: |[{"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:27:48.537678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:48.830106 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:27:48.830588 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:27:48.830588 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:27:49.087384 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:27:49.088054 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:27:49.088291 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Creating image(s)
Jun 27 04:27:49.088710 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "/opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:49.088876 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "/opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:49.089290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "/opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:49.089816 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:27:49.092223 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:27:49.093027 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:49.175419 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.082s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:49.175969 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:49.176523 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:49.177101 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:27:49.179658 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:27:49.180101 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:49.271197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:49.271677 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:49.369212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk 1073741824" returned: 0 in 0.097s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:49.369742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:49.370154 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:49.477874 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.107s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:49.478375 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:27:49.478693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:49.561441 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:49.561891 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Cannot resize image /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:27:49.562404 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:27:49.562606 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Ensure instance console log exists: /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:27:49.562885 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:49.563099 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:49.563238 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:49.565386 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Start _get_guest_xml network_info=[{"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': -1, 'delete_on_termination': False, 'attachment_id': '3b7db226-2782-4f34-978f-f873076c8353', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '30aaefa4-e573-4318-8133-0d457cbf5357', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'serial': 'f3172ea7-d271-4476-a69a-b1c86457041e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:27:49.569743 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:27:49.571164 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-instance-234803072', uuid='30aaefa4-e573-4318-8133-0d457cbf5357'), owner=OwnerMeta(userid='33faf65a5a584bc1acf8dee992884339', username='tempest-VolumesBackupsTest-1575750835-project-member', projectid='f71c3cf0211646de852da0847561d67e', projectname='tempest-VolumesBackupsTest-1575750835'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534469.5708377) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:27:49.572157 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:27:49.572505 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:27:49.573393 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:27:49.573566 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:27:49.574487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:27:49.574816 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:27:49.574966 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:27:49.575052 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:27:49.575175 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:27:49.575270 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:27:49.575387 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:27:49.575556 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:27:49.575652 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:27:49.575753 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:27:49.575844 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:27:49.575964 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:27:49.586885 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:27:49.587234 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:27:49.587385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:27:49.587756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:27:49.587970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:27:49.600039 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:27:49.602229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:27:49.602229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:27:49.602229 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:27:49.602229 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:27:49.602229 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:27:49.612730 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:27:49.612730 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:49.625340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:27:49.625340 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e] added
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:27:49.626088 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:49.637372 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:27:49.637372 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:27:49.637372 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e] added
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:27:49.639551 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:49.639703 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:27:49.639904 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:27:49.640072 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:27:50.627070 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:27:50.639333 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:50.652235 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:27:50.652235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:27:50.656129 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:50.662417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:27:50.662417 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:50.662417 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:27:50.662417 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:50.662562 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:27:50.662562 np0000003830 nova-compute[98984]: 
Jun 27 04:27:50.668157 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:50.678492 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:27:50.678492 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:50.678617 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:27:50.678617 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:50.678713 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:27:50.678713 np0000003830 nova-compute[98984]: 
Jun 27 04:27:51.712650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.50.100,3260]
Jun 27 04:27:51.712650 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.50.100,3260] successful.
Jun 27 04:27:51.712650 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:51.712650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.40.100,3260]
Jun 27 04:27:51.712650 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.40.100,3260] successful.
Jun 27 04:27:51.712650 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:51.722482 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:51.726354 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:27:51.733274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.733274 np0000003830 nova-compute[98984]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.733274 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:51.733553 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.733553 np0000003830 nova-compute[98984]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.733553 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:51.733700 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.133s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:27:51.733873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:27:51.734392 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] HCTL ('7', '-', '-', 0) found on session 221 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:27:51.734528 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:27:51.738888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.738888 np0000003830 nova-compute[98984]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.738888 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:27:51.739153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.739153 np0000003830 nova-compute[98984]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:27:51.739153 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:27:51.739236 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.137s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:27:51.739310 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:27:51.739744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] HCTL ('8', '-', '-', 0) found on session 222 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:27:51.739839 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:27:51.755333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Searching for a device in session 221 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:27:51.755333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:27:51.755333 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Searching for a device in session 222 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:27:52.753095 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Searching for a device in session 222 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:27:52.753443 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:27:53.538775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:53.616808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Found WWN 330000000d7554920 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:27:53.617051 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:27:53.617211 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '330000000d7554920', 'path': '/dev/dm-0', 'multipath_id': '330000000d7554920'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:27:53.617319 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d7554920', 'path': '/dev/dm-0', 'multipath_id': '330000000d7554920'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:27:54.123186 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-234803072',display_name='tempest-instance-234803072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-instance-234803072',id=79,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLv0MxjUhoqE656EIGsFybgMgeSv+TyIzSmYjgORilhcoZYb5yxAoVqPkroSmLVMVb4mDGjhT1abt3Q4DvLbxMBFYQyShdFGmGUJPBYlFGYotp4zX5IgMemuwP7U1uThzQ==',key_name='tempest-keypair-1744168907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71c3cf0211646de852da0847561d67e',ramdisk_id='',reservation_id='r-6p94z11c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1575750835',owner_user_name='tempest-VolumesBackupsTest-1575750835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33faf65a5a584bc1acf8dee992884339',uuid=30aaefa4-e573-4318-8133-0d457cbf5357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:27:54.123641 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Converting VIF {"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:27:54.125087 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:27:54.125823 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lazy-loading 'pci_devices' on Instance uuid 30aaefa4-e573-4318-8133-0d457cbf5357 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <uuid>30aaefa4-e573-4318-8133-0d457cbf5357</uuid>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <name>instance-0000004f</name>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:name>tempest-instance-234803072</nova:name>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:27:49</nova:creationTime>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:user uuid="33faf65a5a584bc1acf8dee992884339">tempest-VolumesBackupsTest-1575750835-project-member</nova:user>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:project uuid="f71c3cf0211646de852da0847561d67e">tempest-VolumesBackupsTest-1575750835</nova:project>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         <nova:port uuid="b8ecf269-e68d-437e-a645-5392d429a39f">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <entry name="serial">30aaefa4-e573-4318-8133-0d457cbf5357</entry>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <entry name="uuid">30aaefa4-e573-4318-8133-0d457cbf5357</entry>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.config"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <disk type="block" device="disk">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <alias name="ua-f3172ea7-d271-4476-a69a-b1c86457041e"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <source dev="/dev/dm-0"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <target dev="vdb" bus="virtio"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <serial>f3172ea7-d271-4476-a69a-b1c86457041e</serial>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:15:f2:0b"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <target dev="tapb8ecf269-e6"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/console.log" append="off"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:27:54.628811 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Preparing to wait for external event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-234803072',display_name='tempest-instance-234803072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-instance-234803072',id=79,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLv0MxjUhoqE656EIGsFybgMgeSv+TyIzSmYjgORilhcoZYb5yxAoVqPkroSmLVMVb4mDGjhT1abt3Q4DvLbxMBFYQyShdFGmGUJPBYlFGYotp4zX5IgMemuwP7U1uThzQ==',key_name='tempest-keypair-1744168907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f71c3cf0211646de852da0847561d67e',ramdisk_id='',reservation_id='r-6p94z11c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1575750835',owner_user_name='tempest-VolumesBackupsTest-1575750835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33faf65a5a584bc1acf8dee992884339',uuid=30aaefa4-e573-4318-8133-0d457cbf5357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Converting VIF {"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:27:54.631336 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:27:54.631719 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.631986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:54.632324 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:27:54.632964 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.633139 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2125afaf-7665-57cf-b6fa-58c7c7d99246', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:54.633904 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.634710 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:54.635160 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.636600 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.636726 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8ecf269-e6, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:54.637107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8ecf269-e6, col_values=(('qos', UUID('5817ed6e-29d1-4052-9452-ce0dd1aa39bb')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:54.637295 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8ecf269-e6, col_values=(('external_ids', {'iface-id': 'b8ecf269-e68d-437e-a645-5392d429a39f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:f2:0b', 'vm-uuid': '30aaefa4-e573-4318-8133-0d457cbf5357'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:27:54.638066 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.639451 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:27:54.643264 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:54.644240 np0000003830 nova-compute[98984]: INFO os_vif [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6')
Jun 27 04:27:56.176972 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:27:56.177435 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:27:56.177435 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:27:56.177435 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] No VIF found with MAC fa:16:3e:15:f2:0b, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:27:56.177890 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Using config drive
Jun 27 04:27:56.682992 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:27:56.793609 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Creating config drive at /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.config
Jun 27 04:27:56.797415 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_4dw1466 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:27:56.861833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_4dw1466" returned: 0 in 0.064s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:27:57.248583 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.268879 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.271352 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.354895 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.358902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.414833 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-87adfedc-3fc3-4d0d-9f95-4a5b708beec6 req-97f54c26-03d2-431e-ba74-11e6f3bb3fa7 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:57.414833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-87adfedc-3fc3-4d0d-9f95-4a5b708beec6 req-97f54c26-03d2-431e-ba74-11e6f3bb3fa7 service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:57.414833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-87adfedc-3fc3-4d0d-9f95-4a5b708beec6 req-97f54c26-03d2-431e-ba74-11e6f3bb3fa7 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:57.414833 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-87adfedc-3fc3-4d0d-9f95-4a5b708beec6 req-97f54c26-03d2-431e-ba74-11e6f3bb3fa7 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:57.414833 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-87adfedc-3fc3-4d0d-9f95-4a5b708beec6 req-97f54c26-03d2-431e-ba74-11e6f3bb3fa7 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Processing event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:27:57.590288 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.591787 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.594075 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.610662 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:57.961683 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534477.9612415, 30aaefa4-e573-4318-8133-0d457cbf5357 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:27:57.962296 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:27:57.962488 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] VM Started (Lifecycle Event)
Jun 27 04:27:57.964452 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:27:57.966724 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Instance spawned successfully.
Jun 27 04:27:57.966999 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:27:58.465954 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:58.468033 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:27:58.473449 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:27:58.473617 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:27:58.473950 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:27:58.474220 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:27:58.474542 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:27:58.474857 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:27:58.972329 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:27:58.972669 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534478.9724154, 30aaefa4-e573-4318-8133-0d457cbf5357 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:27:58.972789 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] VM Paused (Lifecycle Event)
Jun 27 04:27:58.979754 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Took 9.89 seconds to spawn the instance on the hypervisor.
Jun 27 04:27:58.979936 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:59.464967 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04e86332-ac52-42a2-98cd-32597b7d2769 req-7cfab12a-7bec-47f9-935f-71e9e009ef6f service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:27:59.467551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04e86332-ac52-42a2-98cd-32597b7d2769 req-7cfab12a-7bec-47f9-935f-71e9e009ef6f service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:27:59.467551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04e86332-ac52-42a2-98cd-32597b7d2769 req-7cfab12a-7bec-47f9-935f-71e9e009ef6f service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:27:59.467551 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-04e86332-ac52-42a2-98cd-32597b7d2769 req-7cfab12a-7bec-47f9-935f-71e9e009ef6f service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:27:59.467551 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-04e86332-ac52-42a2-98cd-32597b7d2769 req-7cfab12a-7bec-47f9-935f-71e9e009ef6f service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:27:59.467551 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-04e86332-ac52-42a2-98cd-32597b7d2769 req-7cfab12a-7bec-47f9-935f-71e9e009ef6f service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received unexpected event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with vm_state active and task_state None.
Jun 27 04:27:59.476391 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:59.478602 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534479.4783049, 30aaefa4-e573-4318-8133-0d457cbf5357 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:27:59.478695 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] VM Resumed (Lifecycle Event)
Jun 27 04:27:59.489783 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Took 19.43 seconds to build instance.
Jun 27 04:27:59.639073 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:59.961576 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:27:59.980678 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:27:59.982754 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:27:59.991692 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-3dbae801-5b08-42d1-b993-2298d48c70f5 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.937s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:01.155723 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-changed-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:01.156124 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Refreshing instance network info cache due to event network-changed-b8ecf269-e68d-437e-a645-5392d429a39f. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:28:01.156304 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] Acquiring lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:28:01.156396 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] Acquired lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:28:01.156585 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Refreshing network info cache for port b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:28:01.659457 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:01.956661 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:02.076938 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Updated VIF entry in instance network info cache for port b8ecf269-e68d-437e-a645-5392d429a39f. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:28:02.077187 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Updating instance_info_cache with network_info: [{"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:28:02.579182 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-cbc726c0-ec93-4e3f-8aea-bfa6998adb16 req-eec19020-c42d-4806-bc1b-a5e1aa5cca96 service nova] Releasing lock "refresh_cache-30aaefa4-e573-4318-8133-0d457cbf5357" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:28:04.639887 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:04.976694 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:09.641565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:09.977659 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:14.642718 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:14.978134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:17.271755 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:19.643735 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:19.979830 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:20.046882 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:21.470934 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:23.800478 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:24.644700 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:24.982336 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:25.575946 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:29.069171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:29.069594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:29.571764 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:28:29.646616 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:29.989630 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:30.114992 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:30.115339 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:30.118342 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:28:30.118486 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Claim successful on node np0000003830
Jun 27 04:28:31.268948 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:28:31.269318 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:28:31.771609 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:28:32.277592 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.162s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:32.278048 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:28:32.784147 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:28:32.785185 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:28:32.785747 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:32.786090 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:32.852708 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb1df717762741e98e49392818229db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f485b436a624d14aafc66b1936fa4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:28:33.264712 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Successfully created port: 91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:28:33.285894 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:28:33.705275 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Successfully updated port: 91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:28:33.759410 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-changed-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:33.759887 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Refreshing instance network info cache due to event network-changed-91c4bcf9-214f-40eb-ae78-35d9fe4dee56. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:28:33.760126 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] Acquiring lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:28:33.760299 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] Acquired lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:28:33.760468 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Refreshing network info cache for port 91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:28:33.788826 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:28:34.207253 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:28:34.262959 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:34.319705 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:28:34.442322 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:28:34.646853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:34.796023 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:28:34.796888 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:28:34.797131 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Creating image(s)
Jun 27 04:28:34.797582 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "/opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:34.797724 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "/opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:34.798171 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "/opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:34.798684 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:28:34.801283 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:28:34.802447 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:34.889505 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.087s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:34.889937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:34.890419 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:34.890957 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:28:34.893519 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:28:34.893945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:34.945179 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ba9d1b7f-6ca3-4654-8d49-c94668851568 req-eef332a7-ec10-4cf6-b215-172cc8b70217 service nova] Releasing lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:28:34.946025 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquired lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:28:34.946308 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:28:34.985781 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:34.986132 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:34.998810 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:35.046264 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk 1073741824" returned: 0 in 0.060s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:35.046840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:35.047230 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:35.140157 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.093s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:35.140574 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:28:35.140835 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:35.232993 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:35.233386 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Cannot resize image /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:28:35.233901 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:28:35.234080 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Ensure instance console log exists: /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:28:35.234453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:35.234733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:35.234889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:35.514114 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:28:35.657113 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:35.776894 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating instance_info_cache with network_info: [{"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:28:36.279337 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Releasing lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:28:36.279693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Instance network_info: |[{"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:28:36.281640 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Start _get_guest_xml network_info=[{"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:28:36.285915 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:28:36.287249 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1946091842', uuid='8546ff9e-d529-4f55-8379-4d1f334b12d0'), owner=OwnerMeta(userid='fb1df717762741e98e49392818229db4', username='tempest-VolumeMultiattachTests-379193713-project-member', projectid='9f485b436a624d14aafc66b1936fa4be', projectname='tempest-VolumeMultiattachTests-379193713'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534516.286902) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:28:36.288356 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:28:36.288679 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:28:36.289701 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:28:36.289902 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:28:36.290832 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:28:36.291150 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:28:36.291319 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:28:36.291437 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:28:36.291612 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:28:36.291715 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:28:36.291873 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:28:36.292071 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:28:36.292197 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:28:36.292330 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:28:36.292460 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:28:36.292624 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:28:36.303002 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1946091842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-1946091842',id=80,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOEbPQJ66qTbr9qweDGh9vIoZnlKRdwReTLG9ecyp37sdB2gxCnyx1+JIW7K0JgbeyTckBLmfoJcKtuJRFHeX9ItQQmA4lB+cauTjuRjWZ7sd96pKKc+YAjKXYW5Mwnw==',key_name='tempest-keypair-652796712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-sr0pt76b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:28:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=8546ff9e-d529-4f55-8379-4d1f334b12d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:28:36.303286 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:28:36.303755 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:28:36.304284 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'pci_devices' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <uuid>8546ff9e-d529-4f55-8379-4d1f334b12d0</uuid>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <name>instance-00000050</name>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumeMultiattachTests-server-1946091842</nova:name>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:28:36</nova:creationTime>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:user uuid="fb1df717762741e98e49392818229db4">tempest-VolumeMultiattachTests-379193713-project-member</nova:user>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:project uuid="9f485b436a624d14aafc66b1936fa4be">tempest-VolumeMultiattachTests-379193713</nova:project>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         <nova:port uuid="91c4bcf9-214f-40eb-ae78-35d9fe4dee56">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <entry name="serial">8546ff9e-d529-4f55-8379-4d1f334b12d0</entry>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <entry name="uuid">8546ff9e-d529-4f55-8379-4d1f334b12d0</entry>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.config"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:80:18:40"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <target dev="tap91c4bcf9-21"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/console.log" append="off"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:28:36.807372 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Preparing to wait for external event network-vif-plugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1946091842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-1946091842',id=80,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOEbPQJ66qTbr9qweDGh9vIoZnlKRdwReTLG9ecyp37sdB2gxCnyx1+JIW7K0JgbeyTckBLmfoJcKtuJRFHeX9ItQQmA4lB+cauTjuRjWZ7sd96pKKc+YAjKXYW5Mwnw==',key_name='tempest-keypair-652796712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-sr0pt76b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:28:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=8546ff9e-d529-4f55-8379-4d1f334b12d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:28:36.810574 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:28:36.811107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.811167 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:36.811453 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:28:36.812165 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.812304 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef345b74-99fd-51bc-bd0f-4a2645e7d39a', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:36.813185 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.813886 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:28:36.814479 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.816776 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.816776 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91c4bcf9-21, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:36.816976 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91c4bcf9-21, col_values=(('qos', UUID('fa7f911d-8c27-4dc9-9009-044922426b74')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:36.816976 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91c4bcf9-21, col_values=(('external_ids', {'iface-id': '91c4bcf9-214f-40eb-ae78-35d9fe4dee56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:18:40', 'vm-uuid': '8546ff9e-d529-4f55-8379-4d1f334b12d0'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:36.817902 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.820107 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:28:36.824199 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:36.825122 np0000003830 nova-compute[98984]: INFO os_vif [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21')
Jun 27 04:28:37.567156 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:37.567416 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:37.567716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:37.567932 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:37.568104 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:37.570677 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Terminating instance
Jun 27 04:28:37.836159 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:37.836159 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:28:38.074481 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:28:38.097592 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.098976 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.121339 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.125115 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.147762 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.255564 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-01ad0103-837c-4cec-963e-0e1fbf006c0c req-e0984d23-b852-4fe1-842d-7ba2cc4946ca service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:38.256045 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-01ad0103-837c-4cec-963e-0e1fbf006c0c req-e0984d23-b852-4fe1-842d-7ba2cc4946ca service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:38.256243 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-01ad0103-837c-4cec-963e-0e1fbf006c0c req-e0984d23-b852-4fe1-842d-7ba2cc4946ca service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:38.256387 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-01ad0103-837c-4cec-963e-0e1fbf006c0c req-e0984d23-b852-4fe1-842d-7ba2cc4946ca service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:38.256541 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-01ad0103-837c-4cec-963e-0e1fbf006c0c req-e0984d23-b852-4fe1-842d-7ba2cc4946ca service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:38.256666 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-01ad0103-837c-4cec-963e-0e1fbf006c0c req-e0984d23-b852-4fe1-842d-7ba2cc4946ca service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:28:38.342834 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:28:38.342971 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:28:38.343112 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:80:18:40, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:28:38.343549 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Using config drive
Jun 27 04:28:38.380839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.408306 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.411819 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.416688 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99942266800008 future=<Future at 0x7ec518739520 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:28:38.416688 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999088526999913 future=<Future at 0x7ec518739520 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:28:38.416688 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99898851800026 future=<Future at 0x7ec518739520 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:28:38.419191 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Instance destroyed successfully.
Jun 27 04:28:38.419838 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lazy-loading 'resources' on Instance uuid 30aaefa4-e573-4318-8133-0d457cbf5357 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:28:38.429099 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.707986 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.717690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.719906 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.743015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.752805 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.830437 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:38.831417 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:28:38.833760 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.849310 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:38.858944 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.921751 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:27:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-234803072',display_name='tempest-instance-234803072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-instance-234803072',id=79,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLv0MxjUhoqE656EIGsFybgMgeSv+TyIzSmYjgORilhcoZYb5yxAoVqPkroSmLVMVb4mDGjhT1abt3Q4DvLbxMBFYQyShdFGmGUJPBYlFGYotp4zX5IgMemuwP7U1uThzQ==',key_name='tempest-keypair-1744168907',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:27:58Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f71c3cf0211646de852da0847561d67e',ramdisk_id='',reservation_id='r-6p94z11c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1575750835',owner_user_name='tempest-VolumesBackupsTest-1575750835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33faf65a5a584bc1acf8dee992884339',uuid=30aaefa4-e573-4318-8133-0d457cbf5357,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:28:38.921978 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Converting VIF {"id": "b8ecf269-e68d-437e-a645-5392d429a39f", "address": "fa:16:3e:15:f2:0b", "network": {"id": "37b0c16a-5f22-4593-9837-373dd14c0010", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-68732240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f71c3cf0211646de852da0847561d67e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ecf269-e6", "ovs_interfaceid": "b8ecf269-e68d-437e-a645-5392d429a39f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:28:38.922424 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:28:38.922692 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:28:38.923828 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.924008 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8ecf269-e6, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:38.924865 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.925616 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:28:38.931001 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.931594 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.931736 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5817ed6e-29d1-4052-9452-ce0dd1aa39bb) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:28:38.932224 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.932971 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:28:38.937581 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:38.939320 np0000003830 nova-compute[98984]: INFO os_vif [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:f2:0b,bridge_name='br-int',has_traffic_filtering=True,id=b8ecf269-e68d-437e-a645-5392d429a39f,network=Network(37b0c16a-5f22-4593-9837-373dd14c0010),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ecf269-e6')
Jun 27 04:28:38.940852 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:28:38.941114 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:28:38.941246 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:28:38.941834 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:28:38.942171 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f3172ea7-d271-4476-a69a-b1c86457041e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:28:38.942334 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:28:38.964897 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:28:38.964897 np0000003830 nova-compute[98984]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:28:38.964897 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:28:38.965113 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsi session list stdout=tcp: [221] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:28:38.965113 np0000003830 nova-compute[98984]: tcp: [222] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e (non-flash)
Jun 27 04:28:38.965113 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:28:38.965189 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', '221'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', '222')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:28:38.965254 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', '222')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:28:38.969718 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Creating config drive at /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.config
Jun 27 04:28:38.970651 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e', '221')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:28:38.971867 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518233ec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'): ({'sdb'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:28:38.972089 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:28:38.972405 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Flush multipath device 330000000d7554920 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:28:38.975665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4vr9e2kd {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:39.025226 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:28:39.048053 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4vr9e2kd" returned: 0 in 0.072s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:39.071000 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:28:39.110912 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:28:39.111105 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:28:39.111992 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:28:39.123823 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:28:39.124078 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:28:39.135603 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:28:39.171400 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.40.100,3260]
Jun 27 04:28:39.171400 np0000003830 nova-compute[98984]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.40.100,3260] successful.
Jun 27 04:28:39.171400 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:28:39.182331 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:28:39.193712 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:28:39.221514 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.50.100,3260]
Jun 27 04:28:39.221514 np0000003830 nova-compute[98984]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-f3172ea7-d271-4476-a69a-b1c86457041e, portal: 192.168.50.100,3260] successful.
Jun 27 04:28:39.221514 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:28:39.232142 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:28:39.232464 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:28:39.232669 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] <== disconnect_volume: return (290ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:28:39.232821 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:28:39.233149 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Deleting instance files /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357_del
Jun 27 04:28:39.233790 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Deletion of /opt/stack/data/nova/instances/30aaefa4-e573-4318-8133-0d457cbf5357_del complete
Jun 27 04:28:39.449514 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.468268 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.560131 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.621581 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2f19c9ae-e7a0-404d-af94-f05335ff9ed7 req-cea7efbf-fcd7-42af-9534-c17b06755d1c service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-plugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:39.621581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f19c9ae-e7a0-404d-af94-f05335ff9ed7 req-cea7efbf-fcd7-42af-9534-c17b06755d1c service nova] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:39.621581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f19c9ae-e7a0-404d-af94-f05335ff9ed7 req-cea7efbf-fcd7-42af-9534-c17b06755d1c service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:39.621581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-2f19c9ae-e7a0-404d-af94-f05335ff9ed7 req-cea7efbf-fcd7-42af-9534-c17b06755d1c service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:39.621581 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-2f19c9ae-e7a0-404d-af94-f05335ff9ed7 req-cea7efbf-fcd7-42af-9534-c17b06755d1c service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Processing event network-vif-plugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:28:39.741042 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Took 1.67 seconds to destroy the instance on the hypervisor.
Jun 27 04:28:39.741862 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:28:39.742131 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:28:39.742268 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:28:39.742593 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:39.776640 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.778226 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.780396 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.795005 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:39.830398 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:39.844344 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:39.991619 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:40.244566 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534520.244185, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:28:40.244765 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] VM Started (Lifecycle Event)
Jun 27 04:28:40.245209 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:28:40.248461 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:28:40.254756 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Instance spawned successfully.
Jun 27 04:28:40.255376 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:28:40.309310 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:40.309628 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:40.309769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:40.309896 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:40.310003 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:40.310105 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:28:40.310200 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:40.310320 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:40.310444 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:40.310553 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:40.310657 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:40.310761 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received unexpected event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with vm_state active and task_state deleting.
Jun 27 04:28:40.310842 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:40.310956 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:40.311069 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:40.311167 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:40.311260 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:40.311367 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received unexpected event network-vif-plugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with vm_state active and task_state deleting.
Jun 27 04:28:40.311460 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:40.311591 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:40.311783 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:40.311783 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:40.311893 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:40.311989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:28:40.312382 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:40.312490 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Acquiring lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:40.313009 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:40.313111 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] Lock "30aaefa4-e573-4318-8133-0d457cbf5357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:40.313243 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] No waiting events found dispatching network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:40.313288 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9a75b982-0b43-4942-9dee-56a7d2379aea req-1635f1dc-89be-4909-85a2-6f5290b60091 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-unplugged-b8ecf269-e68d-437e-a645-5392d429a39f for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:28:40.335547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:40.335547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:40.335547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:40.335725 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:28:40.727161 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:28:40.747509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:28:40.749674 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:28:40.761614 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:28:40.761765 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:28:40.762050 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:28:40.762287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:28:40.762570 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:28:40.762841 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:28:41.229113 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Took 1.49 seconds to deallocate network for instance.
Jun 27 04:28:41.251792 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:28:41.252065 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534521.2518702, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:28:41.252191 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] VM Paused (Lifecycle Event)
Jun 27 04:28:41.267877 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Took 6.47 seconds to spawn the instance on the hypervisor.
Jun 27 04:28:41.268343 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:28:41.354663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:41.446581 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:41.449202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:41.543453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:41.548720 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:28:41.550252 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:28:41.598286 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:28:41.598688 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51848MB free_disk=71.6947135925293GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:28:41.598851 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:41.599082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:41.676039 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-plugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:41.676475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:41.676673 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:41.676790 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:41.676917 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] No waiting events found dispatching network-vif-plugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:28:41.677023 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received unexpected event network-vif-plugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 for instance with vm_state active and task_state None.
Jun 27 04:28:41.677105 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-590af6cb-9b43-419a-88c6-0c8592104282 req-ed45b38c-7b17-486d-9101-0d12fdc2d955 service nova] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Received event network-vif-deleted-b8ecf269-e68d-437e-a645-5392d429a39f {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:41.756381 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:28:41.758934 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534521.7585063, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:28:41.759100 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] VM Resumed (Lifecycle Event)
Jun 27 04:28:41.776551 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Took 11.70 seconds to build instance.
Jun 27 04:28:41.803536 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Took 0.57 seconds to detach 1 volumes for instance.
Jun 27 04:28:42.261308 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:28:42.263608 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:28:42.277846 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-efe023a1-a74a-4d75-bbbd-2c60a35136e7 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.208s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:42.308683 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:28:42.697825 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 30aaefa4-e573-4318-8133-0d457cbf5357 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:28:42.697934 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:28:42.698088 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:28:42.698209 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:28:41 up 51 min,  2 users,  load average: 2.25, 3.74, 4.85\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '2', 'num_proj_f71c3cf0211646de852da0847561d67e': '1', 'io_workload': '0', 'num_task_None': '1', 'num_proj_9f485b436a624d14aafc66b1936fa4be': '1'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:28:42.837116 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:28:42.837299 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:28:43.339695 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:28:43.401803 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-changed-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:28:43.401988 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Refreshing instance network info cache due to event network-changed-91c4bcf9-214f-40eb-ae78-35d9fe4dee56. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:28:43.402082 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] Acquiring lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:28:43.402173 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] Acquired lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:28:43.402293 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Refreshing network info cache for port 91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:28:43.845649 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:28:43.845834 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.247s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:43.846403 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.538s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:28:43.846769 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:28:43.904598 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:43.933967 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:43.983378 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:28:43.983595 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:28:44.218383 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:28:44.343863 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updated VIF entry in instance network info cache for port 91c4bcf9-214f-40eb-ae78-35d9fe4dee56. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:28:44.344303 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating instance_info_cache with network_info: [{"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:28:44.488072 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:28:44.846453 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-1940db50-9517-4bcd-9e23-15cd1ad42317 req-38166b37-9034-4597-af88-bad0dfd01871 service nova] Releasing lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:28:44.994209 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:44.995288 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.149s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:45.040411 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Deleted allocations for instance 30aaefa4-e573-4318-8133-0d457cbf5357
Jun 27 04:28:46.050896 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b20e4962-35c1-485e-aed6-1c9545bce932 tempest-VolumesBackupsTest-1575750835 tempest-VolumesBackupsTest-1575750835-project-member] Lock "30aaefa4-e573-4318-8133-0d457cbf5357" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.482s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:28:47.846535 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:47.846924 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:47.846924 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:47.847173 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.98 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:28:48.830035 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:48.830298 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:28:48.830443 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:28:48.830604 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:28:48.936545 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:49.994955 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:53.414589 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003654869997262722 future=<Future at 0x7ec518739520 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:28:53.415003 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] Emitting event <LifecycleEvent: 1782534518.4141357, 30aaefa4-e573-4318-8133-0d457cbf5357 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:28:53.415109 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:28:53.415210 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] VM Stopped (Lifecycle Event)
Jun 27 04:28:53.917825 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-44ba60cc-a1f4-4fea-90fa-aeb5ba9d9e6f tempest-VolumesSnapshotTestJSON-2040432487 tempest-VolumesSnapshotTestJSON-2040432487-project-member] [instance: 30aaefa4-e573-4318-8133-0d457cbf5357] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:28:53.940373 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:55.003901 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:28:58.943077 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:00.010487 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:03.945969 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:05.022307 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:08.948712 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:10.027413 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:13.483392 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:13.483947 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:13.951402 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:13.987181 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:29:14.991684 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:15.039489 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:16.077892 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:16.078285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:16.078285 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attaching volume 312e54ca-633e-4a10-b0ef-07256af107e9 to /dev/vdb
Jun 27 04:29:16.133799 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:29:16.144128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:29:16.164466 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:16.207477 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:29:16.207740 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:29:16.215957 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:29:16.216898 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe80:1840', 'fe80::9c80:63ff:fe69:e73'] 
Jun 27 04:29:16.217040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:29:16.217156 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:29:16.217371 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:29:16.217640 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating existing volume attachment record: 5edd8446-932f-4a9e-a4e9-b997b04f8226 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:29:16.764633 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:29:16.764962 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '312e54ca-633e-4a10-b0ef-07256af107e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:29:16.765095 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:16.765590 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:16.765791 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '312e54ca-633e-4a10-b0ef-07256af107e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:29:16.776986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:16.777641 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:16.778094 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:16.778274 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:29:16.778704 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:16.778885 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:29:16.788902 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:29:16.788902 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:16.793943 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:29:16.793943 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9] added
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:16.800289 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:16.800470 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:29:16.800662 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:29:16.800841 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9] added
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:29:16.805223 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:29:17.801239 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:29:17.805600 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:29:17.812033 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:29:17.817845 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:17.824032 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:17.829597 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:17.835680 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:17.835680 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:17.835813 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:17.835813 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:17.841086 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:17.841086 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:17.841238 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:17.841238 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:17.867734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.40.100,3260]
Jun 27 04:29:17.867734 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.40.100,3260] successful.
Jun 27 04:29:17.867734 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:17.877774 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:17.888385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:17.888385 np0000003830 nova-compute[98984]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:17.888385 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:17.888385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:17.888385 np0000003830 nova-compute[98984]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:17.888385 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:17.888653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.110s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:17.888653 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:29:17.889123 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('8', '-', '-', 0) found on session 225 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:29:17.889224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:29:17.901899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 225 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:17.901899 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '312e54ca-633e-4a10-b0ef-07256af107e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:29:18.886293 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.50.100,3260]
Jun 27 04:29:18.886293 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.50.100,3260] successful.
Jun 27 04:29:18.886293 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:18.896974 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:18.909245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:18.909245 np0000003830 nova-compute[98984]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:18.909245 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:18.909245 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:18.909429 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2cb148f4-34fb-491a-acb6-857b70427f63 (non-flash)
Jun 27 04:29:18.909429 np0000003830 nova-compute[98984]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:18.909429 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:18.909429 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:18.909595 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.131s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:18.909678 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:29:18.910106 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('9', '-', '-', 0) found on session 226 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:29:18.910202 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:29:18.925980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 226 and hctl ['9', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:18.955191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:19.922327 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 226 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:19.922787 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '312e54ca-633e-4a10-b0ef-07256af107e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:29:20.813184 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445799245 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:29:20.813488 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.048s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:20.813714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== connect_volume: return (4048ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799245', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799245'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:29:20.813841 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445799245', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445799245'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:29:20.816776 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:29:21.320183 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to attach volume 312e54ca-633e-4a10-b0ef-07256af107e9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]:   <alias name="ua-312e54ca-633e-4a10-b0ef-07256af107e9"/>
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]:   <serial>312e54ca-633e-4a10-b0ef-07256af107e9</serial>
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:29:21.321796 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:29:22.966022 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:22.966363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:22.966363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:22.966363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:80:18:40, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:29:23.958479 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:24.367878 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:24.545300 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-fffa918b-8f85-445d-960a-6127ea58da72 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.467s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:24.545905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.178s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:25.049093 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:29:26.053713 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:26.991704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:26.991896 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:26.992111 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attaching volume 8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 to /dev/vdc
Jun 27 04:29:27.030457 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:29:27.041039 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:29:27.062734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:27.105867 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:29:27.106180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:29:27.115939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:29:27.117071 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe80:1840', 'fe80::9c80:63ff:fe69:e73'] 
Jun 27 04:29:27.117279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:29:27.117424 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:29:27.117731 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:29:27.118025 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating existing volume attachment record: 93d86c09-7e0d-4f3c-94f1-5f09cbdee5d1 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:29:27.695416 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8546ff9e-d529-4f55-8379-4d1f334b12d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'serial': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:29:27.698720 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:29:27.699150 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:29:27.699342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:27.699837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:27.700085 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:29:27.711875 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:27.712378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:27.712556 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:29:27.712935 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:27.713352 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:27.713589 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:29:27.723078 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:29:27.723078 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:27.727571 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:29:27.727571 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68] added
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:29:27.735449 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68] added
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:27.737918 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:27.738137 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:29:27.738200 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:29:27.738324 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:29:28.735865 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:29:28.738794 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:29:28.747291 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:29:28.752720 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.762208 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.764444 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.770235 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.770235 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.770235 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:28.770361 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.770361 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.770361 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:28.776446 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.776446 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.776446 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:28.776640 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.776640 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.776640 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:28.805285 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.40.100,3260]
Jun 27 04:29:28.805285 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.40.100,3260] successful.
Jun 27 04:29:28.805285 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.816250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.822369 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.50.100,3260]
Jun 27 04:29:28.822369 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.50.100,3260] successful.
Jun 27 04:29:28.822369 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.829046 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.829046 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.829046 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.829046 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.829046 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:28.829290 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.829290 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.829290 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.829290 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.829290 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:28.829467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:28.829634 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:29:28.830126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('7', '-', '-', 0) found on session 227 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:29:28.830243 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:29:28.834554 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:28.843568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 227 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:28.843568 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:29:28.846975 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.846975 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.846975 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.846975 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.846975 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:28.847164 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.847164 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:28.847164 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.847164 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:28.847164 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:28.847352 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:28.847448 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:29:28.847999 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('10', '-', '-', 0) found on session 228 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:29:28.848136 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:29:28.862349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:28.862349 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:29:28.961961 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:29.713714 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:29:29.952375 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:30.730111 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found WWN 330000000945ae498 for multipath device dm-1 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:29:30.730111 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:30.731357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000945ae498', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000945ae498'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:29:30.731574 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000945ae498', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000945ae498'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:29:30.735298 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:29:30.735586 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:29:30.735743 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:29:30.753808 np0000003830 nova-compute[98984]: WARNING os_brick.encryptors.luks [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jun 27 04:29:30.758249 np0000003830 nova-compute[98984]: WARNING stevedore.named [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
Jun 27 04:29:30.758249 np0000003830 nova-compute[98984]: WARNING castellan.key_manager [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:29:30.758249 np0000003830 nova-compute[98984]: WARNING nova.keymgr.conf_key_mgr [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
Jun 27 04:29:30.758249 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7ec5180d3ec0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '8546ff9e-d529-4f55-8379-4d1f334b12d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'serial': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'} {{(pid=98984) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
Jun 27 04:29:30.758249 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors.luks [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98984) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
Jun 27 04:29:31.016308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:33.965399 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:34.812720 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Secret XML: <secret ephemeral="no" private="no">
Jun 27 04:29:34.812720 np0000003830 nova-compute[98984]:   <usage type="volume">
Jun 27 04:29:34.812720 np0000003830 nova-compute[98984]:     <volume>8ccd6c8b-033f-4755-a6a0-0b8c931e8f68</volume>
Jun 27 04:29:34.812720 np0000003830 nova-compute[98984]:   </usage>
Jun 27 04:29:34.812720 np0000003830 nova-compute[98984]: </secret>
Jun 27 04:29:34.812720 np0000003830 nova-compute[98984]:  {{(pid=98984) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1207}}
Jun 27 04:29:34.818553 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:29:35.321847 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to attach volume 8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   <alias name="ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68"/>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   <serial>8ccd6c8b-033f-4755-a6a0-0b8c931e8f68</serial>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="c7f69517-4b12-48fd-9076-c7feebc3f912"/>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:29:35.323128 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:29:36.826982 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:36.827473 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:37.943076 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:37.943534 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:37.943534 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:37.943534 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:37.943651 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:80:18:40, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:29:38.970827 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:29:38.971382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:29:38.971382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:29:38.971382 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:29:38.978766 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:38.978962 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:29:39.491274 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-62d57572-39f3-4cc7-81aa-a081f3760082 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.499s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:39.830342 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:39.830756 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:39.831120 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:40.011843 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:40.012707 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:40.050274 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:40.515947 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:29:41.521351 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:41.830192 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:42.334674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:42.334915 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:42.335190 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:42.335285 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:29:42.608206 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:42.608638 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:42.608638 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attaching volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 to /dev/vdd
Jun 27 04:29:42.642778 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:29:42.653040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:29:42.673180 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:42.715120 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:29:42.715382 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:29:42.726297 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:29:42.727074 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe80:1840', 'fe80::9c80:63ff:fe69:e73'] 
Jun 27 04:29:42.727194 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:29:42.727296 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:29:42.727632 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:29:42.727873 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating existing volume attachment record: f4fdf675-dfc9-43d1-a6b3-be4defab7066 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:29:43.283004 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:29:43.283389 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:29:43.283630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:43.284040 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:43.284255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:29:43.295466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:43.296162 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:29:43.296728 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:43.296987 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:29:43.297376 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:29:43.297605 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:29:43.308357 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:29:43.308357 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:43.312808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:29:43.312808 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37] added
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:43.318725 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:43.318973 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:29:43.319062 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:29:43.319203 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37] added
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:29:43.322303 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:43.322540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:29:43.322723 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:29:43.322863 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:29:43.357119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:43.441546 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:43.442003 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:43.528959 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:43.529474 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:29:43.529630 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:29:43.533670 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:29:43.534819 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:43.579754 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:43.580220 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51657MB free_disk=71.67121505737305GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:29:43.580358 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:43.580674 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:44.001090 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:44.319810 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:29:44.323320 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:29:44.331472 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:29:44.337112 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.344406 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.350355 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.360180 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.360180 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.360180 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.360180 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.360180 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:44.360436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.360436 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.360436 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.360436 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.360436 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:44.364220 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.364220 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.364220 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.364220 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.364220 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:44.364347 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.364347 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.364347 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.364347 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.364347 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:44.395970 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.50.100,3260]
Jun 27 04:29:44.395970 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.50.100,3260] successful.
Jun 27 04:29:44.395970 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.400415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.40.100,3260]
Jun 27 04:29:44.400415 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.40.100,3260] successful.
Jun 27 04:29:44.400415 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.407896 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.413511 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.421621 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.421903 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:44.422153 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:44.422272 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:29:44.423125 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('11', '-', '-', 0) found on session 229 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:29:44.423261 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.427737 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:29:44.427957 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:29:44.428143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:44.428224 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:29:44.428925 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('12', '-', '-', 0) found on session 230 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:29:44.429049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:29:44.438561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 229 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:44.438561 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:29:44.442436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 230 and hctl ['12', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:44.632393 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:29:44.632576 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 1 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:29:44.632723 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=16 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:29:43 up 52 min,  2 users,  load average: 1.55, 3.30, 4.63\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_9f485b436a624d14aafc66b1936fa4be': '1', 'io_workload': '0'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:29:44.713352 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:29:44.713599 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:29:45.216166 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:29:45.443256 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 230 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:29:45.443434 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:29:45.722912 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:29:45.723092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.142s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:45.723451 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:46.312163 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found WWN 3300000004400e2ce for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:29:46.312665 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:29:46.312744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '3300000004400e2ce', 'path': '/dev/dm-2', 'multipath_id': '3300000004400e2ce'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:29:46.312944 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004400e2ce', 'path': '/dev/dm-2', 'multipath_id': '3300000004400e2ce'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:29:46.315682 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:29:46.818468 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to attach volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:   <alias name="ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37"/>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:   <target dev="vdd" bus="virtio"/>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:   <serial>0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37</serial>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:29:46.819968 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:29:47.024764 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:47.723485 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:47.723978 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.10 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:47.826687 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:47.827069 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:48.453482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:48.453653 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:48.453761 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:48.453854 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:48.453947 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:29:48.454043 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:80:18:40, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:29:48.830181 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:48.830684 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:29:48.830723 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:49.003129 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:29:49.003272 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:29:49.003361 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:29:49.003446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:29:49.013957 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:49.014122 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:29:49.830707 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:49.831100 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:29:49.832516 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:29:49.999809 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c046f382-b6ea-4f7e-8aed-df8f857d1763 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.391s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:50.060219 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:52.367850 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:52.368246 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:52.869901 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:29:53.414090 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:53.414517 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:53.417451 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:29:53.417602 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Claim successful on node np0000003830
Jun 27 04:29:54.022292 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:54.559759 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:29:54.560114 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:29:55.062365 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:29:55.068407 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:55.571742 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.157s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:55.572298 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:29:56.078948 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:29:56.079415 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:29:56.080036 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:29:56.080348 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:29:56.145662 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb1df717762741e98e49392818229db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f485b436a624d14aafc66b1936fa4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:29:56.580075 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Successfully created port: 1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:29:56.582625 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:29:57.065061 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Successfully updated port: 1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:29:57.085619 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:29:57.113877 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-changed-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:29:57.113877 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Refreshing instance network info cache due to event network-changed-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:29:57.113877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] Acquiring lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:29:57.113877 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] Acquired lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:29:57.113877 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Refreshing network info cache for port 1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:29:57.567145 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:29:57.612873 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:29:57.671043 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:29:57.795444 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:29:58.092981 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:29:58.093818 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:29:58.094051 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Creating image(s)
Jun 27 04:29:58.094667 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:58.094830 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "/opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:58.095377 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "/opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:58.096011 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:29:58.098933 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:29:58.100075 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:58.196775 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:58.197285 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:58.197840 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:58.198415 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:29:58.201268 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:29:58.201604 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:58.288006 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.086s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:58.288391 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:58.301030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-6fd6a24b-f33d-43aa-901f-0ef77fba8210 req-40dd22e0-5392-4a08-bb49-f278084b915d service nova] Releasing lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:29:58.302334 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquired lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:29:58.302663 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:29:58.342281 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk 1073741824" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:58.342635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:58.342945 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:58.426716 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.083s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:58.427109 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:29:58.427393 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:29:58.512670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:29:58.513060 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Cannot resize image /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:29:58.513594 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:29:58.513773 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Ensure instance console log exists: /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:29:58.514046 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:29:58.514244 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:29:58.514375 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:29:58.860222 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:29:59.000642 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:29:59.032308 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:29:59.113002 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Updating instance_info_cache with network_info: [{"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:29:59.615348 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Releasing lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:29:59.615740 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Instance network_info: |[{"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:29:59.617853 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Start _get_guest_xml network_info=[{"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:29:59.622224 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:29:59.623599 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1392541185', uuid='8ec0003a-27ec-4306-b606-dc8f374c9b47'), owner=OwnerMeta(userid='fb1df717762741e98e49392818229db4', username='tempest-VolumeMultiattachTests-379193713-project-member', projectid='9f485b436a624d14aafc66b1936fa4be', projectname='tempest-VolumeMultiattachTests-379193713'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534599.6232357) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:29:59.624659 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:29:59.624973 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:29:59.625897 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:29:59.626054 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:29:59.627036 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:29:59.627314 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:29:59.627439 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:29:59.627549 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:29:59.627671 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:29:59.627753 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:29:59.627847 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:29:59.628000 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:29:59.628094 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:29:59.628191 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:29:59.628287 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:29:59.628419 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:29:59.638363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1392541185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-1392541185',id=81,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOEbPQJ66qTbr9qweDGh9vIoZnlKRdwReTLG9ecyp37sdB2gxCnyx1+JIW7K0JgbeyTckBLmfoJcKtuJRFHeX9ItQQmA4lB+cauTjuRjWZ7sd96pKKc+YAjKXYW5Mwnw==',key_name='tempest-keypair-652796712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-6w4ftc5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=8ec0003a-27ec-4306-b606-dc8f374c9b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:29:59.638540 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:29:59.639135 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:29:59.640112 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ec0003a-27ec-4306-b606-dc8f374c9b47 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <uuid>8ec0003a-27ec-4306-b606-dc8f374c9b47</uuid>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <name>instance-00000051</name>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumeMultiattachTests-server-1392541185</nova:name>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:29:59</nova:creationTime>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:user uuid="fb1df717762741e98e49392818229db4">tempest-VolumeMultiattachTests-379193713-project-member</nova:user>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:project uuid="9f485b436a624d14aafc66b1936fa4be">tempest-VolumeMultiattachTests-379193713</nova:project>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         <nova:port uuid="1f20be8f-6ec5-4e92-bd66-ffb3182b7e75">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <entry name="serial">8ec0003a-27ec-4306-b606-dc8f374c9b47</entry>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <entry name="uuid">8ec0003a-27ec-4306-b606-dc8f374c9b47</entry>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.config"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:84:b3:bc"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <target dev="tap1f20be8f-6e"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/console.log" append="off"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:30:00.143083 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Preparing to wait for external event network-vif-plugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1392541185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-1392541185',id=81,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOEbPQJ66qTbr9qweDGh9vIoZnlKRdwReTLG9ecyp37sdB2gxCnyx1+JIW7K0JgbeyTckBLmfoJcKtuJRFHeX9ItQQmA4lB+cauTjuRjWZ7sd96pKKc+YAjKXYW5Mwnw==',key_name='tempest-keypair-652796712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-6w4ftc5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:29:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=8ec0003a-27ec-4306-b606-dc8f374c9b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:30:00.145670 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:30:00.146032 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.146149 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:00.146446 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:30:00.147153 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.147316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dd26173-5afb-5aa7-ad16-0ee5272eac50', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:00.159559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.159975 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:30:00.160258 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.162106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.162244 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f20be8f-6e, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:00.162582 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f20be8f-6e, col_values=(('qos', UUID('634e77e9-ddca-4b84-b2ac-ddfb9758df89')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:00.162765 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f20be8f-6e, col_values=(('external_ids', {'iface-id': '1f20be8f-6ec5-4e92-bd66-ffb3182b7e75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:b3:bc', 'vm-uuid': '8ec0003a-27ec-4306-b606-dc8f374c9b47'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:00.163374 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.164387 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:30:00.168312 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:00.169111 np0000003830 nova-compute[98984]: INFO os_vif [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e')
Jun 27 04:30:01.684629 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:30:01.685051 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:30:01.685051 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:84:b3:bc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:30:01.685236 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Using config drive
Jun 27 04:30:02.190659 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:02.318221 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Creating config drive at /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.config
Jun 27 04:30:02.323089 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5su2as98 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:02.382823 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5su2as98" returned: 0 in 0.059s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:30:02.771641 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:02.788422 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:02.867417 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:02.918062 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c2dae8e-8a1e-4854-b825-844a8ec3a03f req-7df9ca31-55cc-4815-a7be-caa969d16a5c service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-plugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:02.918988 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c2dae8e-8a1e-4854-b825-844a8ec3a03f req-7df9ca31-55cc-4815-a7be-caa969d16a5c service nova] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:02.919037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c2dae8e-8a1e-4854-b825-844a8ec3a03f req-7df9ca31-55cc-4815-a7be-caa969d16a5c service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:02.919150 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-9c2dae8e-8a1e-4854-b825-844a8ec3a03f req-7df9ca31-55cc-4815-a7be-caa969d16a5c service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:02.919559 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-9c2dae8e-8a1e-4854-b825-844a8ec3a03f req-7df9ca31-55cc-4815-a7be-caa969d16a5c service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Processing event network-vif-plugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:30:02.919621 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:03.408207 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534603.4077063, 8ec0003a-27ec-4306-b606-dc8f374c9b47 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:30:03.408818 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:30:03.409174 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] VM Started (Lifecycle Event)
Jun 27 04:30:03.411271 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:30:03.413800 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Instance spawned successfully.
Jun 27 04:30:03.414255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:30:03.915529 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:30:03.919930 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:30:03.922163 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:30:03.922309 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:30:03.922716 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:30:03.922967 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:30:03.923192 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:30:03.923412 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:30:04.423031 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:30:04.423329 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534604.4231458, 8ec0003a-27ec-4306-b606-dc8f374c9b47 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:30:04.423483 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] VM Paused (Lifecycle Event)
Jun 27 04:30:04.427418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Took 6.33 seconds to spawn the instance on the hypervisor.
Jun 27 04:30:04.427660 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:30:04.925861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:30:04.928414 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534604.9281976, 8ec0003a-27ec-4306-b606-dc8f374c9b47 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:30:04.928601 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] VM Resumed (Lifecycle Event)
Jun 27 04:30:04.935888 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Took 11.56 seconds to build instance.
Jun 27 04:30:04.970479 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7d8685d2-95cf-4758-bd2c-c80a7e9488ba req-cce484ae-226a-478b-94a6-9daf295f502e service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-plugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:04.973207 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7d8685d2-95cf-4758-bd2c-c80a7e9488ba req-cce484ae-226a-478b-94a6-9daf295f502e service nova] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:04.973382 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7d8685d2-95cf-4758-bd2c-c80a7e9488ba req-cce484ae-226a-478b-94a6-9daf295f502e service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:04.973518 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-7d8685d2-95cf-4758-bd2c-c80a7e9488ba req-cce484ae-226a-478b-94a6-9daf295f502e service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:04.973677 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-7d8685d2-95cf-4758-bd2c-c80a7e9488ba req-cce484ae-226a-478b-94a6-9daf295f502e service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] No waiting events found dispatching network-vif-plugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:30:04.973795 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-7d8685d2-95cf-4758-bd2c-c80a7e9488ba req-cce484ae-226a-478b-94a6-9daf295f502e service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received unexpected event network-vif-plugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 for instance with vm_state active and task_state None.
Jun 27 04:30:05.075128 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:05.164066 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:05.430879 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:30:05.432980 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:30:05.437176 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-d27f4957-eff4-4180-92a1-14addaa95a76 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.069s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:07.024509 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-changed-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:07.025300 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Refreshing instance network info cache due to event network-changed-91c4bcf9-214f-40eb-ae78-35d9fe4dee56. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:30:07.025768 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] Acquiring lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:30:07.027170 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] Acquired lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:30:07.027554 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Refreshing network info cache for port 91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:30:07.530108 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:07.783400 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:07.907958 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updated VIF entry in instance network info cache for port 91c4bcf9-214f-40eb-ae78-35d9fe4dee56. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:30:07.908210 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating instance_info_cache with network_info: [{"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:30:08.410092 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] Releasing lock "refresh_cache-8546ff9e-d529-4f55-8379-4d1f334b12d0" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:30:08.410592 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-changed-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:08.410592 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Refreshing instance network info cache due to event network-changed-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:30:08.410769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] Acquiring lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:30:08.410948 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] Acquired lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:30:08.411148 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Refreshing network info cache for port 1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:30:08.913230 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:09.167681 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:09.281626 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Updated VIF entry in instance network info cache for port 1f20be8f-6ec5-4e92-bd66-ffb3182b7e75. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:30:09.281864 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Updating instance_info_cache with network_info: [{"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:30:09.783941 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5ad23089-8360-42d0-bd38-b79afa55f74a req-0ac687af-f3d0-4a44-90af-6159028e1e0f service nova] Releasing lock "refresh_cache-8ec0003a-27ec-4306-b606-dc8f374c9b47" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:30:10.087565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:10.164175 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:15.103589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:15.164243 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:20.113050 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:20.165553 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:25.121564 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:25.166917 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:30.137191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:30.167600 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:35.150191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:35.168424 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:39.830465 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:39.831424 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:30:40.170845 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:41.830119 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:41.830567 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:42.334526 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:42.340271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:42.340271 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:42.340271 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:30:43.173032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:43.173828 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:43.360117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:43.456657 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:30:43.457194 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:43.545909 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:30:43.546459 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:30:43.546688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:30:43.546871 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=98984) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12351}}
Jun 27 04:30:43.552474 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:43.645331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:30:43.646022 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:43.680987 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8ec0003a-27ec-4306-b606-dc8f374c9b47 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:30:43.739897 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:30:43.744187 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:30:43.745110 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:43.789575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:30:43.790002 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51330MB free_disk=71.63094329833984GB free_vcpus=14 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:30:43.790212 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:43.790547 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:44.689353 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:44.845121 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:30:44.845272 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:30:44.845442 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 2 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:30:44.845643 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=16 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:30:43 up 53 min,  2 users,  load average: 0.89, 2.79, 4.37\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_9f485b436a624d14aafc66b1936fa4be': '2', 'io_workload': '0'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:30:44.965589 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:30:44.965806 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:30:45.169513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:45.171557 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:45.468420 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:30:45.840884 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:45.841307 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:45.841307 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Attaching volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 to /dev/vdb
Jun 27 04:30:45.879537 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:30:45.890646 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:30:45.910479 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:30:45.953936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:30:45.954317 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:30:45.962739 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:30:45.963748 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe80:1840', 'fe80::9c80:63ff:fe69:e73', 'fe80::fc16:3eff:fe84:b3bc'] 
Jun 27 04:30:45.963909 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:30:45.964063 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:30:45.964317 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:30:45.964634 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Updating existing volume attachment record: 5a0c2dd5-1c41-4df4-b7c0-c077b7cb564f {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:30:45.975056 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:30:45.975301 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.185s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:45.975719 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:30:46.539214 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:30:46.539725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:30:46.539867 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:30:46.540247 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:30:46.540449 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:30:46.552620 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:30:46.553217 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:30:46.553881 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:30:46.554112 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:30:46.554410 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:30:46.554611 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:30:46.565746 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.startup = automatic
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.scan = manual
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:30:46.570436 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:30:46.577185 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:30:46.582822 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.591504 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.591813 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:30:46.592279 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.039s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:30:46.592415 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:30:46.593266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('12', '0', '0', 0) found on session 230 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:30:46.593385 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.597579 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:30:46.597758 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:30:46.597878 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.044s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:30:46.597987 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:30:46.598394 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('11', '0', '0', 0) found on session 229 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:30:46.598490 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:30:46.604250 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 230 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:30:46.604383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:30:46.606650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 229 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:30:46.606775 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:30:47.554396 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
Jun 27 04:30:48.569512 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found WWN 3300000004400e2ce for multipath device dm-2 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:30:48.569939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.029s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:30:48.569939 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== connect_volume: return (2030ms) {'type': 'block', 'scsi_wwn': '3300000004400e2ce', 'path': '/dev/dm-2', 'multipath_id': '3300000004400e2ce'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:30:48.570000 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004400e2ce', 'path': '/dev/dm-2', 'multipath_id': '3300000004400e2ce'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:30:48.572678 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8ec0003a-27ec-4306-b606-dc8f374c9b47 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:30:49.075849 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Attempting to attach volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:   <alias name="ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37"/>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:   <serial>0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37</serial>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:30:49.077297 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:30:49.975518 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:49.975954 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:49.976045 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.85 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:30:50.173846 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:30:50.174191 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:30:50.174273 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:30:50.174326 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:30:50.180061 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:50.180235 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:30:50.711460 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:30:50.711743 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:30:50.711866 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:30:50.712027 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:84:b3:bc, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:30:50.830118 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:50.830315 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:50.830451 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:30:50.830655 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:30:51.830376 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:30:51.830947 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:30:52.262087 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-7c41ab85-e5a2-41cd-84c4-32df69b06d5f tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.421s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:53.819032 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:53.819480 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:54.321369 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Detaching volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37
Jun 27 04:30:54.360200 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Attempting to driver detach volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 from mountpoint /dev/vdb
Jun 27 04:30:54.365814 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdb by alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:30:54.367101 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdb by alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:30:54.367223 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Attempting to detach device vdb from instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <alias name="ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37"/>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <serial>0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37</serial>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:30:54.367436 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:30:54.374229 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdb from instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 from the persistent domain config.
Jun 27 04:30:54.374463 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] (1/8): Attempting to detach device vdb with device alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 from instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <alias name="ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37"/>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <serial>0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37</serial>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:30:54.374723 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:30:54.834363 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534654.8339756, 8ec0003a-27ec-4306-b606-dc8f374c9b47 => ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:30:54.835686 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 for instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:30:54.838020 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdb from instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 from the live domain config.
Jun 27 04:30:55.171325 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:55.180788 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:55.369845 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Detected multiple connections on this host for volume: 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, skipping target disconnect.
Jun 27 04:30:55.914204 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8ec0003a-27ec-4306-b606-dc8f374c9b47 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:30:56.919794 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-6c07207d-cb24-4d1d-80c1-028f9b9da025 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.100s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:57.018570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:57.018570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:57.018570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:57.018570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:57.018570 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:57.020890 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Terminating instance
Jun 27 04:30:57.523826 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:30:57.539426 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:57.541316 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:57.563468 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:57.676823 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d49a0816-efe0-4c48-b8ef-f4161c5564df req-73b3dd0d-0070-4b7d-aafe-1665d0fb3931 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-unplugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:57.677033 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d49a0816-efe0-4c48-b8ef-f4161c5564df req-73b3dd0d-0070-4b7d-aafe-1665d0fb3931 service nova] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:57.677197 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d49a0816-efe0-4c48-b8ef-f4161c5564df req-73b3dd0d-0070-4b7d-aafe-1665d0fb3931 service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:57.677559 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d49a0816-efe0-4c48-b8ef-f4161c5564df req-73b3dd0d-0070-4b7d-aafe-1665d0fb3931 service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:57.677693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d49a0816-efe0-4c48-b8ef-f4161c5564df req-73b3dd0d-0070-4b7d-aafe-1665d0fb3931 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] No waiting events found dispatching network-vif-unplugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:30:57.678052 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d49a0816-efe0-4c48-b8ef-f4161c5564df req-73b3dd0d-0070-4b7d-aafe-1665d0fb3931 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-unplugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:30:57.690772 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:57.697780 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:57.751178 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:57.841270 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998956723999981 future=<Future at 0x7ec5183891c0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:30:57.842153 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998008303999995 future=<Future at 0x7ec5183891c0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:30:57.842330 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.997830670999974 future=<Future at 0x7ec5183891c0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:30:57.843347 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Instance destroyed successfully.
Jun 27 04:30:57.843768 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'resources' on Instance uuid 8ec0003a-27ec-4306-b606-dc8f374c9b47 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:30:58.346299 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1392541185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-1392541185',id=81,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOEbPQJ66qTbr9qweDGh9vIoZnlKRdwReTLG9ecyp37sdB2gxCnyx1+JIW7K0JgbeyTckBLmfoJcKtuJRFHeX9ItQQmA4lB+cauTjuRjWZ7sd96pKKc+YAjKXYW5Mwnw==',key_name='tempest-keypair-652796712',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:30:04Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-6w4ftc5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=8ec0003a-27ec-4306-b606-dc8f374c9b47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:30:58.347019 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "address": "fa:16:3e:84:b3:bc", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f20be8f-6e", "ovs_interfaceid": "1f20be8f-6ec5-4e92-bd66-ffb3182b7e75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:30:58.347371 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:30:58.347697 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:30:58.349469 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:58.349724 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f20be8f-6e, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:58.350802 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:58.351518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:30:58.351678 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:58.352408 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:58.352589 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=634e77e9-ddca-4b84-b2ac-ddfb9758df89) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:30:58.353068 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:30:58.353513 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:30:58.355202 np0000003830 nova-compute[98984]: INFO os_vif [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:b3:bc,bridge_name='br-int',has_traffic_filtering=True,id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f20be8f-6e')
Jun 27 04:30:58.355463 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Deleting instance files /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47_del
Jun 27 04:30:58.356225 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Deletion of /opt/stack/data/nova/instances/8ec0003a-27ec-4306-b606-dc8f374c9b47_del complete
Jun 27 04:30:58.861593 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Took 1.34 seconds to destroy the instance on the hypervisor.
Jun 27 04:30:58.862198 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:30:58.862534 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:30:58.862728 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:30:58.863018 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:58.918928 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:30:59.728105 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-unplugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:59.728561 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] Acquiring lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:30:59.728779 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:30:59.728917 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:30:59.729041 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] No waiting events found dispatching network-vif-unplugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:30:59.729139 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-unplugged-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:30:59.729232 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Received event network-vif-deleted-1f20be8f-6ec5-4e92-bd66-ffb3182b7e75 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:30:59.729338 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Neutron deleted interface 1f20be8f-6ec5-4e92-bd66-ffb3182b7e75; detaching it from the instance and deleting it from the info cache
Jun 27 04:30:59.731004 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5b6d8557-169e-4cfa-a210-72c93b8b4f3d req-f95a522c-3df0-4a86-8960-36a95cab8308 service nova] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Detach interface failed, port_id=1f20be8f-6ec5-4e92-bd66-ffb3182b7e75, reason: Instance 8ec0003a-27ec-4306-b606-dc8f374c9b47 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:30:59.770195 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:31:00.272404 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Took 1.41 seconds to deallocate network for instance.
Jun 27 04:31:00.778065 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:00.778482 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:00.903531 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:31:00.903741 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:31:01.406518 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:31:01.913487 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.135s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:01.958514 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Deleted allocations for instance 8ec0003a-27ec-4306-b606-dc8f374c9b47
Jun 27 04:31:02.966635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-1b48d7da-70db-496a-915f-3f693540e6c6 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8ec0003a-27ec-4306-b606-dc8f374c9b47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.948s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:03.354023 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:04.060331 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:04.060868 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:04.563657 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Detaching volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37
Jun 27 04:31:04.601560 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to driver detach volume 0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 from mountpoint /dev/vdd
Jun 27 04:31:04.606395 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdd by alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:31:04.607583 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdd by alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:31:04.607694 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Attempting to detach device vdd from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <alias name="ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37"/>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <target dev="vdd" bus="virtio"/>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <serial>0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37</serial>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:31:04.607920 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:31:04.614465 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdd from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the persistent domain config.
Jun 27 04:31:04.614641 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] (1/8): Attempting to detach device vdd with device alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <alias name="ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37"/>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-2"/>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <target dev="vdd" bus="virtio"/>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <serial>0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37</serial>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:31:04.614826 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:31:05.090827 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534665.090455, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:31:05.091854 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 for instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:31:05.094207 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdd from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the live domain config.
Jun 27 04:31:05.120005 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:31:05.120267 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:31:05.120378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:31:05.120687 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:31:05.120980 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:31:05.121095 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:31:05.143805 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: tcp: [229] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: tcp: [230] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37 (non-flash)
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:31:05.144252 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', '228'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', '229'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', '230')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:31:05.144466 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', '230')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:31:05.145248 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37', '229')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:31:05.146053 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5187740e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'): ({'sdf'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:31:05.146255 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Removing multipathed devices sdf, sdg {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:31:05.146454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flush multipath device 3300000004400e2ce {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:31:05.181865 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:31:05.221965 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:31:05.273910 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:31:05.274128 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:31:05.275238 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:31:05.286245 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:31:05.286465 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:31:05.297461 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:05.326698 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.40.100,3260]
Jun 27 04:31:05.326698 np0000003830 nova-compute[98984]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.40.100,3260] successful.
Jun 27 04:31:05.326698 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:05.340282 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:05.351300 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:05.387917 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.50.100,3260]
Jun 27 04:31:05.387917 np0000003830 nova-compute[98984]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-0e529d74-d73f-4ccf-bf9b-53d1f5ab4b37, portal: 192.168.50.100,3260] successful.
Jun 27 04:31:05.387917 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:05.404518 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:05.404756 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:31:05.404873 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== disconnect_volume: return (284ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:31:05.405002 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:31:05.948197 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:31:06.953750 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-373995d5-6e2e-4a2c-91a8-634cacc25c50 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.893s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:07.322963 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:07.323125 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:07.825210 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Detaching volume 8ccd6c8b-033f-4755-a6a0-0b8c931e8f68
Jun 27 04:31:07.859740 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to driver detach volume 8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 from mountpoint /dev/vdc
Jun 27 04:31:07.885369 np0000003830 nova-compute[98984]: DEBUG os_brick.encryptors [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '8546ff9e-d529-4f55-8379-4d1f334b12d0', 'attached_at': '', 'detached_at': '', 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'serial': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'} {{(pid=98984) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
Jun 27 04:31:07.888699 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdc by alias ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:31:07.889729 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdc by alias ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:31:07.889840 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Attempting to detach device vdc from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <alias name="ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68"/>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <serial>8ccd6c8b-033f-4755-a6a0-0b8c931e8f68</serial>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="c7f69517-4b12-48fd-9076-c7feebc3f912"/>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:31:07.890051 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:31:07.895141 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdc from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the persistent domain config.
Jun 27 04:31:07.895292 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] (1/8): Attempting to detach device vdc with device alias ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <alias name="ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68"/>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <target dev="vdc" bus="virtio"/>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <serial>8ccd6c8b-033f-4755-a6a0-0b8c931e8f68</serial>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   <encryption format="luks">
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:     <secret type="passphrase" uuid="c7f69517-4b12-48fd-9076-c7feebc3f912"/>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:   </encryption>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:31:07.895504 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:31:08.351393 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534668.3510427, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:31:08.352275 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 for instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:31:08.354313 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdc from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the live domain config.
Jun 27 04:31:08.354931 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:08.356736 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:31:08.357031 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:31:08.357145 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:31:08.357431 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:31:08.357721 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:31:08.357838 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:31:08.380191 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:08.380191 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:08.380191 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:08.380191 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:08.380191 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:31:08.380473 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:08.380473 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:08.380473 np0000003830 nova-compute[98984]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:08.380473 np0000003830 nova-compute[98984]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68 (non-flash)
Jun 27 04:31:08.380473 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:31:08.380698 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', '228')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:31:08.380698 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', '227')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:31:08.381452 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68', '228')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:31:08.382139 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec5181d1620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'): ({'sde'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:31:08.382342 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Removing multipathed devices sdb, sde {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:31:08.382596 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flush multipath device 330000000945ae498 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:31:08.410944 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:31:08.445930 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:31:08.494542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if SCSI volumes sdb, sde have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:31:08.494542 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] SCSI volumes sdb, sde have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:31:08.494759 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if device paths {'sdb', 'sde'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:31:08.504583 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Device paths {'sdb', 'sde'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:31:08.504772 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:31:08.513835 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:08.542478 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.40.100,3260]
Jun 27 04:31:08.542478 np0000003830 nova-compute[98984]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.40.100,3260] successful.
Jun 27 04:31:08.542478 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:08.554968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:08.564749 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:08.594512 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.50.100,3260]
Jun 27 04:31:08.594512 np0000003830 nova-compute[98984]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-8ccd6c8b-033f-4755-a6a0-0b8c931e8f68, portal: 192.168.50.100,3260] successful.
Jun 27 04:31:08.594512 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:08.606301 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:08.607069 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:31:08.607178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== disconnect_volume: return (249ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:31:08.607311 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:31:09.158000 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:31:10.163192 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9319e94a-7493-4bb9-aae1-2db972359968 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.840s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:10.590287 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:10.590584 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:11.092818 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Detaching volume 312e54ca-633e-4a10-b0ef-07256af107e9
Jun 27 04:31:11.127131 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Attempting to driver detach volume 312e54ca-633e-4a10-b0ef-07256af107e9 from mountpoint /dev/vdb
Jun 27 04:31:11.132082 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdb by alias ua-312e54ca-633e-4a10-b0ef-07256af107e9 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:31:11.133272 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdb by alias ua-312e54ca-633e-4a10-b0ef-07256af107e9 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:31:11.133390 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Attempting to detach device vdb from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:   <alias name="ua-312e54ca-633e-4a10-b0ef-07256af107e9"/>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:   <serial>312e54ca-633e-4a10-b0ef-07256af107e9</serial>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:31:11.133605 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:31:11.145194 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdb from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the persistent domain config.
Jun 27 04:31:11.145330 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] (1/8): Attempting to detach device vdb with device alias ua-312e54ca-633e-4a10-b0ef-07256af107e9 from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:   <alias name="ua-312e54ca-633e-4a10-b0ef-07256af107e9"/>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:   <serial>312e54ca-633e-4a10-b0ef-07256af107e9</serial>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:31:11.145594 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:31:11.606385 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534671.6060297, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => ua-312e54ca-633e-4a10-b0ef-07256af107e9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:31:11.607255 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-312e54ca-633e-4a10-b0ef-07256af107e9 for instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:31:11.609490 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdb from instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 from the live domain config.
Jun 27 04:31:11.610582 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:31:11.610856 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '312e54ca-633e-4a10-b0ef-07256af107e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:31:11.610978 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:31:11.611276 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:31:11.611580 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '312e54ca-633e-4a10-b0ef-07256af107e9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:31:11.611691 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:31:11.633187 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:11.633187 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:11.633187 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:31:11.633340 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:11.633340 np0000003830 nova-compute[98984]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9 (non-flash)
Jun 27 04:31:11.633340 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:31:11.633503 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '226')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:31:11.633650 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '225')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:31:11.634451 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9', '226')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:31:11.635118 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518735f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'): ({'sdd'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:31:11.635311 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Removing multipathed devices sdc, sdd {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:31:11.635537 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flush multipath device 330000000689ec845 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:31:11.674921 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:31:11.718120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:31:11.754942 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:31:11.755140 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:31:11.755713 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:31:11.767762 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:31:11.767951 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:31:11.792054 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:11.821893 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.40.100,3260]
Jun 27 04:31:11.821893 np0000003830 nova-compute[98984]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.40.100,3260] successful.
Jun 27 04:31:11.821893 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:11.833178 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:11.843734 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:11.867625 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.50.100,3260]
Jun 27 04:31:11.867625 np0000003830 nova-compute[98984]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-312e54ca-633e-4a10-b0ef-07256af107e9, portal: 192.168.50.100,3260] successful.
Jun 27 04:31:11.867625 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:11.877414 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:31:11.877630 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:31:11.877744 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== disconnect_volume: return (267ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:31:11.877857 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:31:12.425405 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:31:12.840702 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.00045327900033953483 future=<Future at 0x7ec5183891c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:12.841145 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782534657.8400648, 8ec0003a-27ec-4306-b606-dc8f374c9b47 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:31:12.841305 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:12.841430 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] VM Stopped (Lifecycle Event)
Jun 27 04:31:13.343817 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 8ec0003a-27ec-4306-b606-dc8f374c9b47] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:31:13.355993 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:13.430225 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0af0dfd-4ac3-4133-a170-8a1d15e2a525 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.840s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:17.150476 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:17.150936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:17.150936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:17.150936 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:17.151030 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:17.152796 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Terminating instance
Jun 27 04:31:17.655587 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:31:17.669874 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.672064 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.684425 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.690357 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.708261 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.851931 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8d3a6b1-8b7e-4bb3-86bf-7ce2af1a44f8 req-a9b53d08-0ddd-4327-af22-12262b505245 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-unplugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:17.852584 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8d3a6b1-8b7e-4bb3-86bf-7ce2af1a44f8 req-a9b53d08-0ddd-4327-af22-12262b505245 service nova] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:17.852734 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8d3a6b1-8b7e-4bb3-86bf-7ce2af1a44f8 req-a9b53d08-0ddd-4327-af22-12262b505245 service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:17.852857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a8d3a6b1-8b7e-4bb3-86bf-7ce2af1a44f8 req-a9b53d08-0ddd-4327-af22-12262b505245 service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:17.852993 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8d3a6b1-8b7e-4bb3-86bf-7ce2af1a44f8 req-a9b53d08-0ddd-4327-af22-12262b505245 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] No waiting events found dispatching network-vif-unplugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:31:17.853119 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a8d3a6b1-8b7e-4bb3-86bf-7ce2af1a44f8 req-a9b53d08-0ddd-4327-af22-12262b505245 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-unplugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:31:17.938291 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.943942 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:17.964248 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99902283900019 future=<Future at 0x7ec538633c80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:17.964774 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99847767700021 future=<Future at 0x7ec538633c80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:17.964887 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.99834315499993 future=<Future at 0x7ec538633c80 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:17.966533 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Instance destroyed successfully.
Jun 27 04:31:17.967132 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'resources' on Instance uuid 8546ff9e-d529-4f55-8379-4d1f334b12d0 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:31:18.356699 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:18.469592 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1946091842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-1946091842',id=80,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwOEbPQJ66qTbr9qweDGh9vIoZnlKRdwReTLG9ecyp37sdB2gxCnyx1+JIW7K0JgbeyTckBLmfoJcKtuJRFHeX9ItQQmA4lB+cauTjuRjWZ7sd96pKKc+YAjKXYW5Mwnw==',key_name='tempest-keypair-652796712',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:28:41Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-sr0pt76b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=8546ff9e-d529-4f55-8379-4d1f334b12d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:31:18.469806 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "address": "fa:16:3e:80:18:40", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c4bcf9-21", "ovs_interfaceid": "91c4bcf9-214f-40eb-ae78-35d9fe4dee56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:31:18.470358 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:31:18.470640 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:31:18.471754 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:18.472172 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91c4bcf9-21, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:18.473574 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:18.474919 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:31:18.475400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:18.475560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa7f911d-8c27-4dc9-9009-044922426b74) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:18.476988 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:31:18.478404 np0000003830 nova-compute[98984]: INFO os_vif [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:18:40,bridge_name='br-int',has_traffic_filtering=True,id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c4bcf9-21')
Jun 27 04:31:18.478686 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Deleting instance files /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0_del
Jun 27 04:31:18.479432 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Deletion of /opt/stack/data/nova/instances/8546ff9e-d529-4f55-8379-4d1f334b12d0_del complete
Jun 27 04:31:18.985109 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Took 1.33 seconds to destroy the instance on the hypervisor.
Jun 27 04:31:18.986466 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:31:18.986827 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:31:18.986961 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:31:18.987222 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:19.043759 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:19.356307 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3af0dfb9-4b65-417a-a8e0-9d1e84e3d2ca req-0cb94df0-5902-49e5-8efa-6ba8e192c2cd service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-deleted-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:19.356463 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-3af0dfb9-4b65-417a-a8e0-9d1e84e3d2ca req-0cb94df0-5902-49e5-8efa-6ba8e192c2cd service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Neutron deleted interface 91c4bcf9-214f-40eb-ae78-35d9fe4dee56; detaching it from the instance and deleting it from the info cache
Jun 27 04:31:19.358087 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3af0dfb9-4b65-417a-a8e0-9d1e84e3d2ca req-0cb94df0-5902-49e5-8efa-6ba8e192c2cd service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Detach interface failed, port_id=91c4bcf9-214f-40eb-ae78-35d9fe4dee56, reason: Instance 8546ff9e-d529-4f55-8379-4d1f334b12d0 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:31:19.787415 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:31:19.900973 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28d785db-c284-4b82-886c-572522205ddc req-e5c153fc-27fa-4e37-a614-83259b9e2d52 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-unplugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:19.901239 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28d785db-c284-4b82-886c-572522205ddc req-e5c153fc-27fa-4e37-a614-83259b9e2d52 service nova] Acquiring lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:19.901414 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28d785db-c284-4b82-886c-572522205ddc req-e5c153fc-27fa-4e37-a614-83259b9e2d52 service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:19.901544 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-28d785db-c284-4b82-886c-572522205ddc req-e5c153fc-27fa-4e37-a614-83259b9e2d52 service nova] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:19.901695 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28d785db-c284-4b82-886c-572522205ddc req-e5c153fc-27fa-4e37-a614-83259b9e2d52 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] No waiting events found dispatching network-vif-unplugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:31:19.901801 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-28d785db-c284-4b82-886c-572522205ddc req-e5c153fc-27fa-4e37-a614-83259b9e2d52 service nova] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Received event network-vif-unplugged-91c4bcf9-214f-40eb-ae78-35d9fe4dee56 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:31:20.289266 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Took 1.30 seconds to deallocate network for instance.
Jun 27 04:31:20.794569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:20.795021 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:20.883558 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:31:20.883762 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:31:21.386226 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:31:21.892635 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.098s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:21.963061 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Deleted allocations for instance 8546ff9e-d529-4f55-8379-4d1f334b12d0
Jun 27 04:31:22.972008 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-07e49ad6-830b-47a8-893e-0ceec4873d14 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "8546ff9e-d529-4f55-8379-4d1f334b12d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.821s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:23.477390 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:28.076414 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:28.076860 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:28.478859 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:28.578161 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Starting instance... {{(pid=98984) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
Jun 27 04:31:29.122204 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:29.122597 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:29.125582 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98984) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
Jun 27 04:31:29.125723 np0000003830 nova-compute[98984]: INFO nova.compute.claims [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Claim successful on node np0000003830
Jun 27 04:31:30.217933 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:31:30.218350 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:31:30.720709 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:31:31.229629 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.107s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:31.230090 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Start building networks asynchronously for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
Jun 27 04:31:31.736055 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Allocating IP information in the background. {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
Jun 27 04:31:31.736572 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] allocate_for_instance() {{(pid=98984) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
Jun 27 04:31:31.737530 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:31.737530 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:31.814897 np0000003830 nova-compute[98984]: DEBUG nova.policy [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb1df717762741e98e49392818229db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f485b436a624d14aafc66b1936fa4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98984) authorize /opt/stack/nova/nova/policy.py:192}}
Jun 27 04:31:32.194455 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Successfully created port: 02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
Jun 27 04:31:32.236821 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jun 27 04:31:32.625784 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Successfully updated port: 02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
Jun 27 04:31:32.669861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-changed-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:32.669861 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Refreshing instance network info cache due to event network-changed-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:31:32.670037 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] Acquiring lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:31:32.670149 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] Acquired lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:31:32.670481 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Refreshing network info cache for port 02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:31:32.739313 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Start building block device mappings for instance. {{(pid=98984) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
Jun 27 04:31:32.963614 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0003463150001152826 future=<Future at 0x7ec538633c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:32.964105 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782534677.963178, 8546ff9e-d529-4f55-8379-4d1f334b12d0 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:31:32.964321 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:31:32.964507 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] VM Stopped (Lifecycle Event)
Jun 27 04:31:33.130733 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:31:33.173749 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:33.234184 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:31:33.360516 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:31:33.467184 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 8546ff9e-d529-4f55-8379-4d1f334b12d0] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:31:33.480467 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:33.746575 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Start spawning the instance on the hypervisor. {{(pid=98984) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
Jun 27 04:31:33.747426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Creating instance directory {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}}
Jun 27 04:31:33.747700 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Creating image(s)
Jun 27 04:31:33.748145 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "/opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:33.748325 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "/opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:33.748771 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "/opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:33.749319 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:31:33.751669 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:31:33.752463 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:33.838214 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.085s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:33.838663 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:33.839118 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:33.839652 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:31:33.842092 np0000003830 nova-compute[98984]: DEBUG oslo_utils.imageutils.format_inspector [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98984) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}}
Jun 27 04:31:33.842421 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:33.864042 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-5bb23427-4f0b-4ef3-bf81-3755ca3fb401 req-69d6182c-0261-4551-a8d0-747eb2e7038d service nova] Releasing lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:31:33.865132 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquired lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:31:33.865480 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Building network info cache for instance {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
Jun 27 04:31:33.926755 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.084s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:33.927178 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk 1073741824 {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:34.003689 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26,backing_fmt=raw /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk 1073741824" returned: 0 in 0.076s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:34.004135 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "4d8671a2edb19281fa34f8d53898a85ff4290a26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:34.004572 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:34.101380 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d8671a2edb19281fa34f8d53898a85ff4290a26 --force-share --output=json" returned: 0 in 0.096s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:34.101850 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk. size=1073741824 {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
Jun 27 04:31:34.102119 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:34.191691 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:34.192138 np0000003830 nova-compute[98984]: DEBUG nova.virt.disk.api [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Cannot resize image /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk to a smaller size. {{(pid=98984) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
Jun 27 04:31:34.192595 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Created local disks {{(pid=98984) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}}
Jun 27 04:31:34.192819 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Ensure instance console log exists: /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/console.log {{(pid=98984) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}}
Jun 27 04:31:34.193134 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:34.193410 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:34.193608 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:34.425653 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Instance cache missing network info. {{(pid=98984) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3365}}
Jun 27 04:31:34.581448 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:34.695202 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Updating instance_info_cache with network_info: [{"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:31:35.197388 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Releasing lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:31:35.197662 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Instance network_info: |[{"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98984) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
Jun 27 04:31:35.199521 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Start _get_guest_xml network_info=[{"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'image_id': 'ebd84a34-fa18-42ad-a673-89aa8032841e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8210}}
Jun 27 04:31:35.204163 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:31:35.205570 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ebd84a34-fa18-42ad-a673-89aa8032841e', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-486990088', uuid='663bc261-915f-4398-9b3f-7dc4f3825e27'), owner=OwnerMeta(userid='fb1df717762741e98e49392818229db4', username='tempest-VolumeMultiattachTests-379193713-project-member', projectid='9f485b436a624d14aafc66b1936fa4be', projectname='tempest-VolumeMultiattachTests-379193713'), image=ImageMeta(id='ebd84a34-fa18-42ad-a673-89aa8032841e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782534695.2052047) {{(pid=98984) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
Jun 27 04:31:35.206664 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V1... {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}}
Jun 27 04:31:35.206993 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU controller missing on host. {{(pid=98984) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}}
Jun 27 04:31:35.208038 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching host: 'np0000003830' for CPU controller through CGroups V2... {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}}
Jun 27 04:31:35.208206 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.host [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU controller found on host. {{(pid=98984) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}}
Jun 27 04:31:35.209101 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98984) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}}
Jun 27 04:31:35.209398 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-27T04:02:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-27T04:01:46Z,direct_url=<?>,disk_format='qcow2',id=ebd84a34-fa18-42ad-a673-89aa8032841e,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ec663b0044224dec83cc0cdb7e399abd',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-06-27T04:01:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
Jun 27 04:31:35.209546 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flavor limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
Jun 27 04:31:35.209652 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Image limits 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
Jun 27 04:31:35.209749 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flavor pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
Jun 27 04:31:35.209837 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Image pref 0:0:0 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
Jun 27 04:31:35.209924 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
Jun 27 04:31:35.210083 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
Jun 27 04:31:35.210179 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
Jun 27 04:31:35.210285 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got 1 possible topologies {{(pid=98984) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
Jun 27 04:31:35.210460 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
Jun 27 04:31:35.210524 np0000003830 nova-compute[98984]: DEBUG nova.virt.hardware [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98984) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
Jun 27 04:31:35.219834 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-486990088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-486990088',id=82,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ75EKn4rE7w7kRCLfak2t+oS063VCCRqNmEzR8zcl0wcFQDw0FIu5f7FAtpJvzJkhroWa7FyYiMMA8SaP2B11SNeTv4x0WolV3Ojqr2dGUNrJotB07yvn2smYAFHWGw==',key_name='tempest-keypair-196052447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-qzcemgmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=663bc261-915f-4398-9b3f-7dc4f3825e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98984) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
Jun 27 04:31:35.220038 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:31:35.220477 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:31:35.220962 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'pci_devices' on Instance uuid 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] End _get_guest_xml xml=<domain type="qemu">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <uuid>663bc261-915f-4398-9b3f-7dc4f3825e27</uuid>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <name>instance-00000052</name>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <memory>196608</memory>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <vcpu>1</vcpu>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <metadata>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:package version="33.1.0"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:name>tempest-VolumeMultiattachTests-server-486990088</nova:name>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:creationTime>2026-06-27 04:31:35</nova:creationTime>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:flavor name="m1.nano" id="42">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:memory>192</nova:memory>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:disk>1</nova:disk>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:swap>0</nova:swap>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:ephemeral>0</nova:ephemeral>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:vcpus>1</nova:vcpus>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:extraSpecs>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         </nova:extraSpecs>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       </nova:flavor>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:image uuid="ebd84a34-fa18-42ad-a673-89aa8032841e">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:containerFormat>bare</nova:containerFormat>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:diskFormat>qcow2</nova:diskFormat>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:minDisk>1</nova:minDisk>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:minRam>0</nova:minRam>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:properties>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:           <nova:property name="hw_rng_model">virtio</nova:property>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         </nova:properties>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       </nova:image>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:owner>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:user uuid="fb1df717762741e98e49392818229db4">tempest-VolumeMultiattachTests-379193713-project-member</nova:user>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:project uuid="9f485b436a624d14aafc66b1936fa4be">tempest-VolumeMultiattachTests-379193713</nova:project>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       </nova:owner>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:root type="image" uuid="ebd84a34-fa18-42ad-a673-89aa8032841e"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <nova:ports>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         <nova:port uuid="02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:         </nova:port>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       </nova:ports>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </nova:instance>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   </metadata>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <sysinfo type="smbios">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <system>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <entry name="product">OpenStack Nova</entry>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <entry name="version">33.1.0</entry>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <entry name="serial">663bc261-915f-4398-9b3f-7dc4f3825e27</entry>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <entry name="uuid">663bc261-915f-4398-9b3f-7dc4f3825e27</entry>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <entry name="family">Virtual Machine</entry>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </system>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   </sysinfo>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <os>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <type arch="x86_64" machine="pc">hvm</type>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <boot dev="hd"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <smbios mode="sysinfo"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   </os>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <features>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <acpi/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <tcg>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <tb-cache unit="MiB">128</tb-cache>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </tcg>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <vmcoreinfo/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   </features>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <iothreads>1</iothreads>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <clock offset="utc"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <cpu mode="custom" match="exact">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <model>Nehalem</model>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <topology sockets="1" cores="1" threads="1"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   </cpu>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   <devices>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <disk type="file" device="disk">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <driver name="qemu" type="qcow2" cache="none"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <target dev="vda" bus="virtio"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <disk type="file" device="cdrom">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <driver name="qemu" type="raw" cache="none"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <source file="/opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.config"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <target dev="hda" bus="ide"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </disk>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <interface type="ethernet">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <mac address="fa:16:3e:75:96:51"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <driver name="qemu"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <mtu size="1372"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <target dev="tap02a8f9f9-b3"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </interface>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <serial type="pty">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <log file="/opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/console.log" append="off"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </serial>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <video>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <model type="virtio"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </video>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <rng model="virtio">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <backend model="random">/dev/urandom</backend>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </rng>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <controller type="usb" index="0" model="none"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:       <stats period="10"/>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:     </memballoon>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:   </devices>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]: </domain>
Jun 27 04:31:35.723708 np0000003830 nova-compute[98984]:  {{(pid=98984) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8217}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Preparing to wait for external event network-vif-plugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-27T04:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-486990088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-486990088',id=82,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ75EKn4rE7w7kRCLfak2t+oS063VCCRqNmEzR8zcl0wcFQDw0FIu5f7FAtpJvzJkhroWa7FyYiMMA8SaP2B11SNeTv4x0WolV3Ojqr2dGUNrJotB07yvn2smYAFHWGw==',key_name='tempest-keypair-196052447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-qzcemgmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-27T04:31:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=663bc261-915f-4398-9b3f-7dc4f3825e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:31:35.725980 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:31:35.726251 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3') {{(pid=98984) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
Jun 27 04:31:35.726574 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.727923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:35.727923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jun 27 04:31:35.727923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.727923 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7629cecf-89da-5a67-8848-d20544590153', '_type': 'linux-noop'}}, row=False) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:35.728835 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.729432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:31:35.729910 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.731624 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.731756 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02a8f9f9-b3, may_exist=True, interface_attrs={}) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:35.732054 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02a8f9f9-b3, col_values=(('qos', UUID('11aa7c75-b85c-4bc3-a0b8-1189a37547fc')),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:35.732232 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02a8f9f9-b3, col_values=(('external_ids', {'iface-id': '02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:96:51', 'vm-uuid': '663bc261-915f-4398-9b3f-7dc4f3825e27'}),), if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:31:35.741784 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.742978 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:31:35.747082 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:35.747879 np0000003830 nova-compute[98984]: INFO os_vif [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3')
Jun 27 04:31:37.279287 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:31:37.279741 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:31:37.279741 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:75:96:51, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:31:37.279998 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Using config drive
Jun 27 04:31:37.785452 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:37.911023 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Creating config drive at /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.config
Jun 27 04:31:37.914693 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp15vcq_0z {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:37.967962 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp15vcq_0z" returned: 0 in 0.053s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:38.343542 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.383260 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.384163 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.468783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.475211 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.531676 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ad5b1744-6f4b-4be3-b91e-ebda67170aad req-1217f45f-fe92-4d75-939b-d29d6c4550da service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-plugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:38.532529 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ad5b1744-6f4b-4be3-b91e-ebda67170aad req-1217f45f-fe92-4d75-939b-d29d6c4550da service nova] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:38.532529 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ad5b1744-6f4b-4be3-b91e-ebda67170aad req-1217f45f-fe92-4d75-939b-d29d6c4550da service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:38.532529 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-ad5b1744-6f4b-4be3-b91e-ebda67170aad req-1217f45f-fe92-4d75-939b-d29d6c4550da service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:38.532529 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-ad5b1744-6f4b-4be3-b91e-ebda67170aad req-1217f45f-fe92-4d75-939b-d29d6c4550da service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Processing event network-vif-plugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
Jun 27 04:31:38.625093 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.629457 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:38.641772 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:39.055074 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534699.054684, 663bc261-915f-4398-9b3f-7dc4f3825e27 => Started> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:31:39.055229 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] VM Started (Lifecycle Event)
Jun 27 04:31:39.056836 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98984) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
Jun 27 04:31:39.059487 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Guest created on hypervisor {{(pid=98984) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}}
Jun 27 04:31:39.062558 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Instance spawned successfully.
Jun 27 04:31:39.062998 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
Jun 27 04:31:39.558069 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:31:39.561426 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:31:39.569895 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Found default for hw_cdrom_bus of ide {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:31:39.570044 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Found default for hw_disk_bus of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:31:39.570426 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Found default for hw_input_bus of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:31:39.570773 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Found default for hw_pointer_model of None {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:31:39.571124 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Found default for hw_video_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:31:39.571467 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Found default for hw_vif_model of virtio {{(pid=98984) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
Jun 27 04:31:40.064309 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] During sync_power_state the instance has a pending task (spawning). Skip.
Jun 27 04:31:40.064638 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534700.0644548, 663bc261-915f-4398-9b3f-7dc4f3825e27 => Paused> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:31:40.064755 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] VM Paused (Lifecycle Event)
Jun 27 04:31:40.076698 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Took 6.33 seconds to spawn the instance on the hypervisor.
Jun 27 04:31:40.076926 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:31:40.192432 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:40.566882 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:31:40.568853 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Emitting event <LifecycleEvent: 1782534700.568646, 663bc261-915f-4398-9b3f-7dc4f3825e27 => Resumed> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:31:40.568974 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] VM Resumed (Lifecycle Event)
Jun 27 04:31:40.582061 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22ca9bcb-4559-4345-8248-e0959c59900c req-66e7ee04-f033-4001-a729-d18e4456c50d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-plugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:40.582228 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22ca9bcb-4559-4345-8248-e0959c59900c req-66e7ee04-f033-4001-a729-d18e4456c50d service nova] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:40.582569 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22ca9bcb-4559-4345-8248-e0959c59900c req-66e7ee04-f033-4001-a729-d18e4456c50d service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:40.582718 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-22ca9bcb-4559-4345-8248-e0959c59900c req-66e7ee04-f033-4001-a729-d18e4456c50d service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:40.583102 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-22ca9bcb-4559-4345-8248-e0959c59900c req-66e7ee04-f033-4001-a729-d18e4456c50d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] No waiting events found dispatching network-vif-plugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:31:40.585180 np0000003830 nova-compute[98984]: WARNING nova.compute.manager [req-22ca9bcb-4559-4345-8248-e0959c59900c req-66e7ee04-f033-4001-a729-d18e4456c50d service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received unexpected event network-vif-plugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 for instance with vm_state active and task_state None.
Jun 27 04:31:40.585730 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Took 11.50 seconds to build instance.
Jun 27 04:31:40.734203 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:40.827119 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:40.827119 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:31:40.829915 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:40.830206 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:31:41.071616 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:31:41.073989 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98984) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
Jun 27 04:31:41.087524 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-b24fe32f-f0d2-4809-8a46-c973ac854a5c tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.011s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:41.829994 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:41.830463 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:41.954291 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-changed-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:31:41.954349 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Refreshing instance network info cache due to event network-changed-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99. {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
Jun 27 04:31:41.954552 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] Acquiring lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 27 04:31:41.954655 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] Acquired lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 27 04:31:41.954764 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Refreshing network info cache for port 02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
Jun 27 04:31:42.335522 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:42.335720 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:42.335889 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:42.336051 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:31:42.456792 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:42.728062 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:31:42.841611 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Updated VIF entry in instance network info cache for port 02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99. {{(pid=98984) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3524}}
Jun 27 04:31:42.841953 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Updating instance_info_cache with network_info: [{"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:31:43.344083 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-a162922c-3337-4739-ac3e-069f85e5ae53 req-a571bd37-cddd-4db7-a982-1aea170fd8bf service nova] Releasing lock "refresh_cache-663bc261-915f-4398-9b3f-7dc4f3825e27" {{(pid=98984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 27 04:31:43.353905 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:43.451933 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:43.452643 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk --force-share --output=json {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:43.543886 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:43.549419 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:31:43.551158 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:31:43.605365 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:31:43.605844 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=51814MB free_disk=71.67372512817383GB free_vcpus=15 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:31:43.606106 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:31:43.606431 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:31:44.662528 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Instance 663bc261-915f-4398-9b3f-7dc4f3825e27 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98984) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
Jun 27 04:31:44.662892 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 1 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:31:44.662892 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=16 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:31:43 up 54 min,  2 users,  load average: 1.27, 2.57, 4.19\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_9f485b436a624d14aafc66b1936fa4be': '1', 'io_workload': '0'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:31:44.762908 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:31:44.763165 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:31:45.193815 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:45.265986 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:31:45.736623 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:45.772172 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:31:45.772346 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.166s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:31:45.772814 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:45.772983 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=98984) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
Jun 27 04:31:46.274905 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:31:47.028775 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:31:50.205321 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:50.738365 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:52.274795 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:52.275199 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:52.275233 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:52.275389 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:52.275584 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:31:52.275713 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:31:52.275913 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.55 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:31:55.205795 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:31:55.738711 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:00.207039 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:00.739980 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:02.830299 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:03.332622 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:05.208612 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:05.741377 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:05.848769 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:05.848895 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:06.351861 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:32:07.356290 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:08.416797 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:08.417240 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:08.417240 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Attaching volume 4f4c219c-1533-4dd4-9115-949e8055cca4 to /dev/vdb
Jun 27 04:32:08.452944 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.18', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003830', 'execute': None}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:32:08.463618 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.scaleio [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98984) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
Jun 27 04:32:08.485267 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Running cmd (subprocess): nvme version {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:32:08.528709 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] 'nvme version' failed. Not Retrying. {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 27 04:32:08.528986 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] nvme not present on system {{(pid=98984) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
Jun 27 04:32:08.537692 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98984) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
Jun 27 04:32:08.538601 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.lightos [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Current host hostNQN  and IP(s) are ['10.4.3.18', 'fe80::f816:3eff:fee1:ddb8', '192.168.40.6', 'fe80::f816:3eff:fe31:dd77', '192.168.50.6', 'fe80::f816:3eff:feaa:b58c', '192.168.10.6', 'fe80::f816:3eff:fe63:7faf', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::9c90:2fff:feb4:164f', 'fe80::fc16:3eff:fe75:9651', 'fe80::9c80:63ff:fe69:e73'] 
Jun 27 04:32:08.538711 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
Jun 27 04:32:08.538837 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.lightos [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] LIGHTOS: no hostnqn found. {{(pid=98984) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
Jun 27 04:32:08.539081 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.18', 'host': 'np0000003830', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:285952d3c097', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '46a48708-2437-4aca-a317-7807b5e4ff79', 'nvme_native_multipath': False} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:32:08.539335 np0000003830 nova-compute[98984]: DEBUG nova.virt.block_device [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Updating existing volume attachment record: 5df3beab-c2c5-4bf9-9f3b-b41f8d5da1f8 {{(pid=98984) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
Jun 27 04:32:09.088048 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Calling os-brick to attach iSCSI Volume {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jun 27 04:32:09.088559 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f4c219c-1533-4dd4-9115-949e8055cca4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:32:09.088706 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:32:09.089096 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:32:09.089436 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f4c219c-1533-4dd4-9115-949e8055cca4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
Jun 27 04:32:09.100689 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:32:09.101303 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:32:09.101821 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:32:09.102028 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:32:09.103055 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:32:09.103380 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:32:09.113312 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:32:09.113312 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:09.118104 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jun 27 04:32:09.118104 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4] added
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:09.125003 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:32:09.125272 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:32:09.125272 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4] added
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]:  stderr=iscsiadm: Config file line 363 does not have value
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: iscsiadm: Config file line 363 does not have value
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98984) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
Jun 27 04:32:09.129231 np0000003830 nova-compute[98984]: DEBUG os_brick.utils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98984) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
Jun 27 04:32:10.125766 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
Jun 27 04:32:10.129618 np0000003830 nova-compute[98984]: INFO os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.40.100
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:32:10.137143 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.name = iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.tpgt = -1
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.startup = manual
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.leading_login = No
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.iscsi_ifacename = default
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.net_ifacename = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.ipaddress = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.prefix_len = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.hwaddress = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.transport_name = tcp
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.initiatorname = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.vlan_id = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.vlan_priority = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.vlan_state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.iface_num = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.mtu = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.port = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.bootproto = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.subnet_mask = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.gateway = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id_state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_alt_client_id = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_dns = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_learn_iqn = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_req_vendor_id_state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id_state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_vendor_id = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.dhcp_slp_da = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.fragmentation = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.gratuitous_arp = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.incoming_forwarding = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tos_state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tos = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.ttl = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.delayed_ack = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tcp_nagle = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tcp_wsf_state = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tcp_wsf = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tcp_timer_scale = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.tcp_timestamp = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.redirect = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.def_task_mgmt_timeout = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.header_digest = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.data_digest = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.immediate_data = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.initial_r2t = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.data_seq_inorder = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.data_pdu_inorder = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.erl = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.max_receive_data_len = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.first_burst_len = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.max_outstanding_r2t = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.max_burst_len = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.chap_auth = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.bidi_chap = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.strict_login_compliance = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.discovery_auth = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: iface.discovery_logout = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.discovery_address = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.discovery_port = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.discovery_type = fw
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.initial_cmdsn = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.initial_login_retry_max = 8
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.xmit_thread_priority = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.cmds_max = 128
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.queue_depth = 32
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.nr_sessions = 1
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.auth.authmethod = None
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.auth.username = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.auth.password = ***
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.auth.username_in = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.auth.password_in = <empty>
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.auth.chap_algs = SHA256
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.timeo.replacement_timeout = 120
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.err_timeo.abort_timeout = 15
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.err_timeo.lu_reset_timeout = 30
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.err_timeo.tgt_reset_timeout = 30
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.err_timeo.host_reset_timeout = 60
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.FastAbort = Yes
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.InitialR2T = No
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.ImmediateData = Yes
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.FirstBurstLength = 262144
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.MaxBurstLength = 16776192
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Retain = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.DefaultTime2Wait = 2
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.MaxConnections = 1
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.MaxOutstandingR2T = 1
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.iscsi.ERL = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.scan = auto
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.session.reopen_max = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].address = 192.168.50.100
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].port = 3260
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].startup = manual
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].tcp.window_size = 524288
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].tcp.type_of_service = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].timeo.logout_timeout = 15
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].timeo.login_timeout = 15
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].timeo.auth_timeout = 45
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_interval = 5
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].timeo.noop_out_timeout = 5
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].iscsi.HeaderDigest = None
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].iscsi.DataDigest = None
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].iscsi.IFMarker = No
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: node.conn[0].iscsi.OFMarker = No
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]: # END RECORD
Jun 27 04:32:10.142601 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:10.148477 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:10.154120 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:10.160049 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:32:10.160049 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:32:10.160266 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:32:10.160266 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:32:10.160328 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:32:10.160328 np0000003830 nova-compute[98984]: 
Jun 27 04:32:10.166504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:32:10.166504 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:32:10.166682 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jun 27 04:32:10.166682 np0000003830 nova-compute[98984]:  {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:32:10.166838 np0000003830 nova-compute[98984]: WARNING os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jun 27 04:32:10.166838 np0000003830 nova-compute[98984]: 
Jun 27 04:32:10.209159 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:10.743047 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:11.195538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.40.100,3260]
Jun 27 04:32:11.195538 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.40.100,3260] successful.
Jun 27 04:32:11.195538 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:11.196538 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.50.100,3260]
Jun 27 04:32:11.196538 np0000003830 nova-compute[98984]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.50.100,3260] successful.
Jun 27 04:32:11.196538 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:11.205771 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:11.211121 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:11.218450 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.218450 np0000003830 nova-compute[98984]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.218450 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:32:11.218625 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.218625 np0000003830 nova-compute[98984]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.218625 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:32:11.218888 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.117s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:32:11.218992 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.40.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:32:11.219468 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('7', '-', '-', 0) found on session 231 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:32:11.219590 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:32:11.224090 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.224090 np0000003830 nova-compute[98984]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.224090 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:32:11.224251 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.224251 np0000003830 nova-compute[98984]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:11.224251 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:32:11.224540 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.122s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:32:11.224705 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to 192.168.50.100:3260 {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
Jun 27 04:32:11.225244 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] HCTL ('8', '-', '-', 0) found on session 232 with lun 0 {{(pid=98984) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
Jun 27 04:32:11.225383 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98984) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
Jun 27 04:32:11.231477 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 231 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:32:11.231725 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f4c219c-1533-4dd4-9115-949e8055cca4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:32:11.237519 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 232 and hctl ['8', '*', '*', 0] yield: None {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:32:12.238056 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Searching for a device in session 232 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98984) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
Jun 27 04:32:12.238521 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4f4c219c-1533-4dd4-9115-949e8055cca4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98984) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
Jun 27 04:32:12.333573 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:12.333573 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Cleaning up deleted instances {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
Jun 27 04:32:12.835354 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] There are 0 instances to clean {{(pid=98984) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
Jun 27 04:32:12.835620 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.66 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:13.118151 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found WWN 33000000017927b07 for multipath device dm-0 {{(pid=98984) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
Jun 27 04:32:13.118454 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:32:13.118726 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '33000000017927b07', 'path': '/dev/dm-0', 'multipath_id': '33000000017927b07'} {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:32:13.118894 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000017927b07', 'path': '/dev/dm-0', 'multipath_id': '33000000017927b07'} {{(pid=98984) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
Jun 27 04:32:13.122245 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:32:13.492219 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:13.625090 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Attempting to attach volume 4f4c219c-1533-4dd4-9115-949e8055cca4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98984) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}}
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] attach device xml: <disk type="block" device="disk">
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:   <alias name="ua-4f4c219c-1533-4dd4-9115-949e8055cca4"/>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:   <serial>4f4c219c-1533-4dd4-9115-949e8055cca4</serial>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:32:13.626441 np0000003830 nova-compute[98984]:  {{(pid=98984) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
Jun 27 04:32:13.996084 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:15.256035 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:32:15.256482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:32:15.256482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No BDM found with device name hda, not building metadata. {{(pid=98984) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13230}}
Jun 27 04:32:15.256482 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] No VIF found with MAC fa:16:3e:75:96:51, not building metadata {{(pid=98984) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13206}}
Jun 27 04:32:15.745087 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:16.802594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-9d3ddda1-54b9-4c24-ba02-09a9bceaa976 tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.385s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:17.302312 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:17.302460 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:17.804514 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Detaching volume 4f4c219c-1533-4dd4-9115-949e8055cca4
Jun 27 04:32:17.840237 np0000003830 nova-compute[98984]: INFO nova.virt.block_device [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Attempting to driver detach volume 4f4c219c-1533-4dd4-9115-949e8055cca4 from mountpoint /dev/vdb
Jun 27 04:32:17.844811 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdb by alias ua-4f4c219c-1533-4dd4-9115-949e8055cca4 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:32:17.845919 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Found disk vdb by alias ua-4f4c219c-1533-4dd4-9115-949e8055cca4 {{(pid=98984) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}}
Jun 27 04:32:17.846028 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Attempting to detach device vdb from instance 663bc261-915f-4398-9b3f-7dc4f3825e27 from the persistent domain config. {{(pid=98984) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}}
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <alias name="ua-4f4c219c-1533-4dd4-9115-949e8055cca4"/>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <serial>4f4c219c-1533-4dd4-9115-949e8055cca4</serial>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:32:17.846230 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:32:17.853305 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdb from instance 663bc261-915f-4398-9b3f-7dc4f3825e27 from the persistent domain config.
Jun 27 04:32:17.853419 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] (1/8): Attempting to detach device vdb with device alias ua-4f4c219c-1533-4dd4-9115-949e8055cca4 from instance 663bc261-915f-4398-9b3f-7dc4f3825e27 from the live domain config. {{(pid=98984) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}}
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.guest [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] detach device xml: <disk type="block" device="disk">
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <alias name="ua-4f4c219c-1533-4dd4-9115-949e8055cca4"/>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <source dev="/dev/dm-0"/>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <target dev="vdb" bus="virtio"/>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <serial>4f4c219c-1533-4dd4-9115-949e8055cca4</serial>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <shareable/>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]: </disk>
Jun 27 04:32:17.853683 np0000003830 nova-compute[98984]:  {{(pid=98984) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
Jun 27 04:32:18.307680 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Received event <DeviceRemovedEvent: 1782534738.3073, 663bc261-915f-4398-9b3f-7dc4f3825e27 => ua-4f4c219c-1533-4dd4-9115-949e8055cca4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98984) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Jun 27 04:32:18.308484 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4f4c219c-1533-4dd4-9115-949e8055cca4 for instance 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}}
Jun 27 04:32:18.310901 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully detached device vdb from instance 663bc261-915f-4398-9b3f-7dc4f3825e27 from the live domain config.
Jun 27 04:32:18.338110 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] calling os-brick to detach iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
Jun 27 04:32:18.338348 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ec5385a4fb0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f4c219c-1533-4dd4-9115-949e8055cca4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
Jun 27 04:32:18.338467 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
Jun 27 04:32:18.338772 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
Jun 27 04:32:18.339028 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f4c219c-1533-4dd4-9115-949e8055cca4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
Jun 27 04:32:18.339126 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', 0)] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
Jun 27 04:32:18.360292 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:18.360292 np0000003830 nova-compute[98984]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:18.360292 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
Jun 27 04:32:18.360563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsi session list stdout=tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:18.360563 np0000003830 nova-compute[98984]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4 (non-flash)
Jun 27 04:32:18.360563 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
Jun 27 04:32:18.360563 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', '231'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', '232')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
Jun 27 04:32:18.360763 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', '231')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:32:18.361274 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4', '232')] {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
Jun 27 04:32:18.361845 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ec518776660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'): ({'sdc'}, set())}) {{(pid=98984) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
Jun 27 04:32:18.362007 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Removing multipathed devices sdb, sdc {{(pid=98984) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
Jun 27 04:32:18.362264 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Flush multipath device 33000000017927b07 {{(pid=98984) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
Jun 27 04:32:18.401929 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:32:18.441041 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98984) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
Jun 27 04:32:18.482808 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
Jun 27 04:32:18.482968 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98984) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
Jun 27 04:32:18.483504 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
Jun 27 04:32:18.493378 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.linuxscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98984) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
Jun 27 04:32:18.493565 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4')] {{(pid=98984) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
Jun 27 04:32:18.503578 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:18.527088 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.40.100,3260]
Jun 27 04:32:18.527088 np0000003830 nova-compute[98984]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.40.100,3260] successful.
Jun 27 04:32:18.527088 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:18.537025 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:18.546506 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:18.568048 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 232, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.50.100,3260]
Jun 27 04:32:18.568048 np0000003830 nova-compute[98984]: Logout of [sid: 232, target: iqn.2023-03.storpool.com:os--volume-4f4c219c-1533-4dd4-9115-949e8055cca4, portal: 192.168.50.100,3260] successful.
Jun 27 04:32:18.568048 np0000003830 nova-compute[98984]:  stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:18.577027 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98984) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
Jun 27 04:32:18.577213 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.base [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.238s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
Jun 27 04:32:18.577320 np0000003830 nova-compute[98984]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] <== disconnect_volume: return (238ms) None {{(pid=98984) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
Jun 27 04:32:18.577420 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Disconnected iSCSI Volume {{(pid=98984) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
Jun 27 04:32:19.119235 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'flavor' on Instance uuid 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:32:20.124704 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c3214961-d33e-4966-b7a1-cfd3ecaf2e6a tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.822s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:20.747241 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:21.649101 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:21.649491 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:21.649491 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:21.649491 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:21.649491 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:21.651341 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Terminating instance
Jun 27 04:32:21.990076 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:22.154139 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Start destroying the instance on the hypervisor. {{(pid=98984) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
Jun 27 04:32:22.167820 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.169740 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.182322 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.186418 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.203078 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.300693 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3c2dd7c4-aa14-465e-835e-207a8cd36e2b req-b3cd41fe-8ee1-467f-a82b-a9735c132dba service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-unplugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:32:22.300844 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3c2dd7c4-aa14-465e-835e-207a8cd36e2b req-b3cd41fe-8ee1-467f-a82b-a9735c132dba service nova] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:22.301068 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3c2dd7c4-aa14-465e-835e-207a8cd36e2b req-b3cd41fe-8ee1-467f-a82b-a9735c132dba service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:22.301116 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-3c2dd7c4-aa14-465e-835e-207a8cd36e2b req-b3cd41fe-8ee1-467f-a82b-a9735c132dba service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:22.301793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3c2dd7c4-aa14-465e-835e-207a8cd36e2b req-b3cd41fe-8ee1-467f-a82b-a9735c132dba service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] No waiting events found dispatching network-vif-unplugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:32:22.301793 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3c2dd7c4-aa14-465e-835e-207a8cd36e2b req-b3cd41fe-8ee1-467f-a82b-a9735c132dba service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-unplugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:32:22.367665 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.467734 np0000003830 nova-compute[98984]: DEBUG nova.utils [None req-57c1172f-9d2a-43c0-9402-f9f00dae6642 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999725547999788 future=<Future at 0x7ec5385a42f0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:32:22.468451 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.999020699999619 future=<Future at 0x7ec5385a42f0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:32:22.468575 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=14.998857484999917 future=<Future at 0x7ec5385a42f0 state=pending>) {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:32:22.469654 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [-] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Instance destroyed successfully.
Jun 27 04:32:22.470087 np0000003830 nova-compute[98984]: DEBUG nova.objects.instance [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lazy-loading 'resources' on Instance uuid 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
Jun 27 04:32:22.493597 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Triggering sync for uuid 663bc261-915f-4398-9b3f-7dc4f3825e27 {{(pid=98984) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
Jun 27 04:32:22.494202 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:22.494550 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 19.84 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:22.972688 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.vif [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-27T04:31:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-486990088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000003830',hostname='tempest-volumemultiattachtests-server-486990088',id=82,image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdJ75EKn4rE7w7kRCLfak2t+oS063VCCRqNmEzR8zcl0wcFQDw0FIu5f7FAtpJvzJkhroWa7FyYiMMA8SaP2B11SNeTv4x0WolV3Ojqr2dGUNrJotB07yvn2smYAFHWGw==',key_name='tempest-keypair-196052447',keypairs=<?>,launch_index=0,launched_at=2026-06-27T04:31:40Z,launched_on='np0000003830',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000003830',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f485b436a624d14aafc66b1936fa4be',ramdisk_id='',reservation_id='r-qzcemgmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebd84a34-fa18-42ad-a673-89aa8032841e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-379193713',owner_user_name='tempest-VolumeMultiattachTests-379193713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-06-27T04:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb1df717762741e98e49392818229db4',uuid=663bc261-915f-4398-9b3f-7dc4f3825e27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
Jun 27 04:32:22.973229 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converting VIF {"id": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "address": "fa:16:3e:75:96:51", "network": {"id": "8a33e381-12e5-4a78-b7e4-adf25fb8202d", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-55680264-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9f485b436a624d14aafc66b1936fa4be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a8f9f9-b3", "ovs_interfaceid": "02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jun 27 04:32:22.973662 np0000003830 nova-compute[98984]: DEBUG nova.network.os_vif_util [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3') {{(pid=98984) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
Jun 27 04:32:22.973898 np0000003830 nova-compute[98984]: DEBUG os_vif [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3') {{(pid=98984) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
Jun 27 04:32:22.975158 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.975433 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02a8f9f9-b3, bridge=br-int, if_exists=True) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:32:22.995510 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.996590 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:22.997161 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.997313 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11aa7c75-b85c-4bc3-a0b8-1189a37547fc) {{(pid=98984) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jun 27 04:32:22.997731 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:22.998200 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:22.999854 np0000003830 nova-compute[98984]: INFO os_vif [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:96:51,bridge_name='br-int',has_traffic_filtering=True,id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99,network=Network(8a33e381-12e5-4a78-b7e4-adf25fb8202d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a8f9f9-b3')
Jun 27 04:32:23.000157 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Deleting instance files /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27_del
Jun 27 04:32:23.000877 np0000003830 nova-compute[98984]: INFO nova.virt.libvirt.driver [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Deletion of /opt/stack/data/nova/instances/663bc261-915f-4398-9b3f-7dc4f3825e27_del complete
Jun 27 04:32:23.506644 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Took 1.35 seconds to destroy the instance on the hypervisor.
Jun 27 04:32:23.507205 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._common.loopingcall [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98984) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
Jun 27 04:32:23.507616 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [-] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Deallocating network for instance {{(pid=98984) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
Jun 27 04:32:23.507717 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] deallocate_for_instance() {{(pid=98984) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
Jun 27 04:32:23.507961 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:32:23.563509 np0000003830 nova-compute[98984]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
Jun 27 04:32:23.980418 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3c1acbec-5d56-4562-b42c-1c9e01ab3acd req-d19cab66-3727-43c4-a3e3-a4e66e543f7f service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-deleted-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:32:23.980418 np0000003830 nova-compute[98984]: INFO nova.compute.manager [req-3c1acbec-5d56-4562-b42c-1c9e01ab3acd req-d19cab66-3727-43c4-a3e3-a4e66e543f7f service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Neutron deleted interface 02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99; detaching it from the instance and deleting it from the info cache
Jun 27 04:32:23.981878 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-3c1acbec-5d56-4562-b42c-1c9e01ab3acd req-d19cab66-3727-43c4-a3e3-a4e66e543f7f service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Detach interface failed, port_id=02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99, reason: Instance 663bc261-915f-4398-9b3f-7dc4f3825e27 could not be found. {{(pid=98984) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
Jun 27 04:32:24.352979 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d5e43052-bbe5-43c8-bd4f-7ccd077fa7ff req-5544b797-53a2-4630-824a-97f3c5facd5b service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-unplugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
Jun 27 04:32:24.353370 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d5e43052-bbe5-43c8-bd4f-7ccd077fa7ff req-5544b797-53a2-4630-824a-97f3c5facd5b service nova] Acquiring lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:24.353578 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d5e43052-bbe5-43c8-bd4f-7ccd077fa7ff req-5544b797-53a2-4630-824a-97f3c5facd5b service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:24.353662 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [req-d5e43052-bbe5-43c8-bd4f-7ccd077fa7ff req-5544b797-53a2-4630-824a-97f3c5facd5b service nova] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:24.353798 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d5e43052-bbe5-43c8-bd4f-7ccd077fa7ff req-5544b797-53a2-4630-824a-97f3c5facd5b service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] No waiting events found dispatching network-vif-unplugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 {{(pid=98984) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
Jun 27 04:32:24.353879 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [req-d5e43052-bbe5-43c8-bd4f-7ccd077fa7ff req-5544b797-53a2-4630-824a-97f3c5facd5b service nova] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Received event network-vif-unplugged-02a8f9f9-b35f-43c9-a35b-8dbc3e0c2c99 for instance with task_state deleting. {{(pid=98984) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
Jun 27 04:32:24.429877 np0000003830 nova-compute[98984]: DEBUG nova.network.neutron [-] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Updating instance_info_cache with network_info: [] {{(pid=98984) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Jun 27 04:32:24.931854 np0000003830 nova-compute[98984]: INFO nova.compute.manager [-] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Took 1.42 seconds to deallocate network for instance.
Jun 27 04:32:25.436990 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:25.437397 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:25.554138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:32:25.554403 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:32:26.056907 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:32:26.563575 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.126s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:26.617296 np0000003830 nova-compute[98984]: INFO nova.scheduler.client.report [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Deleted allocations for instance 663bc261-915f-4398-9b3f-7dc4f3825e27
Jun 27 04:32:27.625378 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-c0f3c1db-9364-427b-8bae-ec79a1dba2ce tempest-VolumeMultiattachTests-379193713 tempest-VolumeMultiattachTests-379193713-project-member] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.976s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:27.626665 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.131s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:27.640872 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] During sync_power_state the instance has a pending task (deleting). Skip.
Jun 27 04:32:27.640872 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "663bc261-915f-4398-9b3f-7dc4f3825e27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:28.002693 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:28.002857 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:28.002903 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:32:28.002965 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:28.010230 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:28.010391 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:30.022607 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:31.577247 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:33.011015 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:37.467892 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7ec54ef7a8a0>>, remaining_delay=-0.0004051630003232276 future=<Future at 0x7ec5385a42f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7ec54dbfde20> {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:32:37.468365 np0000003830 nova-compute[98984]: DEBUG nova.virt.driver [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] Emitting event <LifecycleEvent: 1782534742.467361, 663bc261-915f-4398-9b3f-7dc4f3825e27 => Stopped> {{(pid=98984) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
Jun 27 04:32:37.468415 np0000003830 nova-compute[98984]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98984) _log /opt/stack/nova/nova/utils.py:1508}}
Jun 27 04:32:37.468577 np0000003830 nova-compute[98984]: INFO nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] VM Stopped (Lifecycle Event)
Jun 27 04:32:37.971397 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-86067f9f-b7c6-45aa-b2bf-76fb7260d4b4 tempest-TestEncryptedCinderVolumes-1089025697 tempest-TestEncryptedCinderVolumes-1089025697-project-member] [instance: 663bc261-915f-4398-9b3f-7dc4f3825e27] Checking state {{(pid=98984) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
Jun 27 04:32:38.014797 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:38.014970 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:38.015098 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:32:38.015098 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:38.026400 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:38.026670 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:42.334754 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:42.335189 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:43.028287 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:43.028458 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:43.028560 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:32:43.028601 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:43.036373 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:43.036565 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:43.830146 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:43.830609 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:44.334594 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:44.334761 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:44.334857 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:44.335022 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:32:44.346648 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:32:44.347442 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:32:44.401589 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:32:44.402266 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=52206MB free_disk=71.66197967529297GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:32:44.402475 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:32:44.402717 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:32:45.455511 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:32:45.456115 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:32:44 up 55 min,  1 user,  load average: 0.73, 2.16, 3.94\n'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:32:45.497853 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Refreshing inventories for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
Jun 27 04:32:45.537949 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Updating ProviderTree inventory for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
Jun 27 04:32:45.538106 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Updating inventory in ProviderTree for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jun 27 04:32:45.575271 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Refreshing aggregate associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, aggregates: None {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
Jun 27 04:32:45.618361 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Refreshing trait associations for resource provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37, traits: HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_PPC64LE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSSE3,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_AARCH64,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NODE,COMPUTE_ARCH_RISCV64,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_RESCUE_BFV {{(pid=98984) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
Jun 27 04:32:45.662537 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:32:45.662822 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:32:46.165688 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:32:46.672566 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:32:46.672984 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.270s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:32:46.673085 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:48.038430 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:48.038929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:32:48.038929 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:32:48.039055 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:48.042559 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:48.042808 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:32:52.673053 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:52.673618 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:52.673618 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:52.673618 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:32:52.673770 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.16 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:52.831163 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:52.831443 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:53.043237 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:32:53.826642 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:32:53.827140 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:32:58.044258 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:03.049715 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:03.051775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:03.051775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:03.051775 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:03.059563 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:03.059803 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:08.065024 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:08.065549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:08.065549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:08.065549 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:08.072518 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:08.072709 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:13.077134 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:13.077806 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:13.077907 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:13.077993 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:13.083461 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:13.083677 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:18.087764 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:18.088076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:18.088076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:18.088076 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:18.093535 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:18.093690 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:23.096193 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:23.096563 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:23.096563 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:23.096563 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:23.105595 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:23.105769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:28.107136 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:28.107769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:28.107769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:28.107769 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:28.113530 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:28.113688 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:33.117106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:33.117106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:33.117106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:33.117106 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:33.121017 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:33.121017 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:38.135602 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:43.136853 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:43.137376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:43.137376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:43.137376 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:43.148790 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:43.148943 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:43.826248 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:43.826451 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:33:43.829783 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:43.829990 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:33:44.830032 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:44.830490 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:45.334772 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:33:45.334982 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:33:45.335117 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:33:45.335287 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Auditing locally available compute resources for np0000003830 (node: np0000003830) {{(pid=98984) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
Jun 27 04:33:45.348080 np0000003830 nova-compute[98984]: WARNING nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jun 27 04:33:45.348937 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 27 04:33:45.394580 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.processutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98984) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 27 04:33:45.394974 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Hypervisor/Node resource view: name=np0000003830 free_ram=52072MB free_disk=71.63372802734375GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98984) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
Jun 27 04:33:45.395161 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 27 04:33:45.395460 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 27 04:33:46.441879 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
Jun 27 04:33:46.442338 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Final resource view: name=np0000003830 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:33:45 up 56 min,  2 users,  load average: 0.49, 1.82, 3.71\n'} {{(pid=98984) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
Jun 27 04:33:46.482138 np0000003830 nova-compute[98984]: DEBUG nova.virt.libvirt.driver [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98984) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9969}}
Jun 27 04:33:46.482376 np0000003830 nova-compute[98984]: DEBUG nova.compute.provider_tree [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed in ProviderTree for provider: d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 {{(pid=98984) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jun 27 04:33:46.984959 np0000003830 nova-compute[98984]: DEBUG nova.scheduler.client.report [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Inventory has not changed for provider d6db2083-b24e-4fc9-8e4d-9a740cf9bf37 based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98984) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
Jun 27 04:33:47.030736 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:33:47.492015 np0000003830 nova-compute[98984]: DEBUG nova.compute.resource_tracker [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Compute_service record updated for np0000003830:np0000003830 {{(pid=98984) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
Jun 27 04:33:47.492462 np0000003830 nova-compute[98984]: DEBUG oslo_concurrency.lockutils [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.097s {{(pid=98984) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 27 04:33:47.492541 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:33:48.154557 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:48.154557 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:48.154839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:48.154839 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:48.158608 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:48.158783 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:53.163070 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:53.163707 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
Jun 27 04:33:53.163707 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=98984) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
Jun 27 04:33:53.163707 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:53.170655 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
Jun 27 04:33:53.170859 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98984) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
Jun 27 04:33:54.492475 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:54.492925 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:54.492925 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:54.493149 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:54.493378 np0000003830 nova-compute[98984]: DEBUG nova.compute.manager [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98984) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
Jun 27 04:33:54.493630 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.33 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:33:55.827443 np0000003830 nova-compute[98984]: DEBUG oslo_service.periodic_task [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98984) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 27 04:33:55.827964 np0000003830 nova-compute[98984]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8a729eb-7999-4df7-a5d8-ea76ec63f2ae None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98984) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
Jun 27 04:33:58.183890 np0000003830 nova-compute[98984]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98984) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}